2024-09-15T22:35:17.243 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-15T22:35:17.265 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:35:17.347 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272 branch: squid description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/openfiletable} email: ceph-qa@ceph.com first_in_suite: false job_id: '7906272' kernel: client: branch: testing kdb: 1 sha1: distro ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 8921c8ef947807b717db041d85f0761b7914d5fc ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 8921c8ef947807b717db041d85f0761b7914d5fc kclient: syntax: v1 subvolume_version: 1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ad35db06e8924912f01e32b35576297c0f1352b4 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3393 sha1: 8921c8ef947807b717db041d85f0761b7914d5fc sleep_before_teardown: 0 subset: 294/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ad35db06e8924912f01e32b35576297c0f1352b4 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIILBj6g3PljsUDj0w4WmpgNIQYBdiYxTLzFbylhPCRszr7XjydH/H4iyEGJn73V721UrBFWNeLTQmIvDMEyjH4= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM86ZmAbNqm483qSSELe5WSHxrRrhifA1D69yfSJMPPGfrHF4PbDcJ+qXfhKCHgsZoqBFWP4ECLYEFEwpcS4b2s= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - cephfs_test_runner: modules: - tasks.cephfs.test_openfiletable teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-15_21:24:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-15T22:35:17.347 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa; will attempt to use it 2024-09-15T22:35:17.348 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa/tasks 2024-09-15T22:35:17.348 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-15T22:35:17.350 INFO:teuthology.task.internal:Checking packages... 2024-09-15T22:35:17.371 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '8921c8ef947807b717db041d85f0761b7914d5fc' 2024-09-15T22:35:17.371 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-15T22:35:17.372 INFO:teuthology.packaging:ref: None 2024-09-15T22:35:17.372 INFO:teuthology.packaging:tag: None 2024-09-15T22:35:17.372 INFO:teuthology.packaging:branch: squid 2024-09-15T22:35:17.372 INFO:teuthology.packaging:sha1: 8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:35:17.372 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-09-15T22:35:17.598 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:35:17.599 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-15T22:35:17.607 INFO:teuthology.task.internal:no buildpackages task found 2024-09-15T22:35:17.607 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-15T22:35:17.634 INFO:teuthology.task.internal:Saving configuration 2024-09-15T22:35:17.650 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-15T22:35:17.661 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-15T22:35:17.684 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:29:51.447899', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMdYcfR+BhwsfnLahVi7UyxG2ThvyBQRZoH9eaDgKt2a'} 2024-09-15T22:35:17.705 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-15 22:29:51.445936', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMnebUisFLNqpFiVSpwAv12JIbAIM3A1h1JKBPoEkDDO'} 2024-09-15T22:35:17.705 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-15T22:35:17.713 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-15T22:35:17.714 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-15T22:35:17.714 INFO:teuthology.run_tasks:Running task console_log... 2024-09-15T22:35:17.795 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc02aab7130>, signals=[15]) 2024-09-15T22:35:17.795 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-15T22:35:17.803 INFO:teuthology.task.internal:Opening connections... 2024-09-15T22:35:17.803 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:35:17.804 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:35:17.885 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:35:17.885 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:35:17.964 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-15T22:35:17.973 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2024-09-15T22:35:17.978 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2024-09-15T22:35:17.978 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2024-09-15T22:35:18.025 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T22:35:18.025 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Ubuntu" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="22.04" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_CODENAME=jammy 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:ID=ubuntu 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE=debian 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T22:35:18.026 INFO:teuthology.orchestra.run.smithi031.stdout:UBUNTU_CODENAME=jammy 2024-09-15T22:35:18.027 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2024-09-15T22:35:18.045 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-15T22:35:18.050 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-15T22:35:18.050 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-15T22:35:18.097 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-15T22:35:18.097 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="Ubuntu" 2024-09-15T22:35:18.097 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="22.04" 2024-09-15T22:35:18.097 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-15T22:35:18.097 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_CODENAME=jammy 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:ID=ubuntu 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE=debian 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-15T22:35:18.098 INFO:teuthology.orchestra.run.smithi102.stdout:UBUNTU_CODENAME=jammy 2024-09-15T22:35:18.098 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-15T22:35:18.120 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-15T22:35:18.132 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-15T22:35:18.150 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-15T22:35:18.150 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:35:18.153 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-15T22:35:18.157 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-15T22:35:18.176 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-15T22:35:18.176 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:35:18.199 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-15T22:35:18.207 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-15T22:35:18.264 INFO:teuthology.run_tasks:Running task kernel... 2024-09-15T22:35:18.280 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'} 2024-09-15T22:35:18.280 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2024-09-15T22:35:18.280 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2024-09-15T22:35:18.280 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:35:18.281 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-15T22:35:18.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:35:18.285 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-15T22:35:18.288 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:35:18.289 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2024-09-15T22:35:18.441 DEBUG:teuthology.task.kernel:sha1 for client.0 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:18.441 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-15T22:35:18.441 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-15T22:35:18.446 INFO:teuthology.orchestra.run.smithi031.stdout:5.15.0-56-generic 2024-09-15T22:35:18.447 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:18.447 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-15T22:35:18.447 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2024-09-15T22:35:18.447 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-15T22:35:18.460 DEBUG:teuthology.task.kernel:sha1 for client.1 is 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:18.460 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "2ca44a2f35ca8f36983aaaa46d49312239ef519a"... 2024-09-15T22:35:18.461 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-15T22:35:18.466 INFO:teuthology.orchestra.run.smithi102.stdout:5.15.0-56-generic 2024-09-15T22:35:18.466 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:18.466 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-09-15T22:35:18.467 INFO:teuthology.task.kernel:Installing linux-firmware on client.1... 2024-09-15T22:35:18.467 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-09-15T22:35:18.506 INFO:teuthology.orchestra.run.smithi031.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-15T22:35:18.524 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-09-15T22:35:18.654 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git config --global init.defaultBranch 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: 2024-09-15T22:35:18.655 INFO:teuthology.orchestra.run.smithi031.stderr:hint: git branch -m 2024-09-15T22:35:18.656 INFO:teuthology.orchestra.run.smithi031.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-15T22:35:18.658 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git config --global init.defaultBranch 2024-09-15T22:35:18.673 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2024-09-15T22:35:18.674 INFO:teuthology.orchestra.run.smithi102.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-09-15T22:35:18.674 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-09-15T22:35:18.674 INFO:teuthology.orchestra.run.smithi102.stderr:hint: 2024-09-15T22:35:18.674 INFO:teuthology.orchestra.run.smithi102.stderr:hint: git branch -m 2024-09-15T22:35:18.674 INFO:teuthology.orchestra.run.smithi102.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-09-15T22:35:18.676 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-09-15T22:35:18.725 DEBUG:teuthology.orchestra.run.smithi031:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-15T22:35:18.740 DEBUG:teuthology.orchestra.run.smithi102:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-09-15T22:35:18.782 DEBUG:teuthology.orchestra.run.smithi031:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-15T22:35:18.795 DEBUG:teuthology.orchestra.run.smithi102:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-09-15T22:35:41.794 INFO:teuthology.orchestra.run.smithi031.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-15T22:35:41.794 INFO:teuthology.orchestra.run.smithi031.stderr: * [new branch] main -> origin/main 2024-09-15T22:35:41.824 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190312 -> 20190312 2024-09-15T22:35:41.824 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190416 -> 20190416 2024-09-15T22:35:41.824 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190514 -> 20190514 2024-09-15T22:35:41.825 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190618 -> 20190618 2024-09-15T22:35:41.825 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190717 -> 20190717 2024-09-15T22:35:41.825 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190815 -> 20190815 2024-09-15T22:35:41.825 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20190923 -> 20190923 2024-09-15T22:35:41.827 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191022 -> 20191022 2024-09-15T22:35:41.827 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20191215 -> 20191215 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200122 -> 20200122 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200316 -> 20200316 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200421 -> 20200421 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200519 -> 20200519 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200619 -> 20200619 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200721 -> 20200721 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200817 -> 20200817 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20200918 -> 20200918 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201022 -> 20201022 2024-09-15T22:35:41.828 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201118 -> 20201118 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20201218 -> 20201218 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210208 -> 20210208 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210315 -> 20210315 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210511 -> 20210511 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210716 -> 20210716 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210818 -> 20210818 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20210919 -> 20210919 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211027 -> 20211027 2024-09-15T22:35:41.829 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20211216 -> 20211216 2024-09-15T22:35:41.832 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220209 -> 20220209 2024-09-15T22:35:41.832 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220310 -> 20220310 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220411 -> 20220411 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220509 -> 20220509 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220610 -> 20220610 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220708 -> 20220708 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220815 -> 20220815 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20220913 -> 20220913 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221012 -> 20221012 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221109 -> 20221109 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20221214 -> 20221214 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230117 -> 20230117 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230210 -> 20230210 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230310 -> 20230310 2024-09-15T22:35:41.833 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230404 -> 20230404 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230515 -> 20230515 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230625 -> 20230625 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230804 -> 20230804 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20230919 -> 20230919 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231030 -> 20231030 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231111 -> 20231111 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20231211 -> 20231211 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240115 -> 20240115 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240220 -> 20240220 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240312 -> 20240312 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240410 -> 20240410 2024-09-15T22:35:41.834 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240513 -> 20240513 2024-09-15T22:35:41.835 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240610 -> 20240610 2024-09-15T22:35:41.835 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240709 -> 20240709 2024-09-15T22:35:41.835 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240811 -> 20240811 2024-09-15T22:35:41.835 INFO:teuthology.orchestra.run.smithi031.stderr: * [new tag] 20240909 -> 20240909 2024-09-15T22:35:41.959 INFO:teuthology.orchestra.run.smithi102.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-09-15T22:35:41.959 INFO:teuthology.orchestra.run.smithi102.stderr: * [new branch] main -> origin/main 2024-09-15T22:35:41.995 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190312 -> 20190312 2024-09-15T22:35:41.995 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190416 -> 20190416 2024-09-15T22:35:41.995 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190514 -> 20190514 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190618 -> 20190618 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190717 -> 20190717 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190815 -> 20190815 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20190923 -> 20190923 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191022 -> 20191022 2024-09-15T22:35:41.996 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20191215 -> 20191215 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200122 -> 20200122 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200316 -> 20200316 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200421 -> 20200421 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200519 -> 20200519 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200619 -> 20200619 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200721 -> 20200721 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200817 -> 20200817 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20200918 -> 20200918 2024-09-15T22:35:41.998 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201022 -> 20201022 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201118 -> 20201118 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20201218 -> 20201218 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210208 -> 20210208 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210315 -> 20210315 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210511 -> 20210511 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210716 -> 20210716 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210818 -> 20210818 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20210919 -> 20210919 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211027 -> 20211027 2024-09-15T22:35:41.999 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20211216 -> 20211216 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220209 -> 20220209 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220310 -> 20220310 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220411 -> 20220411 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220509 -> 20220509 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220610 -> 20220610 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220708 -> 20220708 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220815 -> 20220815 2024-09-15T22:35:42.002 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20220913 -> 20220913 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221012 -> 20221012 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221109 -> 20221109 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20221214 -> 20221214 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230117 -> 20230117 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230210 -> 20230210 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230310 -> 20230310 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230404 -> 20230404 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230515 -> 20230515 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230625 -> 20230625 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230804 -> 20230804 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20230919 -> 20230919 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231030 -> 20231030 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231111 -> 20231111 2024-09-15T22:35:42.003 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20231211 -> 20231211 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240115 -> 20240115 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240220 -> 20240220 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240312 -> 20240312 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240410 -> 20240410 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240513 -> 20240513 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240610 -> 20240610 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240709 -> 20240709 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240811 -> 20240811 2024-09-15T22:35:42.004 INFO:teuthology.orchestra.run.smithi102.stderr: * [new tag] 20240909 -> 20240909 2024-09-15T22:35:46.584 INFO:teuthology.orchestra.run.smithi102.stderr:Updating files: 44% (1555/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 59% (2077/3520) Updating files: 59% (2080/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 69% (2429/3520) Updating files: 69% (2437/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 82% (2887/3520) Updating files: 82% (2905/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-15T22:35:46.589 INFO:teuthology.orchestra.run.smithi102.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-15T22:35:46.611 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-15T22:35:46.611 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:46.678 INFO:teuthology.orchestra.run.smithi031.stderr:Updating files: 29% (1029/3520) Updating files: 30% (1056/3520) Updating files: 31% (1092/3520) Updating files: 32% (1127/3520) Updating files: 33% (1162/3520) Updating files: 34% (1197/3520) Updating files: 35% (1232/3520) Updating files: 36% (1268/3520) Updating files: 37% (1303/3520) Updating files: 38% (1338/3520) Updating files: 39% (1373/3520) Updating files: 40% (1408/3520) Updating files: 41% (1444/3520) Updating files: 42% (1479/3520) Updating files: 43% (1514/3520) Updating files: 44% (1549/3520) Updating files: 45% (1584/3520) Updating files: 46% (1620/3520) Updating files: 47% (1655/3520) Updating files: 48% (1690/3520) Updating files: 49% (1725/3520) Updating files: 50% (1760/3520) Updating files: 51% (1796/3520) Updating files: 52% (1831/3520) Updating files: 53% (1866/3520) Updating files: 54% (1901/3520) Updating files: 55% (1936/3520) Updating files: 56% (1972/3520) Updating files: 57% (2007/3520) Updating files: 58% (2042/3520) Updating files: 58% (2058/3520) Updating files: 59% (2077/3520) Updating files: 60% (2112/3520) Updating files: 61% (2148/3520) Updating files: 62% (2183/3520) Updating files: 63% (2218/3520) Updating files: 64% (2253/3520) Updating files: 65% (2288/3520) Updating files: 66% (2324/3520) Updating files: 67% (2359/3520) Updating files: 68% (2394/3520) Updating files: 68% (2427/3520) Updating files: 69% (2429/3520) Updating files: 70% (2464/3520) Updating files: 71% (2500/3520) Updating files: 72% (2535/3520) Updating files: 73% (2570/3520) Updating files: 74% (2605/3520) Updating files: 75% (2640/3520) Updating files: 76% (2676/3520) Updating files: 77% (2711/3520) Updating files: 78% (2746/3520) Updating files: 79% (2781/3520) Updating files: 80% (2816/3520) Updating files: 81% (2852/3520) Updating files: 81% (2886/3520) Updating files: 82% (2887/3520) Updating files: 83% (2922/3520) Updating files: 84% (2957/3520) Updating files: 85% (2992/3520) Updating files: 86% (3028/3520) Updating files: 87% (3063/3520) Updating files: 88% (3098/3520) Updating files: 89% (3133/3520) Updating files: 90% (3168/3520) Updating files: 91% (3204/3520) Updating files: 92% (3239/3520) Updating files: 93% (3274/3520) Updating files: 94% (3309/3520) Updating files: 95% (3344/3520) Updating files: 96% (3380/3520) Updating files: 97% (3415/3520) Updating files: 98% (3450/3520) Updating files: 99% (3485/3520) Updating files: 100% (3520/3520) Updating files: 100% (3520/3520), done. 2024-09-15T22:35:46.684 INFO:teuthology.orchestra.run.smithi031.stdout:HEAD is now at 6c88d9b8 Merge branch 'amd-staging' into 'main' 2024-09-15T22:35:46.708 INFO:teuthology.task.kernel:Downloading kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:35:46.709 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=2ca44a2f35ca8f36983aaaa46d49312239ef519a 2024-09-15T22:35:46.756 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:35:46.757 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-15T22:35:46.759 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi102.front.sepia.ceph.com to complete... 2024-09-15T22:35:46.843 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:35:46.844 DEBUG:teuthology.orchestra.run.smithi031:> rm -f /tmp/linux-image.deb && echo linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/ --input-file=- 2024-09-15T22:35:46.846 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-09-15T22:35:48.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15 22:35:48 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-15T22:35:48.233 INFO:teuthology.orchestra.run.smithi102.stderr:FINISHED --2024-09-15 22:35:48-- 2024-09-15T22:35:48.233 INFO:teuthology.orchestra.run.smithi102.stderr:Total wall clock time: 1.4s 2024-09-15T22:35:48.233 INFO:teuthology.orchestra.run.smithi102.stderr:Downloaded: 1 files, 43M in 1.3s (32.6 MB/s) 2024-09-15T22:35:48.237 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.1... 2024-09-15T22:35:48.238 DEBUG:teuthology.orchestra.run.smithi102:> sudo dpkg -i /tmp/linux-image.deb 2024-09-15T22:35:48.472 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-15T22:35:48.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15 22:35:49 URL:https://4.chacra.ceph.com/r/kernel/testing/2ca44a2f35ca8f36983aaaa46d49312239ef519a/ubuntu/jammy/flavors/default/pool/main/l/linux-6.11.0-rc5-g2ca44a2f35ca/linux-image-6.11.0-rc5-g2ca44a2f35ca_6.11.0-rc5-g2ca44a2f35ca-1_amd64.deb [45349154/45349154] -> "/tmp/linux-image.deb" [1] 2024-09-15T22:35:48.506 INFO:teuthology.orchestra.run.smithi031.stderr:FINISHED --2024-09-15 22:35:49-- 2024-09-15T22:35:48.507 INFO:teuthology.orchestra.run.smithi031.stderr:Total wall clock time: 1.6s 2024-09-15T22:35:48.507 INFO:teuthology.orchestra.run.smithi031.stderr:Downloaded: 1 files, 43M in 1.5s (28.6 MB/s) 2024-09-15T22:35:48.511 INFO:teuthology.task.kernel:Installing kernel 2ca44a2f35ca8f36983aaaa46d49312239ef519a on client.0... 2024-09-15T22:35:48.511 DEBUG:teuthology.orchestra.run.smithi031:> sudo dpkg -i /tmp/linux-image.deb 2024-09-15T22:35:48.732 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package linux-image-6.11.0-rc5-g2ca44a2f35ca. 2024-09-15T22:35:50.605 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-15T22:35:50.609 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-15T22:35:50.694 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-09-15T22:35:50.699 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-09-15T22:35:50.716 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-15T22:35:50.797 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-15T22:35:54.457 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-15T22:35:54.496 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up linux-image-6.11.0-rc5-g2ca44a2f35ca (6.11.0-rc5-g2ca44a2f35ca-1) ... 2024-09-15T22:35:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:35:54.614 INFO:teuthology.orchestra.run.smithi031.stderr:update-initramfs: Generating /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:17.304 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:36:17.313 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:36:17.334 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-15T22:36:17.626 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:17.639 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:17.855 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:36:17.863 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:36:17.886 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-15T22:36:17.920 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:36:17.935 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:36:17.994 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:36:18.000 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:36:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:36:18.201 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-15T22:36:18.203 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.225 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.385 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-deb -c /tmp/linux-image.deb 2024-09-15T22:36:18.393 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-15T22:36:18.393 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-15T22:36:18.393 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.413 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.413 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-15T22:36:18.439 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-15T22:36:18.440 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-15T22:36:18.442 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-15T22:36:18.442 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-15T22:36:18.442 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-15T22:36:18.442 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-15T22:36:18.443 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-15T22:36:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-15T22:36:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-15T22:36:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-15T22:36:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-15T22:36:18.444 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-15T22:36:18.456 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-15T22:36:18.456 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-15T22:36:18.456 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-15T22:36:18.456 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-15T22:36:18.457 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-15T22:36:18.458 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-15T22:36:18.459 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-15T22:36:18.460 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-15T22:36:18.461 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-15T22:36:18.462 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-15T22:36:18.471 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-15T22:36:18.472 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-15T22:36:18.473 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-15T22:36:18.474 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-15T22:36:18.475 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-15T22:36:18.476 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-15T22:36:18.477 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-15T22:36:18.478 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-15T22:36:18.479 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-15T22:36:18.480 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-15T22:36:18.481 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-15T22:36:18.481 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-15T22:36:18.481 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-15T22:36:18.481 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-15T22:36:18.494 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:36:18.501 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:36:18.510 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-15T22:36:18.510 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-15T22:36:18.510 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-15T22:36:18.510 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-15T22:36:18.510 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-15T22:36:18.511 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-15T22:36:18.512 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-15T22:36:18.513 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-15T22:36:18.514 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-15T22:36:18.515 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-15T22:36:18.516 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-15T22:36:18.517 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-15T22:36:18.518 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-15T22:36:18.519 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-15T22:36:18.520 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-15T22:36:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-15T22:36:18.522 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-15T22:36:18.523 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-15T22:36:18.524 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-15T22:36:18.525 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-15T22:36:18.526 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-15T22:36:18.527 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-15T22:36:18.528 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-15T22:36:18.529 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-15T22:36:18.530 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-15T22:36:18.531 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-15T22:36:18.532 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-15T22:36:18.533 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-15T22:36:18.534 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-15T22:36:18.535 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-15T22:36:18.536 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-15T22:36:18.537 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-15T22:36:18.556 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:36:18.559 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-15T22:36:18.560 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-15T22:36:18.561 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-15T22:36:18.562 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-15T22:36:18.563 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-15T22:36:18.564 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-15T22:36:18.565 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-15T22:36:18.566 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-15T22:36:18.567 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-15T22:36:18.568 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-15T22:36:18.569 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-15T22:36:18.570 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-15T22:36:18.571 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-15T22:36:18.572 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-15T22:36:18.573 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-15T22:36:18.574 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-15T22:36:18.575 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-15T22:36:18.576 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-15T22:36:18.577 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-15T22:36:18.578 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-15T22:36:18.579 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-15T22:36:18.580 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-15T22:36:18.581 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-15T22:36:18.582 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-15T22:36:18.583 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:36:18.588 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-15T22:36:18.588 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-15T22:36:18.589 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-15T22:36:18.590 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-15T22:36:18.591 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-15T22:36:18.592 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-15T22:36:18.593 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-15T22:36:18.594 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-15T22:36:18.595 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-15T22:36:18.616 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-15T22:36:18.617 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-15T22:36:18.618 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-15T22:36:18.618 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-15T22:36:18.619 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-15T22:36:18.619 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-15T22:36:18.620 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-15T22:36:18.621 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-15T22:36:18.622 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-15T22:36:18.623 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-15T22:36:18.624 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-15T22:36:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-15T22:36:18.626 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-15T22:36:18.627 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-15T22:36:18.628 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-15T22:36:18.629 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-15T22:36:18.630 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-15T22:36:18.631 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-15T22:36:18.632 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-15T22:36:18.633 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-15T22:36:18.634 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-15T22:36:18.635 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-15T22:36:18.636 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-15T22:36:18.637 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-15T22:36:18.638 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-15T22:36:18.639 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-15T22:36:18.644 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-15T22:36:18.645 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-15T22:36:18.646 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-15T22:36:18.647 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-15T22:36:18.648 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-15T22:36:18.649 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-15T22:36:18.650 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-15T22:36:18.652 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-15T22:36:18.653 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-15T22:36:18.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-15T22:36:18.654 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-15T22:36:18.660 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-15T22:36:18.661 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-15T22:36:18.662 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-15T22:36:18.663 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-15T22:36:18.664 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-15T22:36:18.665 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-15T22:36:18.666 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-15T22:36:18.667 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-15T22:36:18.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-15T22:36:18.688 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-15T22:36:18.689 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-15T22:36:18.690 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-15T22:36:18.691 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-15T22:36:18.692 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-15T22:36:18.693 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-15T22:36:18.694 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-15T22:36:18.695 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-15T22:36:18.696 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-15T22:36:18.697 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-15T22:36:18.698 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-15T22:36:18.699 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-15T22:36:18.700 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-15T22:36:18.701 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-15T22:36:18.702 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-15T22:36:18.703 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-15T22:36:18.704 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-15T22:36:18.705 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-15T22:36:18.706 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-15T22:36:18.707 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-15T22:36:18.708 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-15T22:36:18.709 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-15T22:36:18.710 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-15T22:36:18.711 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:36:18.711 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:36:18.711 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:36:18.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-15T22:36:18.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-15T22:36:18.714 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-15T22:36:18.714 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-15T22:36:18.715 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-15T22:36:18.716 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-15T22:36:18.717 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-15T22:36:18.718 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-15T22:36:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-15T22:36:18.723 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-15T22:36:18.724 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-15T22:36:18.725 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-15T22:36:18.726 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-15T22:36:18.727 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-15T22:36:18.730 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-15T22:36:18.731 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-15T22:36:18.731 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-15T22:36:18.731 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-15T22:36:18.732 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-15T22:36:18.733 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-15T22:36:18.733 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-15T22:36:18.733 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-15T22:36:18.733 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-15T22:36:18.733 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-15T22:36:18.738 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-15T22:36:18.739 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-15T22:36:18.741 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-15T22:36:18.750 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-15T22:36:18.751 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-15T22:36:18.752 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-15T22:36:18.754 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-15T22:36:18.754 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-15T22:36:18.755 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-15T22:36:18.756 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-15T22:36:18.757 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-15T22:36:18.757 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-15T22:36:18.757 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-15T22:36:18.757 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-15T22:36:18.757 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-15T22:36:18.759 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-15T22:36:18.760 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-15T22:36:18.761 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-15T22:36:18.762 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-15T22:36:18.763 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-15T22:36:18.764 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-15T22:36:18.764 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-15T22:36:18.764 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-15T22:36:18.764 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-15T22:36:18.764 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-15T22:36:18.773 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-15T22:36:18.774 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-15T22:36:18.775 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-15T22:36:18.776 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-15T22:36:18.777 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-15T22:36:18.778 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-15T22:36:18.779 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-15T22:36:18.780 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-15T22:36:18.781 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-15T22:36:18.782 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-15T22:36:18.783 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-15T22:36:18.798 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-15T22:36:18.799 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-15T22:36:18.800 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-15T22:36:18.801 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-15T22:36:18.802 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-15T22:36:18.803 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-15T22:36:18.804 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-15T22:36:18.805 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-15T22:36:18.806 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-15T22:36:18.807 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-15T22:36:18.808 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-15T22:36:18.809 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-15T22:36:18.810 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-15T22:36:18.811 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-15T22:36:18.812 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-15T22:36:18.813 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-15T22:36:18.814 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-15T22:36:18.814 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-15T22:36:18.816 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-15T22:36:18.816 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-15T22:36:18.817 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-15T22:36:18.818 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-15T22:36:18.819 INFO:teuthology.orchestra.run.smithi031.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:36:18.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-15T22:36:18.819 INFO:teuthology.orchestra.run.smithi031.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-15T22:36:18.824 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.824 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.824 DEBUG:teuthology.orchestra.run.smithi031:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-15T22:36:18.867 INFO:teuthology.orchestra.run.smithi031.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:18.867 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:18.867 INFO:teuthology.orchestra.run.smithi031.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:18.867 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-15T22:36:18.868 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.868 DEBUG:teuthology.orchestra.run.smithi031:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-15T22:36:18.911 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi031.front.sepia.ceph.com to complete... 2024-09-15T22:36:18.918 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-deb -c /tmp/linux-image.deb 2024-09-15T22:36:18.968 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./ 2024-09-15T22:36:18.968 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./boot/ 2024-09-15T22:36:18.968 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7098725 2024-09-06 14:57 ./boot/System.map-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.986 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 174121 2024-09-06 14:57 ./boot/config-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:18.986 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13292544 2024-09-06 14:57 ./boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.006 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/ 2024-09-15T22:36:19.006 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/ 2024-09-15T22:36:19.006 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postinst.d/ 2024-09-15T22:36:19.006 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/postrm.d/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/preinst.d/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./etc/kernel/prerm.d/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ 2024-09-15T22:36:19.007 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 189809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/aesni-intel.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 155337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-09-15T22:36:19.009 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-avx2.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-09-15T22:36:19.010 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/ 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/ 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/ 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/cpuid.ko 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kernel/msr.ko 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/ 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 505169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-amd.ko 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1060585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm-intel.ko 2024-09-15T22:36:19.011 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2858865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/arch/x86/kvm/kvm.ko 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/af_alg.ko 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_hash.ko 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/algif_skcipher.ko 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ansi_cprng.ko 2024-09-15T22:36:19.025 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/anubis.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/arc4.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/ 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/ 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_memcpy.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_pq.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_raid6_recov.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_tx.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/async_xor.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/async_tx/raid6test.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authenc.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/authencesn.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blake2b_generic.ko 2024-09-15T22:36:19.026 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_common.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/blowfish_generic.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/camellia_generic.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast5_generic.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast6_generic.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cast_common.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/ccm.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cmac.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crc32_generic.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cryptd.ko 2024-09-15T22:36:19.027 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_engine.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_simd.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/crypto_user.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/cts.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/des_generic.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/dh_generic.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/echainiv.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/essiv.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/fcrypt.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/khazad.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lrw.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/lz4hc.ko 2024-09-15T22:36:19.028 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/md4.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/michael_mic.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcbc.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/pcrypt.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/rmd160.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/seed.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/serpent_generic.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 169521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tcrypt.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/tea.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_common.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/twofish_generic.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/vmac.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/wp512.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xcbc.ko 2024-09-15T22:36:19.029 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xor.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xts.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/crypto/xxhash_generic.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_extlog.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_ipmi.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/acpi_pad.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/ 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/apei/einj.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/ec_sys.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/platform_profile.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbs.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/sbshc.ko 2024-09-15T22:36:19.030 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/acpi/video.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/acard-ahci.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/ahci_platform.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 105105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/libahci_platform.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_acpi.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ali.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_amd.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_artop.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atiixp.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_atp867x.ko 2024-09-15T22:36:19.031 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd640.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cmd64x.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_cypress.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_efar.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt366.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt37x.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x2n.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_hpt3x3.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it8213.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_it821x.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_jmicron.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_legacy.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_marvell.ko 2024-09-15T22:36:19.032 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_mpiix.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_netcell.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ninja32.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87410.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_ns87415.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_oldpiix.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_opti.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_optidma.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pcmcia.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc2027x.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_piccolo.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_radisys.ko 2024-09-15T22:36:19.033 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rdc.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_rz1000.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sch.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_serverworks.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sil680.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_sl82c105.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_triflex.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pata_via.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/pdc_adma.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_inic162x.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_mv.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_nv.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_promise.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_qstor.ko 2024-09-15T22:36:19.034 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sil24.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sis.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_svw.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_sx4.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_uli.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_via.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ata/sata_vsc.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/auxdisplay/ks0108.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/ 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 161225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/bcma/bcma.ko 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/ 2024-09-15T22:36:19.035 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/ 2024-09-15T22:36:19.036 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/aoe/aoe.ko 2024-09-15T22:36:19.036 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/ 2024-09-15T22:36:19.036 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1240825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/drbd/drbd.ko 2024-09-15T22:36:19.064 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 203657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/floppy.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/ 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 143337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/nbd.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/ 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/null_blk/null_blk.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/pktcdvd.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 312817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/rbd.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/ 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/ 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/block/zram/zram.ko 2024-09-15T22:36:19.065 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/applicom.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hangcheck-timer.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/ 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/amd-rng.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/intel-rng.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/via-rng.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/hw_random/virtio-rng.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 183745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 179465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_si.ko 2024-09-15T22:36:19.066 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/lp.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/ 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/mwave/mwave.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/nvram.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/ppdev.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tlclk.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/ 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_atmel.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-09-15T22:36:19.067 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_infineon.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/tpm_nsc.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/ 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_class.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_core.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/ 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-palmas.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-si5351.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-twl6040.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/clk/clk-wm831x.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/ 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-09-15T22:36:19.068 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/p4-clockmod.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/cpufreq/speedstep-lib.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 334505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/ccp/ccp.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 833113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-aes.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/padlock-sha.ko 2024-09-15T22:36:19.069 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dca/dca.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/dw/dw_dmac.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 147345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/dma/ioat/ioatdma.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/amd64_edac.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/e752x_edac.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/edac_mce_amd.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3000_edac.ko 2024-09-15T22:36:19.070 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i3200_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5100_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i5400_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7300_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i7core_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/i82975x_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/ie31200_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/sb_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/edac/x38_edac.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/ 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-gpio.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max14577.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max77693.ko 2024-09-15T22:36:19.071 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-max8997.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-palmas.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-rt8973a.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/extcon/extcon-sm5502.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/ 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/dmi-sysfs.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/ 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/efi/efi-pstore.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/firmware/iscsi_ibft.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/ 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-adp5520.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-amd8111.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-arizona.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9052.ko 2024-09-15T22:36:19.072 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-da9055.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-dln2.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-f7188x.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-generic.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ich.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-kempld.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-lp3943.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max7300.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max730x.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-max732x.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pca953x.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-pcf857x.ko 2024-09-15T22:36:19.073 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-rdc321x.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-sch311x.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-tps65912.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl4030.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-twl6040.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-viperboard.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-vx855.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm831x.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8350.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/gpio/gpio-wm8994.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/ 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-a4tech.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-apple.ko 2024-09-15T22:36:19.074 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-appleir.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-aureal.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-axff.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-belkin.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cherry.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-chicony.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cp2112.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-cypress.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-dr.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elecom.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-elo.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-emsff.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ezkey.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gaff.ko 2024-09-15T22:36:19.075 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-generic.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gt683r.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-gyration.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-kbd.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtek-mouse.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-holtekff.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-hyperv.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-icade.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kensington.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-keytouch.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-kye.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lcpower.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-led.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lenovo.ko 2024-09-15T22:36:19.076 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-lg-g15.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-dj.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-logitech.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-magicmouse.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-microsoft.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-monterey.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-multitouch.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ntrig.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-ortek.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-penmount.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-petalynx.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-picolcd.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-pl.ko 2024-09-15T22:36:19.077 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-plantronics.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-primax.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-rmi.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-arvo.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-common.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-isku.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kone.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-konepure.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-lua.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-pyra.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-ryos.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat-savu.ko 2024-09-15T22:36:19.078 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-roccat.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-saitek.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-samsung.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sensor-hub.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sjoy.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sony.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-speedlink.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-steelseries.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-sunplus.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-thrustmaster.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tivo.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-tmff.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-topseed.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-twinhan.ko 2024-09-15T22:36:19.079 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-uclogic.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-waltop.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 184865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-wiimote.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-xinmo.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zpff.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid-zydacron.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 462849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/hid.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/uhid.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/ 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 153953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbhid.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbkbd.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/usbhid/usbmouse.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 261241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hid/wacom.ko 2024-09-15T22:36:19.080 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/ 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_balloon.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_utils.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 378337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hv/hv_vmbus.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/abituguru3.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/acpi_power_meter.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7414.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ad7418.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adc128d818.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1025.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1026.ko 2024-09-15T22:36:19.081 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1029.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm1031.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adm9240.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ads7828.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7410.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7411.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7462.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7470.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7475.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/adt7x10.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/amc6821.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/applesmc.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asb100.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asc7621.ko 2024-09-15T22:36:19.082 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/asus_atk0110.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/atxp1.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/coretemp.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/cros_ec_hwmon.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9052-hwmon.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/da9055-hwmon.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/dme1737.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds1621.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ds620.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc1403.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc2103.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/emc6w201.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71805f.ko 2024-09-15T22:36:19.083 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f71882fg.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/f75375s.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fam15h_power.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/fschmd.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g760a.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/g762.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl518sm.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/gl520sm.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hih6130.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/hwmon-vid.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5500_temp.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/i5k_amb.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmaem.ko 2024-09-15T22:36:19.084 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ibmpex.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina209.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ina2xx.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 150681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/it87.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/jc42.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k10temp.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/k8temp.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lineage-pem.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm63.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm73.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm75.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm77.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm78.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm80.ko 2024-09-15T22:36:19.085 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm83.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm85.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm87.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm90.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm92.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 131585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm93.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95234.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95241.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/lm95245.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc2945.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4151.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4215.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4222.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4245.ko 2024-09-15T22:36:19.086 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4260.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/ltc4261.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max16065.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1619.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max1668.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max197.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6639.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6650.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/max6697.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mc13783-adc.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/mcp3021.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6683.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 140657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775-core.ko 2024-09-15T22:36:19.087 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct6775.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/nct7802.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87360.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pc87427.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pcf8591.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max16064.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max34440.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/max8688.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-09-15T22:36:19.088 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/powr1220.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5627.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch5636.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sch56xx-common.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht15.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sht21.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/shtc1.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/sis5595.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47b397.ko 2024-09-15T22:36:19.089 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m1.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/smsc47m192.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/thmc50.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp102.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp103.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp401.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/tmp421.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via-cputemp.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/via686a.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt1211.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/vt8231.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627ehf.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83627hf.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83781d.ko 2024-09-15T22:36:19.090 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 75217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83791d.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83792d.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 116873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83793.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83795.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l785ts.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/w83l786ng.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/ 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/ 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/ 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-09-15T22:36:19.091 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-09-15T22:36:19.092 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-i801.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-isch.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-parport.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-09-15T22:36:19.093 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-via.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-mux.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-smbus.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/i2c-stub.ko 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/ 2024-09-15T22:36:19.094 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 328633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_cm.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1107329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_core.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_umad.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 404889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/iw_cm.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 343753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_cm.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/ 2024-09-15T22:36:19.095 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 591177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-09-15T22:36:19.096 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/ 2024-09-15T22:36:19.096 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 515585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-09-15T22:36:19.096 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/ 2024-09-15T22:36:19.096 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 919921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 375761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 203241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/ 2024-09-15T22:36:19.119 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 212353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 334665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 132457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 157209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/evbug.ko 2024-09-15T22:36:19.120 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/ff-memless.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/ 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/fm801-gp.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/gameport/gameport.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/joydev.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/ 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lkkbd.ko 2024-09-15T22:36:19.121 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8323.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/lm8333.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/newtonkbd.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt1070.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/qt2160.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/stowaway.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/sunkbd.ko 2024-09-15T22:36:19.122 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/keyboard/xtkbd.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/matrix-keymap.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/ 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/appletouch.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/bcm5974.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 160569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/cyapatp.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 114801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/elan_i2c.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/gpio_mouse.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 430033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/psmouse.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/sermouse.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/synaptics_usb.ko 2024-09-15T22:36:19.123 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/mouse/vsxxxaa.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/ 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 139497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/rmi4/rmi_core.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/altera_ps2.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/arc_ps2.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ct82c710.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/parkbd.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/pcips2.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/ps2mult.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serio_raw.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/serio/serport.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/input/sparse-keymap.ko 2024-09-15T22:36:19.124 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/ 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-88pm860x.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-adp5520.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-bd2802.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-blinkm.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da903x.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-da9052.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-gpio.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3530.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3533.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm355x.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lm3642.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp3944.ko 2024-09-15T22:36:19.125 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-lp8788.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-max8997.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-mc13783.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-menf21bmc.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca9532.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca955x.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-pca963x.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-ss4200.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-tca6507.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm831x-status.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/leds-wm8350.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-09-15T22:36:19.126 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/ 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/ 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 776777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/bcache/bcache.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bio-prison.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-bufio.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache-smq.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 197121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-cache.ko 2024-09-15T22:36:19.127 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-crypt.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-delay.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-era.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-flakey.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log-userspace.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-log.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-mirror.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-multipath.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-queue-length.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-raid.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-region-hash.ko 2024-09-15T22:36:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-round-robin.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-service-time.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 139257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-snapshot.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-switch.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 234353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-thin-pool.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-verity.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/dm-zero.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/ 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 257025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid0.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid1.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 157401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid10.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 443385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/md/raid456.ko 2024-09-15T22:36:19.129 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/ 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/ 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 211273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptbase.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptctl.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptfc.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptlan.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 150977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptsas.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptscsih.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/message/fusion/mptspi.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/ 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm800.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm805.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/88pm80x.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona-i2c.ko 2024-09-15T22:36:19.130 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 146569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/arizona.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/bcm590xx.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/cros_ec_dev.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/dln2.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/janz-cmodio.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/kempld-core.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-core.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lp3943.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_ich.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/lpc_sch.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/max8907.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-core.ko 2024-09-15T22:36:19.131 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/menf21bmc.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-adc.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633-gpio.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/pcf50633.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/retu-mfd.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/si476x-core.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/sm501.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps65010.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/tps6507x.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/viperboard.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/vx855.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wl1273-core.ko 2024-09-15T22:36:19.132 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/mfd/wm8994.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ad525x_dpot.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/ 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds9802als.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/apds990x.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/bh1770glc.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/ 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/c2port/core.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/ 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/cb710/cb710.ko 2024-09-15T22:36:19.133 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ds1682.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/dummy-irq.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/ 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/echo/echo.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/ 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/at24.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/eeprom/max6875.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/enclosure.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/ 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 191761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hmc6352.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/hpilo.ko 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ 2024-09-15T22:36:19.134 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 92489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ics932s401.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29003.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/isl29020.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/ 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/ 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 153777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-me.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei-txe.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 381905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/mei/mei.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/phantom.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/ 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/ti-st/st_drv.ko 2024-09-15T22:36:19.135 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_7xx1.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tifm_core.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/tsl2550.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_balloon.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/ 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 232257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/ 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 623361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/bonding/bonding.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/ 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/ 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/b53/b53_common.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/bcm-sf2.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6060.ko 2024-09-15T22:36:19.136 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/ 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 592833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/dummy.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/eql.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/ 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 86233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/8390.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-09-15T22:36:19.137 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/ 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/ 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/agere/et131x.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/ 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/ 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/ 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 116105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-09-15T22:36:19.138 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 229409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-09-15T22:36:19.139 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1734265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 166913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 164665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 439633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 432417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 257433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 444721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-09-15T22:36:19.140 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1309441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 207073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 269777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/ 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 169313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-09-15T22:36:19.141 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/ 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/dnet.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ec_bhf.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/ 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/ 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 356153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ethoc.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fealnx.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/ 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-09-15T22:36:19.142 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e100.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 366465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 755425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 324721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1193705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 356609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/ 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 672177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-09-15T22:36:19.143 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 121609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 966193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 193889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libeth/libeth.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 5969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/intel/libie/libie.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 109353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/jme.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/ 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 127057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/skge.ko 2024-09-15T22:36:19.144 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 151049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/ 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 888945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 346977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-09-15T22:36:19.145 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1408481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/ 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 131601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-09-15T22:36:19.175 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 181409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 171649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 301017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 105857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-09-15T22:36:19.176 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 885465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/atp.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 264393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 142481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1346017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/ 2024-09-15T22:36:19.177 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/ 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis190.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sis/sis900.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/ 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 100937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/ 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-09-15T22:36:19.178 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 644913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/ 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/cassini.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 208177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/niu.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sungem.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/ 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/ 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/ti/tlan.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/ 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-09-15T22:36:19.179 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/defxx.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 275889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/fddi/skfp/skfp.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/geneve.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 290697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/ 2024-09-15T22:36:19.180 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ieee802154/fakelb.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ifb.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ipvlan/ipvlan.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvlan.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/macvtap.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/ 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-gpio.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio/mdio-regmap.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mdio.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/mii.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/netconsole.ko 2024-09-15T22:36:19.181 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/nlmon.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/ 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs-lynx.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/amd.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm7xxx.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/bcm87xx.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/broadcom.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/cicada.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/davicom.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/et1011c.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/icplus.ko 2024-09-15T22:36:19.182 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/lxt.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/marvell.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/micrel.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/national.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 118505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/phylink.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/qsemi.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/realtek.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/smsc.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/ste10Xp.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/phy/vitesse.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/ 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/plip/plip.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/bsd_comp.ko 2024-09-15T22:36:19.183 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_async.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_deflate.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_mppe.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/ppp_synctty.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppoe.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pppox.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/ppp/pptp.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/ 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/slip/slip.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/sungem_phy.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/tap.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/ 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 136729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_activebackup.ko 2024-09-15T22:36:19.184 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_broadcast.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_random.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/veth.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/ 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 179329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/ 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 384193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/vxlan/vxlan.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/ 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 175857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/net/xen-netback/xen-netback.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ntb/ntb.ko 2024-09-15T22:36:19.185 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/ 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/ 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 337697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme-core.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 128353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/nvme/host/nvme.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/ 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 164153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_cs.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_pc.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/parport/parport_serial.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/ 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/ 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-09-15T22:36:19.186 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/pci-stub.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pci/xen-pcifront.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/ 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/i82092.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 177817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 76785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_core.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/pd6729.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pcmcia/yenta_socket.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/ 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/ 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/ 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-09-15T22:36:19.187 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/ 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/ 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/ 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/ 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acer-wmi.ko 2024-09-15T22:36:19.188 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/acerhdf.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/apple-gmux.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-laptop.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 172313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/asus-wmi.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/classmate-laptop.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/hdaps.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/ibm_rtl.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/ 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-09-15T22:36:19.189 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/intel_ips.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/msi-wmi.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/mxm-wmi.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-laptop.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/samsung-q10.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/topstar-laptop.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/toshiba_haps.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi-bmof.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/platform/x86/wmi.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/ 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_battery.ko 2024-09-15T22:36:19.190 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/88pm860x_charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq2415x_charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 73161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24190_charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/bq24735-charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_charge-control.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9030_battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/da9052-battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2760_battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2780_battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2781_battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/ds2782_battery.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/gpio-charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/isp1704_charger.ko 2024-09-15T22:36:19.191 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/lp8727_charger.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max14577_charger.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max17042_battery.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8903_charger.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/max8925_power.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/pcf50633-charger.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/sbs-battery.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/test_power.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/tps65090-charger.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_backup.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm831x_power.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/power/supply/wm8350_power.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/ 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 98737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_common.ko 2024-09-15T22:36:19.192 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/powercap/intel_rapl_msr.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-gpio.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps-ldisc.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/clients/pps_parport.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/pps/pps_core.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ptp/ptp_kvm.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/ 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ras/amd/fmpm.ko 2024-09-15T22:36:19.193 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/ 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm80x.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-88pm860x.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-bq32k.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9052.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9055.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-da9063.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1286.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 82585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1307.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1374.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1511.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1553.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1672.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds1742.ko 2024-09-15T22:36:19.194 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds2404.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-ds3232.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-em3027.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-fm3130.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl12022.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-isl1208.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-lp8788.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m41t80.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t35.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t59.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-m48t86.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max6900.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8907.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8925.ko 2024-09-15T22:36:19.195 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8997.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-max8998.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-msm6242.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-palmas.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf2127.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf50633.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf85063.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8523.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8563.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-pcf8583.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rc5t583.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rp5c01.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rs5c372.ko 2024-09-15T22:36:19.196 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8025.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-rx8581.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-s35390a.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps6586x.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-tps65910.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm831x.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-wm8350.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/rtc/rtc-x1205.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-9xxx.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-sas.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/3w-xxxx.ko 2024-09-15T22:36:19.197 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 164753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/BusLogic.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/a100u2w.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/ 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 341105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aacraid/aacraid.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/advansys.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/ 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 468305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 380857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/ 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 244049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/am53c974.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/ 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 135801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/atp870u.ko 2024-09-15T22:36:19.198 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 305161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1526289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bfa/bfa.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 298321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ch.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 390817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/csiostor/csiostor.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 89041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-09-15T22:36:19.199 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 168361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dc395x.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/dmx3191d.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/ 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 267737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esas2r/esas2r.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/esp_scsi.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/ 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/fcoe.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 191041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fdomain.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/ 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 366737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/fnic/fnic.ko 2024-09-15T22:36:19.200 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 251641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hpsa.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hptiop.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/hv_storvsc.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/imm.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/initio.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 327841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ipr.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 129881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ips.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/ 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 398505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/isci/isci.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/iscsi_tcp.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/ 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 380649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libfc/libfc.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 172833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi.ko 2024-09-15T22:36:19.201 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libiscsi_tcp.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/ 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 274913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/libsas/libsas.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/ 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2737441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/lpfc/lpfc.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/ 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 388737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 105177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/megaraid.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/ 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 833969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/ 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 158857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvsas/mvsas.ko 2024-09-15T22:36:19.202 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 96697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/mvumi.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/ 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/ 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 444273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/pmcraid.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ppa.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla1280.ko 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/ 2024-09-15T22:36:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2323537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-09-15T22:36:19.236 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 103793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/ 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 697393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/qlogicfas408.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/raid_class.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 331577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_debug.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 219497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_fc.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 349593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 121777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_sas.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 92385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_spi.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/scsi_transport_srp.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/ses.ko 2024-09-15T22:36:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 138265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/st.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 57489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/stex.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/ 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 205137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/virtio_scsi.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/vmw_pvscsi.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/wd719x.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/scsi/xen-scsifront.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 172697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ssb/ssb.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/ 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/ 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 915121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/ 2024-09-15T22:36:19.238 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/loopback/tcm_loop.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_file.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_iblock.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1161521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_mod.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_pscsi.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 149801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/target_core_user.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/ 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/ 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/ 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/ 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-09-15T22:36:19.239 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-09-15T22:36:19.240 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/moxa.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/mxser.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_gsm.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/n_hdlc.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/nozomi.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/ 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/ 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-09-15T22:36:19.241 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/altera_uart.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/arc_uart.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/ 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 121249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/jsm/jsm.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/rp2.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 68009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/tty/serial/sc16is7xx_i2c.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/ 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 689289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/core/ufshcd-core.ko 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ 2024-09-15T22:36:19.242 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/ 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_aec.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_cif.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_dmem_genirq.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_mf624.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_netx.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pci_generic.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/uio/uio_sercos3.ko 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/ 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/ 2024-09-15T22:36:19.243 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/c67x00/c67x00.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 187689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/ 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-acm.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/cdc-wdm.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 56841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usblp.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 107633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/class/usbtmc.ko 2024-09-15T22:36:19.244 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/common/ulpi.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/ 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/ 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 576329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/dwc3/dwc3.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/ 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/ 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_ether.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/u_serial.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-09-15T22:36:19.245 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 132897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 62473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 142801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 99913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-09-15T22:36:19.246 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/ 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-09-15T22:36:19.247 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 200137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/libcomposite.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/ 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/ 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 182665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2272.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/net2280.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-09-15T22:36:19.248 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 87561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 191281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/bcma-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 108417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/isp116x-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/sl811_cs.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/ssb-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/ 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/mdc800.ko 2024-09-15T22:36:19.249 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/image/microtek.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/adutux.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/appledisplay.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/cytherm.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ehset.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi26.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/emi62.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ezusb.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/idmouse.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/iowarrior.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/isight_firmware.ko 2024-09-15T22:36:19.250 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/ldusb.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/legousbtower.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/lvstest.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/ 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/trancevibrator.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usb3503.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usblcd.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbsevseg.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 84369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/usbtest.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/uss720.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/misc/yurex.ko 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/ 2024-09-15T22:36:19.251 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/mon/usbmon.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/ 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 391209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/musb/musb_hdrc.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/ 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-generic.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-isp1301.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/phy/phy-tahvo.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/aircable.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ark3116.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/belkin_sa.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ch341.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cp210x.ko 2024-09-15T22:36:19.252 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cyberjack.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/cypress_m8.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/digi_acceleport.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/empeg.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/f81232.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 188729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ftdi_sio.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/garmin_gps.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_edgeport.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 142937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/io_ti.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipaq.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ipw.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ir-usb.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan.ko 2024-09-15T22:36:19.253 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/keyspan_pda.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kl5kusb105.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/kobil_sct.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mct_u232.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/metro-usb.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7720.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 91625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mos7840.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 65281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/mxuport.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/navman.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/omninet.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/opticon.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 201257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/option.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/oti6858.ko 2024-09-15T22:36:19.254 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/pl2303.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcaux.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/qcserial.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/quatech2.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/safe_serial.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/sierra.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/spcp8x5.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ssu100.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/symbolserial.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_debug.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usb_wwan.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 148729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/usbserial.ko 2024-09-15T22:36:19.255 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/visor.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/whiteheat.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/wishbone-serial.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/serial/xsens_mt.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 63361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/uas.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-alauda.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-cypress.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-datafab.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-freecom.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-isd200.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-09-15T22:36:19.256 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-karma.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-onetouch.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-realtek.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr09.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-sddr55.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/ums-usbat.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 201057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/storage/usb-storage.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/ 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-core.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/usbip-host.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 122537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/ 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/ 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 196977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-09-15T22:36:19.257 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33737 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/pci/vfio-pci.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/ 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 135241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_iotlb.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 71553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_net.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 110185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/vhost/vhost_scsi.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/ 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/ 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/aat2870_bl.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp5520_bl.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8860_bl.ko 2024-09-15T22:36:19.258 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/adp8870_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/apple_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/as3711_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/bd6107.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da903x_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/da9052_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/gpio_backlight.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/kb3886_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lcd.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3533_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lm3639_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/lv5207lp.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/max8925_bl.ko 2024-09-15T22:36:19.259 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pandora_bl.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/platform_lcd.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/video/backlight/wm831x_bl.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/ 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2482.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/ds2490.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/matrox_w1.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/masters/w1-gpio.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/ 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-09-15T22:36:19.260 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_smem.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/slaves/w1_therm.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 127601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/w1/wire.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/acquirewdt.ko 2024-09-15T22:36:19.261 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/advantechwdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim1535_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/alim7101_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/cpu5wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9052_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9055_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/da9063_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/dw_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/eurotechwdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/f71808e_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/hpwdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/i6300esb.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/iTCO_wdt.ko 2024-09-15T22:36:19.262 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ib700wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ibmasr.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it8712f_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/it87_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/kempld_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/machzwd.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/mena21_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/nv_tco.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pc87413_wdt.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_pci.ko 2024-09-15T22:36:19.263 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/pcwd_usb.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/retu_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sc1200wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sch311x_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/softdog.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/sp5100_tco.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/twl4030_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/via_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-09-15T22:36:19.264 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83877f_wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/w83977f_wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wafer5823wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wdt_pci.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm831x_wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/wm8350_wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/watchdog/xen_wdt.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/ 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-evtchn.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntalloc.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-gntdev.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/ 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 214065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-privcmd.ko 2024-09-15T22:36:19.265 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xen-scsiback.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/drivers/xen/xenfs/xenfs.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 195161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/9p/9p.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/adfs/adfs.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 197849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/affs/affs.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1259073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/afs/kafs.ko 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/ 2024-09-15T22:36:19.266 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 127665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/autofs/autofs4.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 80561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/befs/befs.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/bfs/bfs.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/binfmt_misc.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4575041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/btrfs/btrfs.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 384329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cachefiles/cachefiles.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1591681 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ceph/ceph.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/ 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 130593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/coda/coda.ko 2024-09-15T22:36:19.267 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/configfs/configfs.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/cramfs/cramfs.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 841817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/dlm/dlm.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/efs/efs.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1901633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/f2fs/f2fs.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fat/msdos.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/ 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/freevxfs/freevxfs.ko 2024-09-15T22:36:19.268 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/ 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/fuse/cuse.ko 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/ 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1488329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/gfs2/gfs2.ko 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/ 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 183553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfs/hfs.ko 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/ 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 282177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hfsplus/hfsplus.ko 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/ 2024-09-15T22:36:19.269 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 248625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/hpfs/hpfs.ko 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/ 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 93513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/isofs/isofs.ko 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/ 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 529833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/jfs/jfs.ko 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/ 2024-09-15T22:36:19.277 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 359969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/lockd/lockd.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 113265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/minix/minix.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 646793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/netfs/netfs.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 111585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/ 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 147553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-09-15T22:36:19.278 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1291361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfs.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 83001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv2.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 152537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv3.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2526953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs/nfsv4.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/ 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/grace.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfs_common/nfs_acl.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/ 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 2119673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nfsd/nfsd.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/ 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 734385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nilfs2/nilfs2.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/ 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-celtic.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-centeuro.ko 2024-09-15T22:36:19.279 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-croatian.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-cyrillic.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-gaelic.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-greek.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-iceland.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-inuit.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-roman.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-romanian.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/mac-turkish.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ascii.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1250.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1251.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp1255.ko 2024-09-15T22:36:19.280 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp737.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp775.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp850.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp852.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp855.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp857.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp860.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp861.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp862.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp863.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp864.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp865.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp866.ko 2024-09-15T22:36:19.281 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp869.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp874.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 95761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp932.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp936.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 167273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp949.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_cp950.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_euc-jp.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-1.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-13.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-14.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13313 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-15.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-2.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-3.ko 2024-09-15T22:36:19.282 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-4.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-5.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-6.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-7.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_iso8859-9.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-r.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-ru.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_koi8-u.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_ucs2_utils.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/nls/nls_utf8.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 632217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ntfs3/ntfs3.ko 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ 2024-09-15T22:36:19.283 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 299761 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 547233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 3255305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/ 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 67633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/omfs/omfs.ko 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/ 2024-09-15T22:36:19.284 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 468161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/overlayfs/overlay.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/pstore/ramoops.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx4/qnx4.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 58177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/qnx6/qnx6.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_tree.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v1.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/quota/quota_v2.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 684489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/reiserfs/reiserfs.ko 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/ 2024-09-15T22:36:19.285 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/romfs/romfs.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 3333977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/client/cifs.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_arc4.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/smb/common/cifs_md4.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 163081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/squashfs/squashfs.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 116065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/sysv/sysv.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 309513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/udf/udf.ko 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ 2024-09-15T22:36:19.286 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 198129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/ufs/ufs.ko 2024-09-15T22:36:19.287 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/ 2024-09-15T22:36:19.287 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 5454809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/fs/xfs/xfs.ko 2024-09-15T22:36:19.294 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:36:19.294 INFO:teuthology.orchestra.run.smithi031.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/ 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/ 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 97945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/locking/locktorture.ko 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/ 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/time/test_udelay.ko 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/kernel/torture.ko 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc-itu-t.ko 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 6793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc7.ko 2024-09-15T22:36:19.308 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crc8.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/ 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libarc4.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/crypto/libdes.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/interval_tree_test.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/libcrc32c.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lru_cache.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/ 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4_compress.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/lz4/lz4hc_compress.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/ 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/math/cordic.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/memory-notifier-error-inject.ko 2024-09-15T22:36:19.309 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/notifier-error-inject.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/percpu_test.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/pm-notifier-error-inject.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/ 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 151073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/raid6/raid6_pq.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/rbtree_test.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/ 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20897 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/reed_solomon/reed_solomon.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test-kstrtox.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 4912673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_bpf.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_firmware.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/test_module.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_bm.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_fsm.ko 2024-09-15T22:36:19.310 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/ts_kmp.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/ 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/lib/xz/xz_dec_test.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/ 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/mm/hwpoison-inject.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/ 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/6lowpan.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_dest.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_fragment.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_hop.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_ipv6.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_mobility.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_routing.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/6lowpan/nhc_udp.ko 2024-09-15T22:36:19.311 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/ 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/garp.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/mrp.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/p8022.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/psnap.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/802/stp.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/ 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106841 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/8021q/8021q.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/ 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 234745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_fd.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_rdma.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/9p/9pnet_virtio.ko 2024-09-15T22:36:19.312 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/ 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 875441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/batman-adv/batman-adv.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/ 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 88073 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/br_netfilter.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1026825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/bridge.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_among.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arp.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11233 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_limit.ko 2024-09-15T22:36:19.313 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_log.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9657 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_snat.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_stp.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/ebtables.ko 2024-09-15T22:36:19.314 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/ 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1229873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ceph/libceph.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/ 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 154121 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/core/pktgen.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/ 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 239393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10353 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_diag.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv4.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dccp/dccp_ipv6.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/ 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 498249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/dsa_core.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_brcm.ko 2024-09-15T22:36:19.315 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_dsa.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_none.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/dsa/tag_trailer.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/ 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/hsr/hsr.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 55409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 356385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ieee802154/ieee802154_socket.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29169 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ah4.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/esp4.ko 2024-09-15T22:36:19.316 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 59793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/fou.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/gre.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 64777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/inet_diag.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 77777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_gre.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 78481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_tunnel.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ip_vti.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipcomp.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/ipip.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arp_tables.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ip_tables.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-09-15T22:36:19.317 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16441 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/iptable_security.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-09-15T22:36:19.318 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_bic.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_dctcp.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_diag.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_highspeed.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_htcp.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11753 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_hybla.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_illinois.ko 2024-09-15T22:36:19.319 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11825 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_lp.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_scalable.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_vegas.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_veno.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_westwood.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tcp_yeah.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/tunnel4.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_diag.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53401 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/udp_tunnel.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv4/xfrm4_tunnel.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ah6.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 47193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/esp6.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17201 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/fou6.ko 2024-09-15T22:36:19.320 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 102889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_gre.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 117649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_tunnel.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ip6_vti.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/ipcomp6.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/mip6.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-09-15T22:36:19.321 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17537 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 29017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10617 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-09-15T22:36:19.322 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11185 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 94433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/sit.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 30065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/tunnel6.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/ipv6/xfrm6_tunnel.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/ 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 106217 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/key/af_key.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/ 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 155593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_core.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_debugfs.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_eth.ko 2024-09-15T22:36:19.323 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ip6.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_netlink.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/l2tp/l2tp_ppp.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/ 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 61609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/lapb/lapb.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/ 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 333641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/llc/llc2.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/ 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 388577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mac802154/mac802154.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/ 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/mpls/mpls_gso.ko 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ 2024-09-15T22:36:19.324 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 144881 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124137 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 124449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 126777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 126577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 137937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 133785 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-09-15T22:36:19.325 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 139177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 138369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 136281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 140001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 532393 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-09-15T22:36:19.326 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 54465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conncount.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 485769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37729 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 134177 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_h323.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_irc.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-09-15T22:36:19.327 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 140921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19025 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sane.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_sip.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10993 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_dup_netdev.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 119745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_flow_table_inet.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 46193 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_log_syslog.ko 2024-09-15T22:36:19.328 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 115817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_amanda.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_ftp.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13433 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_irc.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_sip.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_nat_tftp.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 51953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_synproxy_core.ko 2024-09-15T22:36:19.329 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 813705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nf_tables.ko 2024-09-15T22:36:19.330 INFO:teuthology.orchestra.run.smithi031.stderr:Generating grub configuration file ... 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36049 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_acct.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_log.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26129 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_osf.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 66593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nfnetlink_queue.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_chain_nat.ko 2024-09-15T22:36:19.345 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_compat.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 50641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_ct.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_dup_netdev.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fib.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_fwd_netdev.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17329 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_hash.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25385 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_limit.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18017 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_log.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_masq.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_nat.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_numgen.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_osf.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_queue.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_redir.ko 2024-09-15T22:36:19.346 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_reject_inet.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15145 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_socket.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25081 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_synproxy.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17721 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/nft_tproxy.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 104257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/x_tables.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14281 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_AUDIT.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CHECKSUM.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CLASSIFY.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 21953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_CT.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_DSCP.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HL.ko 2024-09-15T22:36:19.347 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_HMARK.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45305 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_IDLETIMER.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16033 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LED.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_LOG.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_MASQUERADE.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NETMAP.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10937 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFLOG.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_NFQUEUE.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22809 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_RATEEST.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12633 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_REDIRECT.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16777 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_SECMARK.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPMSS.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11849 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-09-15T22:36:19.348 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TEE.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TPROXY.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_TRACE.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15377 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_addrtype.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16665 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_bpf.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cgroup.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12953 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cluster.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_comment.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12041 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connbytes.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13113 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlabel.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10705 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connlimit.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_connmark.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_conntrack.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_cpu.ko 2024-09-15T22:36:19.349 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12585 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dccp.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_devgroup.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10345 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_dscp.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ecn.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_esp.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 52929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hashlimit.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_helper.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_hl.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipcomp.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_iprange.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13497 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_ipvs.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_l2tp.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9225 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_length.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11609 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_limit.ko 2024-09-15T22:36:19.350 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mac.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_mark.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_multiport.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16249 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nat.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_nfacct.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_osf.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11649 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_owner.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_physdev.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_pkttype.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13641 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_policy.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_quota.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_rateest.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9361 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_realm.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43569 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_recent.ko 2024-09-15T22:36:19.351 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 14985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_sctp.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_set.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 19865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_socket.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10833 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_state.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10945 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_statistic.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10105 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_string.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9673 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpmss.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_tcpudp.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_time.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netfilter/xt_u32.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/ 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 17321 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/netlink/netlink_diag.ko 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/ 2024-09-15T22:36:19.352 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/nsh/nsh.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/ 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 485961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/openvswitch.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-geneve.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10961 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-gre.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/openvswitch/vport-vxlan.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/ 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 16009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/packet/af_packet_diag.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/ 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 141545 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/phonet.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 69001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/phonet/pn_pep.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/ 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 314473 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 202161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_rdma.ko 2024-09-15T22:36:19.353 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 85265 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rds/rds_tcp.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/ 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1024009 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/rxrpc/rxrpc.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/ 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39097 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_csum.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 28817 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_gact.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45505 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_mirred.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 27689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_nat.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 53577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_pedit.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38801 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_police.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24057 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_simple.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43513 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_skbedit.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 45769 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/act_vlan.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32289 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_basic.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 41561 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_bpf.ko 2024-09-15T22:36:19.354 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_cgroup.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 37409 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_flow.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39697 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_fw.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 49417 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_route.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 79257 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/cls_u32.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8793 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_cmp.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 15481 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_ipset.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 48889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_meta.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 9337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_nbyte.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13465 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_text.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 8457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/em_u32.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25921 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_choke.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25209 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_codel.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43577 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_drr.ko 2024-09-15T22:36:19.355 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 43865 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 39273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_fq_codel.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 42985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_gred.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60913 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hfsc.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 26689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_hhf.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 81065 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_htb.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33745 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_ingress.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 36713 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 11905 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_mqprio_lib.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33153 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_multiq.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 44857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_netem.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 32425 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_pie.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 13593 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_plug.ko 2024-09-15T22:36:19.356 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 31889 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_prio.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 60337 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_qfq.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 40977 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_red.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 33521 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfb.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 38457 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_sfq.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 35857 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_tbf.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 34241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sched/sch_teql.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/ 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1184689 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 24001 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sctp/sctp_diag.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/ 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/ 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 426969 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 70273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-09-15T22:36:19.357 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1895553 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/sunrpc.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/ 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 925089 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/ 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 1122601 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12241 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/tipc/tipc_diag.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/ 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 18273 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/unix/unix_diag.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/ 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 101161 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 90369 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 120625 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 12985 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_diag.ko 2024-09-15T22:36:19.358 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 20489 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/vmw_vsock/vsock_loopback.ko 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/ 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 165529 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/x25/x25.ko 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/ 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 25449 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_algo.ko 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 22929 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_ipcomp.ko 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 135873 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/kernel/net/xfrm/xfrm_user.ko 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 649700 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 633853 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.alias.bin 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 7850 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 23959 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.alias.bin 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 10056 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.bin 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 74053 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.builtin.modinfo 2024-09-15T22:36:19.359 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 147543 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 233297 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.dep.bin 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 210 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.devname 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 72756 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.order 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 879 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.softdep 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 261535 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 316586 2024-09-06 14:57 ./lib/modules/6.11.0-rc5-g2ca44a2f35ca/modules.symbols.bin 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/ 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/ 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/ 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:drwxr-xr-x root/root 0 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/ 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 176 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/changelog.Debian.gz 2024-09-15T22:36:19.360 INFO:teuthology.orchestra.run.smithi102.stdout:-rw-r--r-- root/root 691 2024-09-06 14:57 ./usr/share/doc/linux-image-6.11.0-rc5-g2ca44a2f35ca/copyright 2024-09-15T22:36:19.365 DEBUG:teuthology.task.kernel:get_image_version: 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.365 INFO:teuthology.task.kernel:searching for kernel 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.365 DEBUG:teuthology.orchestra.run.smithi102:> egrep '(submenu|menuentry.*6.11.0-rc5-g2ca44a2f35ca).*{' /boot/grub/grub.cfg 2024-09-15T22:36:19.398 INFO:teuthology.orchestra.run.smithi102.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:19.398 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:19.398 INFO:teuthology.orchestra.run.smithi102.stdout: menuentry 'Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.11.0-rc5-g2ca44a2f35ca-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-09-15T22:36:19.399 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-09-15T22:36:19.399 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.399 DEBUG:teuthology.orchestra.run.smithi102:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-09-15T22:36:19.442 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi102.front.sepia.ceph.com to complete... 2024-09-15T22:36:19.479 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.485 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:19.700 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:36:19.706 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:36:19.747 INFO:teuthology.orchestra.run.smithi031.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:36:19.752 INFO:teuthology.orchestra.run.smithi031.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:36:19.858 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub' 2024-09-15T22:36:19.859 INFO:teuthology.orchestra.run.smithi102.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-15T22:36:19.879 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-15T22:36:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:36:20.005 INFO:teuthology.orchestra.run.smithi031.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:36:20.006 INFO:teuthology.orchestra.run.smithi031.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:36:20.037 INFO:teuthology.orchestra.run.smithi031.stderr:done 2024-09-15T22:36:20.078 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:20.085 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:36:20.306 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-15T22:36:20.311 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-15T22:36:20.352 INFO:teuthology.orchestra.run.smithi102.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-15T22:36:20.358 INFO:teuthology.orchestra.run.smithi102.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-15T22:36:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-15T22:36:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-15T22:36:20.533 INFO:teuthology.orchestra.run.smithi102.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-15T22:36:20.554 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-15T22:36:51.172 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-09-15T22:36:51.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-15T22:36:51.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:36:51.668 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-09-15T22:36:51.668 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-15T22:36:51.668 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:37:51.236 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:37:51.670 DEBUG:teuthology.orchestra.remote:timed out 2024-09-15T22:38:00.246 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-15T22:38:00.247 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:38:00.453 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-15T22:38:00.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-15T22:38:00.672 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:38:01.141 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-15T22:38:01.141 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-15T22:38:01.142 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2024-09-15T22:38:01.191 INFO:teuthology.orchestra.run.smithi031.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:38:01.191 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:38:01.191 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:38:01.191 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T22:38:01.323 ERROR:teuthology.orchestra.connection:Error authenticating with smithi102.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/connection.py", line 111, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/virtualenv/lib/python3.10/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-09-15T22:38:02.195 DEBUG:teuthology.parallel:result is None 2024-09-15T22:38:05.412 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-15T22:38:06.293 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-15T22:38:06.293 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.11.0-rc5-g2ca44a2f35ca"... 2024-09-15T22:38:06.294 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-15T22:38:06.343 INFO:teuthology.orchestra.run.smithi102.stdout:6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:38:06.344 DEBUG:teuthology.task.kernel:current kernel version is 6.11.0-rc5-g2ca44a2f35ca vs 6.11.0-rc5-g2ca44a2f35ca 2024-09-15T22:38:06.344 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-15T22:38:06.344 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-15T22:38:07.346 DEBUG:teuthology.parallel:result is None 2024-09-15T22:38:07.346 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-15T22:38:07.355 INFO:teuthology.task.internal:Creating test directory... 2024-09-15T22:38:07.355 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:38:07.358 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-15T22:38:07.366 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-15T22:38:07.396 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-15T22:38:07.476 INFO:teuthology.task.internal:Creating archive directory... 2024-09-15T22:38:07.476 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:38:07.479 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-15T22:38:07.503 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-15T22:38:07.531 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-15T22:38:07.531 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:38:07.537 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-15T22:38:07.601 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:38:07.621 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:38:07.622 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:38:07.639 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-15T22:38:07.642 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-15T22:38:07.648 INFO:teuthology.task.internal:Configuring sudo... 2024-09-15T22:38:07.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:38:07.652 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-15T22:38:07.670 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-15T22:38:07.682 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-15T22:38:07.682 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:38:07.718 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-15T22:38:07.725 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:38:07.776 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:38:07.828 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:38:07.828 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:38:07.898 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-15T22:38:07.906 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-15T22:38:07.955 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:38:07.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-15T22:38:08.030 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2024-09-15T22:38:08.033 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-15T22:38:08.137 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-15T22:38:08.144 INFO:teuthology.task.internal:Starting timer... 2024-09-15T22:38:08.144 INFO:teuthology.run_tasks:Running task pcp... 2024-09-15T22:38:08.184 INFO:teuthology.run_tasks:Running task selinux... 2024-09-15T22:38:08.221 DEBUG:teuthology.task.selinux:Excluding smithi031: OS 'ubuntu' does not support SELinux 2024-09-15T22:38:08.221 DEBUG:teuthology.task.selinux:Excluding smithi102: OS 'ubuntu' does not support SELinux 2024-09-15T22:38:08.221 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-15T22:38:08.221 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-15T22:38:08.221 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-15T22:38:08.221 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-15T22:38:08.248 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-15T22:38:08.260 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-15T22:38:08.261 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi031.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-15T22:46:26.701 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-15T22:46:26.702 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-15T22:46:26.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:46:26.788 DEBUG:teuthology.orchestra.run.smithi031:> true 2024-09-15T22:46:26.920 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2024-09-15T22:46:26.920 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-15T22:46:26.921 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-15T22:46:27.013 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-15T22:46:27.144 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-15T22:46:27.144 INFO:teuthology.run_tasks:Running task clock... 2024-09-15T22:46:27.270 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-15T22:46:27.270 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:46:27.271 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:46:27.274 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-15T22:46:27.274 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Command line: ntpd -gq 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: ---------------------------------------------------- 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: corporation. Support and training for ntp-4 are 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: available at https://www.nwtime.org/support 2024-09-15T22:46:27.312 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: ---------------------------------------------------- 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: proto: precision = 0.043 usec (-24) 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: basedate set to 2022-02-04 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: gps base set to 2022-02-06 (week 2196) 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:46:27.313 INFO:teuthology.orchestra.run.smithi031.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:46:27.314 INFO:teuthology.orchestra.run.smithi031.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Command line: ntpd -gq 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: ---------------------------------------------------- 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: ntp-4 is maintained by Network Time Foundation, 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: corporation. Support and training for ntp-4 are 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: available at https://www.nwtime.org/support 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: ---------------------------------------------------- 2024-09-15T22:46:27.315 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: proto: precision = 0.041 usec (-24) 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen normally on 3 ens1f0 172.21.15.31:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen normally on 4 lo [::1]:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:caba%4]:123 2024-09-15T22:46:27.316 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:27 ntpd[18381]: Listening on routing socket on fd #22 for interface updates 2024-09-15T22:46:27.317 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: basedate set to 2022-02-04 2024-09-15T22:46:27.317 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: gps base set to 2022-02-06 (week 2196) 2024-09-15T22:46:27.317 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:46:27.317 INFO:teuthology.orchestra.run.smithi102.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-15T22:46:27.317 INFO:teuthology.orchestra.run.smithi102.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:46:27.318 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: restrict ::: KOD does nothing without LIMITED. 2024-09-15T22:46:27.318 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen and drop on 0 v6wildcard [::]:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen normally on 2 lo 127.0.0.1:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen normally on 3 enp3s0f1 172.21.15.102:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen normally on 4 lo [::1]:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d769%5]:123 2024-09-15T22:46:27.319 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:27 ntpd[18470]: Listening on routing socket on fd #22 for interface updates 2024-09-15T22:46:28.312 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:28.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:28.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:28.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:28.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:28.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:28 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:28.314 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:28.314 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:28.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:28.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:28.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:28.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:28 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:29.312 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.312 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:29.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:29 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:29.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:29 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:30.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:30.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:30 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:30.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:30 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:31.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:31 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:31.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:31 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:32.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:32 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:32.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:32 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:33.312 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:33.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:33 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:33.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:33.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:33 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:34.313 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:34.314 INFO:teuthology.orchestra.run.smithi031.stdout:15 Sep 22:46:34 ntpd[18381]: ntpd: time slew -0.001039 s 2024-09-15T22:46:34.314 INFO:teuthology.orchestra.run.smithi031.stdout:ntpd: time slew -0.001039s 2024-09-15T22:46:34.314 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T22:46:34.315 INFO:teuthology.orchestra.run.smithi031.stderr:15 Sep 22:46:34 ntpd[18381]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T22:46:34.315 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: can't open /var/log/ntpstats/rawstats.20240915: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: can't open /var/log/ntpstats/peerstats.20240915: Permission denied 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stdout:15 Sep 22:46:34 ntpd[18470]: ntpd: time slew -0.000014 s 2024-09-15T22:46:34.316 INFO:teuthology.orchestra.run.smithi102.stdout:ntpd: time slew -0.000014s 2024-09-15T22:46:34.317 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-15T22:46:34.317 INFO:teuthology.orchestra.run.smithi102.stderr:15 Sep 22:46:34 ntpd[18470]: can't open /var/log/ntpstats/loopstats.20240915: Permission denied 2024-09-15T22:46:34.405 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:46:34.406 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-15T22:46:34.406 INFO:teuthology.orchestra.run.smithi102.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.406 INFO:teuthology.orchestra.run.smithi102.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.406 INFO:teuthology.orchestra.run.smithi102.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.406 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:46:34.423 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-15T22:46:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:46:34.423 INFO:teuthology.run_tasks:Running task install... 2024-09-15T22:46:34.431 DEBUG:teuthology.task.install:project ceph 2024-09-15T22:46:34.431 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}} 2024-09-15T22:46:34.432 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'} 2024-09-15T22:46:34.432 INFO:teuthology.task.install:Using flavor: default 2024-09-15T22:46:34.437 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-15T22:46:34.437 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-15T22:46:34.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-key list | grep Ceph 2024-09-15T22:46:34.438 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-key list | grep Ceph 2024-09-15T22:46:34.552 INFO:teuthology.orchestra.run.smithi102.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T22:46:34.568 INFO:teuthology.orchestra.run.smithi031.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-15T22:46:34.602 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T22:46:34.602 INFO:teuthology.orchestra.run.smithi102.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T22:46:34.603 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T22:46:34.604 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T22:46:34.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:46:34.621 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-15T22:46:34.621 INFO:teuthology.orchestra.run.smithi031.stdout:uid [ unknown] Ceph.com (release key) 2024-09-15T22:46:34.622 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-09-15T22:46:34.622 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-09-15T22:46:34.622 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:46:34.746 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T22:46:34.746 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:46:34.764 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default/ 2024-09-15T22:46:34.765 INFO:teuthology.task.install.deb:Package version is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:46:34.863 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:46:34.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T22:46:34.882 DEBUG:teuthology.orchestra.run.smithi102:> sudo apt-get update 2024-09-15T22:46:34.888 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:46:34.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-15T22:46:34.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo apt-get update 2024-09-15T22:46:35.064 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:46:35.071 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:46:35.072 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:46:35.088 INFO:teuthology.orchestra.run.smithi102.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:46:35.095 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-15T22:46:35.101 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-15T22:46:35.111 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T22:46:35.118 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-15T22:46:35.133 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T22:46:35.146 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy InRelease 2024-09-15T22:46:35.155 INFO:teuthology.orchestra.run.smithi102.stdout:Ign:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T22:46:35.168 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-09-15T22:46:35.176 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T22:46:35.190 INFO:teuthology.orchestra.run.smithi031.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-15T22:46:35.209 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T22:46:35.212 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-09-15T22:46:35.223 INFO:teuthology.orchestra.run.smithi031.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-15T22:46:35.245 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,422 B] 2024-09-15T22:46:35.662 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 29.0 kB in 1s (52.2 kB/s) 2024-09-15T22:46:35.713 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 29.0 kB in 1s (50.9 kB/s) 2024-09-15T22:46:36.697 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-15T22:46:36.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:46:36.787 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-15T22:46:36.804 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-15T22:46:36.820 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.1.1-326-g8921c8ef-1jammy cephadm=19.1.1-326-g8921c8ef-1jammy ceph-mds=19.1.1-326-g8921c8ef-1jammy ceph-mgr=19.1.1-326-g8921c8ef-1jammy ceph-common=19.1.1-326-g8921c8ef-1jammy ceph-fuse=19.1.1-326-g8921c8ef-1jammy ceph-test=19.1.1-326-g8921c8ef-1jammy ceph-volume=19.1.1-326-g8921c8ef-1jammy radosgw=19.1.1-326-g8921c8ef-1jammy python3-rados=19.1.1-326-g8921c8ef-1jammy python3-rgw=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy python3-rbd=19.1.1-326-g8921c8ef-1jammy libcephfs2=19.1.1-326-g8921c8ef-1jammy libcephfs-dev=19.1.1-326-g8921c8ef-1jammy librados2=19.1.1-326-g8921c8ef-1jammy librbd1=19.1.1-326-g8921c8ef-1jammy rbd-fuse=19.1.1-326-g8921c8ef-1jammy python3-cephfs=19.1.1-326-g8921c8ef-1jammy cephfs-shell=19.1.1-326-g8921c8ef-1jammy cephfs-top=19.1.1-326-g8921c8ef-1jammy cephfs-mirror=19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:46:36.898 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-15T22:46:36.972 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-15T22:46:36.973 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-15T22:46:37.086 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-15T22:46:37.086 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-15T22:46:37.159 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:46:37.160 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:46:37.160 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:46:37.160 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:46:37.160 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:46:37.160 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:46:37.161 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:46:37.161 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-15T22:46:37.161 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T22:46:37.161 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T22:46:37.163 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T22:46:37.164 INFO:teuthology.orchestra.run.smithi102.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout:Recommended packages: 2024-09-15T22:46:37.165 INFO:teuthology.orchestra.run.smithi102.stdout: btrfs-tools 2024-09-15T22:46:37.280 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:46:37.280 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:46:37.280 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:46:37.280 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:46:37.281 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:46:37.281 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:46:37.281 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:46:37.281 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-15T22:46:37.281 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-15T22:46:37.283 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-15T22:46:37.283 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-09-15T22:46:37.284 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-09-15T22:46:37.285 INFO:teuthology.orchestra.run.smithi031.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-15T22:46:37.286 INFO:teuthology.orchestra.run.smithi031.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-15T22:46:37.287 INFO:teuthology.orchestra.run.smithi031.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-15T22:46:37.287 INFO:teuthology.orchestra.run.smithi031.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-15T22:46:37.287 INFO:teuthology.orchestra.run.smithi031.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-15T22:46:37.287 INFO:teuthology.orchestra.run.smithi031.stdout:Recommended packages: 2024-09-15T22:46:37.287 INFO:teuthology.orchestra.run.smithi031.stdout: btrfs-tools 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T22:46:37.319 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T22:46:37.321 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T22:46:37.322 INFO:teuthology.orchestra.run.smithi102.stdout: socat unzip xmlstarlet zip 2024-09-15T22:46:37.408 INFO:teuthology.orchestra.run.smithi102.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-15T22:46:37.408 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 181 MB of archives. 2024-09-15T22:46:37.408 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T22:46:37.408 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T22:46:37.425 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T22:46:37.435 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T22:46:37.445 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-15T22:46:37.445 INFO:teuthology.orchestra.run.smithi031.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-15T22:46:37.445 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-15T22:46:37.445 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-09-15T22:46:37.445 INFO:teuthology.orchestra.run.smithi031.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-15T22:46:37.447 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-15T22:46:37.448 INFO:teuthology.orchestra.run.smithi031.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-15T22:46:37.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-15T22:46:37.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-15T22:46:37.449 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-09-15T22:46:37.449 INFO:teuthology.orchestra.run.smithi031.stdout: socat unzip xmlstarlet zip 2024-09-15T22:46:37.470 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T22:46:37.476 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T22:46:37.496 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T22:46:37.499 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T22:46:37.510 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T22:46:37.516 INFO:teuthology.orchestra.run.smithi031.stdout:0 upgraded, 124 newly installed, 0 to remove and 334 not upgraded. 2024-09-15T22:46:37.516 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 181 MB of archives. 2024-09-15T22:46:37.516 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 831 MB of additional disk space will be used. 2024-09-15T22:46:37.517 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-09-15T22:46:37.534 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-15T22:46:37.544 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-09-15T22:46:37.548 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T22:46:37.551 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T22:46:37.558 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T22:46:37.560 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T22:46:37.561 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T22:46:37.573 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T22:46:37.575 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T22:46:37.577 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T22:46:37.578 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T22:46:37.579 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T22:46:37.585 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-15T22:46:37.585 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T22:46:37.587 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T22:46:37.588 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T22:46:37.589 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T22:46:37.602 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T22:46:37.603 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T22:46:37.603 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T22:46:37.603 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T22:46:37.604 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T22:46:37.604 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T22:46:37.606 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.1.1-326-g8921c8ef-1jammy [3,590 kB] 2024-09-15T22:46:37.606 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-15T22:46:37.609 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-15T22:46:37.619 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T22:46:37.619 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T22:46:37.620 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-15T22:46:37.621 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T22:46:37.622 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T22:46:37.636 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T22:46:37.636 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T22:46:37.637 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T22:46:37.637 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T22:46:37.638 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T22:46:37.639 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T22:46:37.644 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T22:46:37.653 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T22:46:37.653 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T22:46:37.657 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T22:46:37.658 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T22:46:37.658 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-15T22:46:37.660 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-15T22:46:37.667 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-15T22:46:37.670 INFO:teuthology.orchestra.run.smithi102.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T22:46:37.670 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-15T22:46:37.670 INFO:teuthology.orchestra.run.smithi102.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T22:46:37.671 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-15T22:46:37.671 INFO:teuthology.orchestra.run.smithi102.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T22:46:37.673 INFO:teuthology.orchestra.run.smithi102.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T22:46:37.674 INFO:teuthology.orchestra.run.smithi102.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T22:46:37.675 INFO:teuthology.orchestra.run.smithi102.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T22:46:37.676 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-15T22:46:37.678 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-15T22:46:37.680 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-15T22:46:37.681 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-15T22:46:37.681 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-15T22:46:37.686 INFO:teuthology.orchestra.run.smithi102.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T22:46:37.688 INFO:teuthology.orchestra.run.smithi102.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T22:46:37.689 INFO:teuthology.orchestra.run.smithi102.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T22:46:37.690 INFO:teuthology.orchestra.run.smithi102.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T22:46:37.692 INFO:teuthology.orchestra.run.smithi102.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T22:46:37.694 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-15T22:46:37.696 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-15T22:46:37.697 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-15T22:46:37.698 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-15T22:46:37.704 INFO:teuthology.orchestra.run.smithi102.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T22:46:37.704 INFO:teuthology.orchestra.run.smithi102.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T22:46:37.709 INFO:teuthology.orchestra.run.smithi102.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T22:46:37.709 INFO:teuthology.orchestra.run.smithi102.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T22:46:37.711 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-15T22:46:37.712 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-15T22:46:37.712 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-15T22:46:37.713 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-15T22:46:37.713 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-15T22:46:37.714 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-15T22:46:37.715 INFO:teuthology.orchestra.run.smithi102.stdout:Get:59 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T22:46:37.716 INFO:teuthology.orchestra.run.smithi102.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T22:46:37.722 INFO:teuthology.orchestra.run.smithi102.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T22:46:37.728 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-15T22:46:37.729 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-15T22:46:37.732 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-15T22:46:37.732 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-15T22:46:37.746 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-15T22:46:37.746 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-15T22:46:37.747 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-15T22:46:37.747 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-15T22:46:37.748 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-15T22:46:37.748 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-15T22:46:37.750 INFO:teuthology.orchestra.run.smithi102.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T22:46:37.751 INFO:teuthology.orchestra.run.smithi102.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T22:46:37.752 INFO:teuthology.orchestra.run.smithi102.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T22:46:37.753 INFO:teuthology.orchestra.run.smithi102.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T22:46:37.754 INFO:teuthology.orchestra.run.smithi102.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T22:46:37.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-15T22:46:37.765 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-15T22:46:37.770 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-15T22:46:37.770 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-15T22:46:37.773 INFO:teuthology.orchestra.run.smithi102.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T22:46:37.775 INFO:teuthology.orchestra.run.smithi102.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T22:46:37.776 INFO:teuthology.orchestra.run.smithi102.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T22:46:37.782 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-15T22:46:37.782 INFO:teuthology.orchestra.run.smithi031.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-15T22:46:37.783 INFO:teuthology.orchestra.run.smithi031.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-15T22:46:37.785 INFO:teuthology.orchestra.run.smithi031.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-15T22:46:37.786 INFO:teuthology.orchestra.run.smithi031.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-15T22:46:37.787 INFO:teuthology.orchestra.run.smithi031.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-15T22:46:37.793 INFO:teuthology.orchestra.run.smithi102.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T22:46:37.793 INFO:teuthology.orchestra.run.smithi102.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T22:46:37.794 INFO:teuthology.orchestra.run.smithi102.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T22:46:37.794 INFO:teuthology.orchestra.run.smithi102.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T22:46:37.795 INFO:teuthology.orchestra.run.smithi102.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T22:46:37.796 INFO:teuthology.orchestra.run.smithi102.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T22:46:37.800 INFO:teuthology.orchestra.run.smithi031.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-15T22:46:37.801 INFO:teuthology.orchestra.run.smithi031.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-15T22:46:37.802 INFO:teuthology.orchestra.run.smithi031.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-15T22:46:37.803 INFO:teuthology.orchestra.run.smithi031.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-15T22:46:37.803 INFO:teuthology.orchestra.run.smithi102.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T22:46:37.803 INFO:teuthology.orchestra.run.smithi102.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T22:46:37.807 INFO:teuthology.orchestra.run.smithi102.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T22:46:37.816 INFO:teuthology.orchestra.run.smithi031.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-15T22:46:37.820 INFO:teuthology.orchestra.run.smithi102.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T22:46:37.821 INFO:teuthology.orchestra.run.smithi102.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T22:46:37.822 INFO:teuthology.orchestra.run.smithi102.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T22:46:37.825 INFO:teuthology.orchestra.run.smithi102.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T22:46:37.828 INFO:teuthology.orchestra.run.smithi102.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T22:46:37.829 INFO:teuthology.orchestra.run.smithi102.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T22:46:37.830 INFO:teuthology.orchestra.run.smithi102.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T22:46:37.837 INFO:teuthology.orchestra.run.smithi102.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T22:46:37.841 INFO:teuthology.orchestra.run.smithi102.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T22:46:37.842 INFO:teuthology.orchestra.run.smithi102.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T22:46:37.848 INFO:teuthology.orchestra.run.smithi102.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T22:46:37.850 INFO:teuthology.orchestra.run.smithi102.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T22:46:37.854 INFO:teuthology.orchestra.run.smithi102.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T22:46:37.855 INFO:teuthology.orchestra.run.smithi102.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T22:46:37.856 INFO:teuthology.orchestra.run.smithi102.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T22:46:37.856 INFO:teuthology.orchestra.run.smithi102.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T22:46:37.857 INFO:teuthology.orchestra.run.smithi102.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T22:46:37.858 INFO:teuthology.orchestra.run.smithi102.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T22:46:37.859 INFO:teuthology.orchestra.run.smithi102.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T22:46:37.866 INFO:teuthology.orchestra.run.smithi102.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T22:46:37.868 INFO:teuthology.orchestra.run.smithi031.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-15T22:46:37.869 INFO:teuthology.orchestra.run.smithi031.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-15T22:46:37.872 INFO:teuthology.orchestra.run.smithi031.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-15T22:46:37.872 INFO:teuthology.orchestra.run.smithi031.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-15T22:46:37.872 INFO:teuthology.orchestra.run.smithi102.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T22:46:37.872 INFO:teuthology.orchestra.run.smithi102.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T22:46:37.873 INFO:teuthology.orchestra.run.smithi031.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-15T22:46:37.874 INFO:teuthology.orchestra.run.smithi102.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T22:46:37.888 INFO:teuthology.orchestra.run.smithi102.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T22:46:37.894 INFO:teuthology.orchestra.run.smithi031.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-15T22:46:37.896 INFO:teuthology.orchestra.run.smithi031.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-15T22:46:37.896 INFO:teuthology.orchestra.run.smithi031.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-15T22:46:37.915 INFO:teuthology.orchestra.run.smithi031.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-15T22:46:37.916 INFO:teuthology.orchestra.run.smithi031.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-15T22:46:37.916 INFO:teuthology.orchestra.run.smithi031.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi031.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-15T22:46:37.917 INFO:teuthology.orchestra.run.smithi031.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-15T22:46:37.918 INFO:teuthology.orchestra.run.smithi031.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-15T22:46:37.922 INFO:teuthology.orchestra.run.smithi031.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-15T22:46:37.923 INFO:teuthology.orchestra.run.smithi031.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-15T22:46:37.929 INFO:teuthology.orchestra.run.smithi031.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-15T22:46:37.939 INFO:teuthology.orchestra.run.smithi031.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-15T22:46:37.941 INFO:teuthology.orchestra.run.smithi031.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-15T22:46:37.941 INFO:teuthology.orchestra.run.smithi031.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-15T22:46:37.945 INFO:teuthology.orchestra.run.smithi031.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-15T22:46:37.948 INFO:teuthology.orchestra.run.smithi031.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-09-15T22:46:37.949 INFO:teuthology.orchestra.run.smithi031.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-15T22:46:37.950 INFO:teuthology.orchestra.run.smithi031.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-15T22:46:37.956 INFO:teuthology.orchestra.run.smithi031.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.3 [474 kB] 2024-09-15T22:46:37.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-15T22:46:37.961 INFO:teuthology.orchestra.run.smithi031.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-15T22:46:37.973 INFO:teuthology.orchestra.run.smithi031.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-15T22:46:37.974 INFO:teuthology.orchestra.run.smithi031.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-15T22:46:37.975 INFO:teuthology.orchestra.run.smithi031.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-15T22:46:37.975 INFO:teuthology.orchestra.run.smithi031.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-15T22:46:37.977 INFO:teuthology.orchestra.run.smithi031.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-15T22:46:37.978 INFO:teuthology.orchestra.run.smithi031.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-15T22:46:37.985 INFO:teuthology.orchestra.run.smithi031.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-15T22:46:37.990 INFO:teuthology.orchestra.run.smithi031.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-15T22:46:37.991 INFO:teuthology.orchestra.run.smithi031.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-15T22:46:37.993 INFO:teuthology.orchestra.run.smithi031.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-15T22:46:38.007 INFO:teuthology.orchestra.run.smithi031.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-15T22:46:38.329 INFO:teuthology.orchestra.run.smithi102.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T22:46:38.332 INFO:teuthology.orchestra.run.smithi031.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.1.1-326-g8921c8ef-1jammy [3,241 kB] 2024-09-15T22:46:38.418 INFO:teuthology.orchestra.run.smithi102.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T22:46:38.420 INFO:teuthology.orchestra.run.smithi102.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T22:46:38.422 INFO:teuthology.orchestra.run.smithi102.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T22:46:38.454 INFO:teuthology.orchestra.run.smithi102.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T22:46:38.569 INFO:teuthology.orchestra.run.smithi102.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T22:46:38.754 INFO:teuthology.orchestra.run.smithi031.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.1.1-326-g8921c8ef-1jammy [719 kB] 2024-09-15T22:46:38.816 INFO:teuthology.orchestra.run.smithi031.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.1.1-326-g8921c8ef-1jammy [356 kB] 2024-09-15T22:46:38.862 INFO:teuthology.orchestra.run.smithi031.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.1.1-326-g8921c8ef-1jammy [32.8 kB] 2024-09-15T22:46:38.863 INFO:teuthology.orchestra.run.smithi031.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.1.1-326-g8921c8ef-1jammy [180 kB] 2024-09-15T22:46:38.871 INFO:teuthology.orchestra.run.smithi031.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.1.1-326-g8921c8ef-1jammy [67.8 kB] 2024-09-15T22:46:38.910 INFO:teuthology.orchestra.run.smithi031.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.1.1-326-g8921c8ef-1jammy [333 kB] 2024-09-15T22:46:38.919 INFO:teuthology.orchestra.run.smithi031.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.1.1-326-g8921c8ef-1jammy [6,875 kB] 2024-09-15T22:46:39.012 INFO:teuthology.orchestra.run.smithi102.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T22:46:39.013 INFO:teuthology.orchestra.run.smithi102.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T22:46:39.020 INFO:teuthology.orchestra.run.smithi102.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T22:46:39.071 INFO:teuthology.orchestra.run.smithi102.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T22:46:39.090 INFO:teuthology.orchestra.run.smithi102.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T22:46:39.093 INFO:teuthology.orchestra.run.smithi102.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T22:46:39.136 INFO:teuthology.orchestra.run.smithi102.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T22:46:39.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T22:46:39.316 INFO:teuthology.orchestra.run.smithi102.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T22:46:39.497 INFO:teuthology.orchestra.run.smithi031.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.1.1-326-g8921c8ef-1jammy [112 kB] 2024-09-15T22:46:39.499 INFO:teuthology.orchestra.run.smithi031.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.1.1-326-g8921c8ef-1jammy [472 kB] 2024-09-15T22:46:39.511 INFO:teuthology.orchestra.run.smithi031.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.1.1-326-g8921c8ef-1jammy [25.9 MB] 2024-09-15T22:46:40.544 INFO:teuthology.orchestra.run.smithi102.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T22:46:40.545 INFO:teuthology.orchestra.run.smithi102.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T22:46:40.547 INFO:teuthology.orchestra.run.smithi102.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T22:46:40.547 INFO:teuthology.orchestra.run.smithi102.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T22:46:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T22:46:40.548 INFO:teuthology.orchestra.run.smithi102.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T22:46:40.838 INFO:teuthology.orchestra.run.smithi031.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.1.1-326-g8921c8ef-1jammy [5,145 kB] 2024-09-15T22:46:40.875 INFO:teuthology.orchestra.run.smithi102.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T22:46:40.951 INFO:teuthology.orchestra.run.smithi031.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.1.1-326-g8921c8ef-1jammy [245 kB] 2024-09-15T22:46:40.953 INFO:teuthology.orchestra.run.smithi031.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.1.1-326-g8921c8ef-1jammy [124 kB] 2024-09-15T22:46:40.955 INFO:teuthology.orchestra.run.smithi031.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.1.1-326-g8921c8ef-1jammy [1,555 kB] 2024-09-15T22:46:40.981 INFO:teuthology.orchestra.run.smithi031.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.1.1-326-g8921c8ef-1jammy [6,143 kB] 2024-09-15T22:46:41.083 INFO:teuthology.orchestra.run.smithi031.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.1.1-326-g8921c8ef-1jammy [22.8 MB] 2024-09-15T22:46:41.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.1.1-326-g8921c8ef-1jammy [14.1 kB] 2024-09-15T22:46:41.462 INFO:teuthology.orchestra.run.smithi031.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.1.1-326-g8921c8ef-1jammy [877 kB] 2024-09-15T22:46:41.469 INFO:teuthology.orchestra.run.smithi031.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.1.1-326-g8921c8ef-1jammy [2,462 kB] 2024-09-15T22:46:41.510 INFO:teuthology.orchestra.run.smithi031.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.1.1-326-g8921c8ef-1jammy [794 kB] 2024-09-15T22:46:41.522 INFO:teuthology.orchestra.run.smithi031.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.1.1-326-g8921c8ef-1jammy [152 kB] 2024-09-15T22:46:41.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.1.1-326-g8921c8ef-1jammy [2,275 kB] 2024-09-15T22:46:41.540 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 181 MB in 4s (51.0 MB/s) 2024-09-15T22:46:41.563 INFO:teuthology.orchestra.run.smithi031.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.1.1-326-g8921c8ef-1jammy [8,625 kB] 2024-09-15T22:46:41.681 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T22:46:41.706 INFO:teuthology.orchestra.run.smithi031.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.1.1-326-g8921c8ef-1jammy [14.2 kB] 2024-09-15T22:46:41.706 INFO:teuthology.orchestra.run.smithi031.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.1.1-326-g8921c8ef-1jammy [51.4 MB] 2024-09-15T22:46:41.746 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-15T22:46:41.749 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T22:46:41.796 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T22:46:42.107 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T22:46:42.121 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T22:46:42.166 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:46:42.444 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T22:46:42.457 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T22:46:42.493 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T22:46:42.563 INFO:teuthology.orchestra.run.smithi031.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.1.1-326-g8921c8ef-1jammy [130 kB] 2024-09-15T22:46:42.563 INFO:teuthology.orchestra.run.smithi031.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.1.1-326-g8921c8ef-1jammy [237 kB] 2024-09-15T22:46:42.566 INFO:teuthology.orchestra.run.smithi031.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.1.1-326-g8921c8ef-1jammy [34.0 kB] 2024-09-15T22:46:42.566 INFO:teuthology.orchestra.run.smithi031.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.1.1-326-g8921c8ef-1jammy [23.5 kB] 2024-09-15T22:46:42.566 INFO:teuthology.orchestra.run.smithi031.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.1.1-326-g8921c8ef-1jammy [39.0 kB] 2024-09-15T22:46:42.567 INFO:teuthology.orchestra.run.smithi031.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.1.1-326-g8921c8ef-1jammy [13.6 MB] 2024-09-15T22:46:42.781 INFO:teuthology.orchestra.run.smithi031.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/squid/8921c8ef947807b717db041d85f0761b7914d5fc/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.1.1-326-g8921c8ef-1jammy [91.5 kB] 2024-09-15T22:46:42.813 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T22:46:42.828 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T22:46:42.913 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:46:43.250 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T22:46:43.265 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T22:46:43.309 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:46:43.458 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 181 MB in 5s (34.1 MB/s) 2024-09-15T22:46:43.590 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyperclip. 2024-09-15T22:46:43.637 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T22:46:43.651 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T22:46:43.658 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132928 files and directories currently installed.) 2024-09-15T22:46:43.661 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-09-15T22:46:43.695 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:46:43.706 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-09-15T22:46:44.025 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-15T22:46:44.040 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-15T22:46:44.083 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:46:44.190 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T22:46:44.205 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:44.257 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:44.345 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cmd2. 2024-09-15T22:46:44.359 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-09-15T22:46:44.394 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-09-15T22:46:44.618 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T22:46:44.632 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:44.677 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:44.680 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-15T22:46:45.147 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-15T22:46:45.147 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:46:45.147 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-15T22:46:45.147 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-15T22:46:45.171 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T22:46:45.176 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:46:45.185 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:45.229 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:45.528 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-15T22:46:45.544 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-15T22:46:45.586 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:46:45.591 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T22:46:45.605 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T22:46:45.649 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:46:45.948 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-15T22:46:45.960 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librados2. 2024-09-15T22:46:45.963 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:45.975 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:46.006 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:46.019 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:46.401 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-15T22:46:46.416 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:46.459 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:46.480 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librbd1. 2024-09-15T22:46:46.500 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:46.538 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:46.829 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-15T22:46:46.846 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-15T22:46:46.888 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:46:46.924 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T22:46:46.938 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:46.983 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:47.207 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-15T22:46:47.223 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-15T22:46:47.243 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rados. 2024-09-15T22:46:47.257 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:46:47.257 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:47.302 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:47.527 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librados2. 2024-09-15T22:46:47.543 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../010-librados2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:47.585 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:47.654 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T22:46:47.668 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:46:47.713 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:47.965 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T22:46:47.980 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:48.023 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:48.028 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librbd1. 2024-09-15T22:46:48.043 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../011-librbd1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:48.087 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:48.310 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T22:46:48.324 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:46:48.360 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:48.490 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs2. 2024-09-15T22:46:48.505 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../012-libcephfs2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:48.548 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:48.654 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T22:46:48.668 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T22:46:48.729 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T22:46:48.825 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rados. 2024-09-15T22:46:48.841 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../013-python3-rados_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:48.884 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:48.974 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T22:46:48.988 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:49.040 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:49.376 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T22:46:49.388 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T22:46:49.426 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:46:49.528 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-15T22:46:49.543 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:46:49.578 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:49.789 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cephfs. 2024-09-15T22:46:49.804 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../015-python3-cephfs_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:49.847 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:49.904 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T22:46:49.918 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T22:46:49.978 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:46:50.166 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-15T22:46:50.181 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../016-python3-ceph-common_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:46:50.224 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:50.264 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T22:46:50.277 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T22:46:50.306 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:46:50.552 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-prettytable. 2024-09-15T22:46:50.568 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-09-15T22:46:50.610 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-15T22:46:50.618 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua5.1. 2024-09-15T22:46:50.630 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T22:46:50.668 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:46:50.888 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rbd. 2024-09-15T22:46:50.899 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../018-python3-rbd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:50.938 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:50.971 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-any. 2024-09-15T22:46:50.984 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T22:46:51.021 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T22:46:51.207 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-15T22:46:51.219 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-15T22:46:51.249 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:46:51.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package zip. 2024-09-15T22:46:51.285 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T22:46:51.315 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T22:46:51.526 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-15T22:46:51.538 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-15T22:46:51.576 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:46:51.602 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package unzip. 2024-09-15T22:46:51.614 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T22:46:51.651 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:46:51.879 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-15T22:46:51.890 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-15T22:46:51.929 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:46:52.038 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package luarocks. 2024-09-15T22:46:52.051 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T22:46:52.088 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:46:52.190 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua5.1. 2024-09-15T22:46:52.202 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-15T22:46:52.232 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:46:52.504 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package librgw2. 2024-09-15T22:46:52.516 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:52.551 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-any. 2024-09-15T22:46:52.554 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:52.563 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-09-15T22:46:52.601 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-15T22:46:52.829 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package zip. 2024-09-15T22:46:52.840 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-09-15T22:46:52.878 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking zip (3.0-12build2) ... 2024-09-15T22:46:53.015 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T22:46:53.027 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:53.056 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:53.173 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package unzip. 2024-09-15T22:46:53.185 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-15T22:46:53.223 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:46:53.385 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T22:46:53.397 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T22:46:53.434 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:46:53.610 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package luarocks. 2024-09-15T22:46:53.622 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-15T22:46:53.677 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:46:53.779 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T22:46:53.792 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:53.829 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:54.084 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package librgw2. 2024-09-15T22:46:54.096 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../027-librgw2_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:54.159 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:54.241 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-common. 2024-09-15T22:46:54.256 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:54.299 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:54.611 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rgw. 2024-09-15T22:46:54.626 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../028-python3-rgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:54.661 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:54.997 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-15T22:46:55.010 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-15T22:46:55.063 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:46:55.358 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libradosstriper1. 2024-09-15T22:46:55.371 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../030-libradosstriper1_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:55.408 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:55.429 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-base. 2024-09-15T22:46:55.446 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:55.497 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:55.795 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-common. 2024-09-15T22:46:55.807 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../031-ceph-common_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:55.836 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:56.075 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T22:46:56.089 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T22:46:56.134 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:46:56.436 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T22:46:56.450 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T22:46:56.495 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:46:56.797 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T22:46:56.812 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T22:46:56.856 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:46:56.874 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-base. 2024-09-15T22:46:56.887 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../032-ceph-base_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:46:56.934 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:46:57.159 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T22:46:57.173 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T22:46:57.239 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:46:57.479 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-15T22:46:57.490 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-15T22:46:57.511 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T22:46:57.526 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T22:46:57.528 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:46:57.570 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:46:57.814 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cheroot. 2024-09-15T22:46:57.827 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-15T22:46:57.864 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:46:57.872 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T22:46:57.887 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T22:46:57.931 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T22:46:58.208 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-15T22:46:58.221 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-15T22:46:58.225 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-portend. 2024-09-15T22:46:58.240 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T22:46:58.267 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:46:58.283 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T22:46:58.503 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-15T22:46:58.515 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-15T22:46:58.545 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:46:58.578 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T22:46:58.593 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T22:46:58.628 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T22:46:58.830 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-15T22:46:58.843 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-15T22:46:58.880 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:46:58.931 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T22:46:58.946 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T22:46:58.989 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:46:59.166 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempora. 2024-09-15T22:46:59.179 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-09-15T22:46:59.216 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-15T22:46:59.343 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T22:46:59.358 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T22:46:59.401 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T22:46:59.704 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-portend. 2024-09-15T22:46:59.717 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-09-15T22:46:59.729 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T22:46:59.747 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T22:46:59.754 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-15T22:46:59.787 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T22:47:00.057 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-15T22:47:00.070 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-15T22:47:00.107 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-15T22:47:00.256 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T22:47:00.271 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T22:47:00.315 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:47:00.453 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-15T22:47:00.465 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-15T22:47:00.502 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:47:00.576 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-mako. 2024-09-15T22:47:00.589 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T22:47:00.626 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:47:00.855 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-natsort. 2024-09-15T22:47:00.868 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-09-15T22:47:00.905 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-15T22:47:00.937 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T22:47:00.950 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T22:47:00.987 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:47:01.216 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-logutils. 2024-09-15T22:47:01.228 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-09-15T22:47:01.266 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-15T22:47:01.273 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T22:47:01.286 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T22:47:01.323 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:47:01.544 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-15T22:47:01.557 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-15T22:47:01.586 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:47:01.609 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webob. 2024-09-15T22:47:01.622 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T22:47:01.659 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:47:01.847 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-mako. 2024-09-15T22:47:01.857 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-15T22:47:01.897 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:47:01.996 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T22:47:02.008 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T22:47:02.049 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:47:02.258 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-15T22:47:02.269 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-15T22:47:02.308 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:47:02.373 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T22:47:02.386 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T22:47:02.423 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:47:02.595 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-15T22:47:02.605 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-15T22:47:02.644 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:47:02.709 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-paste. 2024-09-15T22:47:02.722 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T22:47:02.760 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:47:02.906 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webob. 2024-09-15T22:47:02.920 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-15T22:47:02.957 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:47:03.104 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T22:47:03.118 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T22:47:03.171 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:47:03.251 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-waitress. 2024-09-15T22:47:03.262 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-15T22:47:03.303 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:47:03.558 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T22:47:03.573 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T22:47:03.623 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:47:03.629 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-tempita. 2024-09-15T22:47:03.643 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-15T22:47:03.687 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:47:03.935 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T22:47:03.949 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T22:47:03.989 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-paste. 2024-09-15T22:47:03.993 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T22:47:04.002 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-15T22:47:04.039 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:47:04.351 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-15T22:47:04.354 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T22:47:04.363 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-15T22:47:04.369 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T22:47:04.401 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:47:04.421 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:47:04.687 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-15T22:47:04.700 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-15T22:47:04.737 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:47:04.851 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T22:47:04.865 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T22:47:04.917 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T22:47:05.056 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-webtest. 2024-09-15T22:47:05.072 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-09-15T22:47:05.108 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-15T22:47:05.295 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-idna. 2024-09-15T22:47:05.309 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T22:47:05.362 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:47:05.367 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pecan. 2024-09-15T22:47:05.381 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-15T22:47:05.417 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:47:05.756 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-certifi. 2024-09-15T22:47:05.764 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T22:47:05.771 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-09-15T22:47:05.779 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T22:47:05.814 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-15T22:47:05.831 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:47:06.142 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-idna. 2024-09-15T22:47:06.151 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests. 2024-09-15T22:47:06.155 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../057-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-15T22:47:06.165 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T22:47:06.200 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:47:06.209 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:47:06.521 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T22:47:06.535 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T22:47:06.536 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-urllib3. 2024-09-15T22:47:06.549 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-15T22:47:06.579 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:47:06.586 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:47:06.823 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T22:47:06.837 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:06.873 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests. 2024-09-15T22:47:06.881 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:06.887 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-15T22:47:06.931 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:47:07.192 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-15T22:47:07.206 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-15T22:47:07.242 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:47:07.278 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T22:47:07.291 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:07.336 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:07.504 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-15T22:47:07.518 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:07.562 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:07.606 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T22:47:07.620 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T22:47:07.664 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:47:07.950 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-15T22:47:07.964 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:07.968 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T22:47:07.981 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T22:47:08.008 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:08.025 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T22:47:08.294 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-15T22:47:08.308 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-15T22:47:08.353 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:47:08.403 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T22:47:08.417 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:08.461 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:08.647 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-openssl. 2024-09-15T22:47:08.661 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-09-15T22:47:08.706 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-15T22:47:08.814 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T22:47:08.829 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:08.864 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:09.042 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr. 2024-09-15T22:47:09.056 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../065-ceph-mgr_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:09.100 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:09.452 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T22:47:09.465 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:09.495 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mon. 2024-09-15T22:47:09.509 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:09.512 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../066-ceph-mon_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:09.562 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:10.057 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-osd. 2024-09-15T22:47:10.071 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../067-ceph-osd_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:10.115 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:11.146 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph. 2024-09-15T22:47:11.160 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:11.204 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:11.507 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T22:47:11.520 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph. 2024-09-15T22:47:11.541 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../068-ceph_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:11.565 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:11.584 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:11.887 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-fuse. 2024-09-15T22:47:11.902 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../069-ceph-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:11.910 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T22:47:11.923 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:11.945 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:11.960 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:12.257 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mds. 2024-09-15T22:47:12.272 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../070-ceph-mds_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:12.307 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:12.337 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephadm. 2024-09-15T22:47:12.351 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:12.396 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:12.702 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephadm. 2024-09-15T22:47:12.716 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T22:47:12.717 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../071-cephadm_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:12.729 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T22:47:12.760 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:12.773 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T22:47:13.080 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-15T22:47:13.093 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T22:47:13.094 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-15T22:47:13.107 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:47:13.138 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-15T22:47:13.151 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:13.449 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-15T22:47:13.464 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:47:13.507 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:14.089 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-babel. 2024-09-15T22:47:14.102 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:47:14.139 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:14.425 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T22:47:14.445 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T22:47:14.483 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:47:14.487 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-babel. 2024-09-15T22:47:14.501 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-15T22:47:14.545 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:14.828 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T22:47:14.841 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:14.878 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:15.065 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-jinja2. 2024-09-15T22:47:15.079 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-15T22:47:15.123 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:47:15.190 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T22:47:15.202 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T22:47:15.239 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T22:47:15.501 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-15T22:47:15.516 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:15.551 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-routes. 2024-09-15T22:47:15.551 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:15.563 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T22:47:15.601 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:47:15.888 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-15T22:47:15.903 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-09-15T22:47:15.946 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-15T22:47:15.962 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T22:47:15.975 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:16.012 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:16.266 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-routes. 2024-09-15T22:47:16.280 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-15T22:47:16.324 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:47:16.661 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-15T22:47:16.675 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:16.743 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:17.217 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T22:47:17.230 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T22:47:17.275 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:47:17.721 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T22:47:17.734 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T22:47:17.762 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:47:18.024 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-15T22:47:18.038 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-15T22:47:18.082 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:47:18.140 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T22:47:18.153 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T22:47:18.286 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:47:18.589 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T22:47:18.602 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T22:47:18.610 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-joblib. 2024-09-15T22:47:18.625 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-15T22:47:18.639 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:47:18.668 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:47:19.039 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-15T22:47:19.054 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-15T22:47:19.174 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:47:19.289 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T22:47:19.303 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:19.339 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:19.477 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-sklearn. 2024-09-15T22:47:19.492 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-15T22:47:19.560 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:47:20.236 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-15T22:47:20.260 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:20.276 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T22:47:20.295 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T22:47:20.297 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:20.535 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T22:47:20.838 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T22:47:20.852 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T22:47:20.895 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:47:21.233 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T22:47:21.239 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-cachetools. 2024-09-15T22:47:21.247 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T22:47:21.255 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-09-15T22:47:21.290 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:47:21.297 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-15T22:47:21.551 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-15T22:47:21.565 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-15T22:47:21.585 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T22:47:21.599 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T22:47:21.600 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:47:21.643 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T22:47:21.904 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-15T22:47:21.919 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-15T22:47:21.970 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:47:21.989 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T22:47:22.003 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T22:47:22.047 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T22:47:22.273 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-rsa. 2024-09-15T22:47:22.288 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-09-15T22:47:22.331 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-15T22:47:22.333 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T22:47:22.348 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T22:47:22.383 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:47:22.677 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-google-auth. 2024-09-15T22:47:22.693 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-09-15T22:47:22.695 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T22:47:22.709 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T22:47:22.735 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-15T22:47:22.753 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T22:47:23.055 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-15T22:47:23.071 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-15T22:47:23.107 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T22:47:23.113 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:47:23.121 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T22:47:23.164 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:47:23.425 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-websocket. 2024-09-15T22:47:23.440 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-09-15T22:47:23.482 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-15T22:47:23.803 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-15T22:47:23.818 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-15T22:47:23.820 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T22:47:23.833 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:23.860 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:47:23.878 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:24.214 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T22:47:24.228 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T22:47:24.273 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:47:24.500 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-15T22:47:24.514 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:24.550 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:24.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T22:47:24.631 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:47:24.676 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:47:24.852 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-15T22:47:24.866 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-15T22:47:24.910 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:47:24.945 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package jq. 2024-09-15T22:47:24.959 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:47:25.003 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T22:47:25.264 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package socat. 2024-09-15T22:47:25.278 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T22:47:25.280 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-15T22:47:25.296 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:47:25.322 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:47:25.339 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:47:25.651 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T22:47:25.665 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T22:47:25.709 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:47:25.816 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package jq. 2024-09-15T22:47:25.832 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-15T22:47:25.883 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-15T22:47:26.080 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-test. 2024-09-15T22:47:26.095 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:26.136 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package socat. 2024-09-15T22:47:26.147 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:26.151 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-15T22:47:26.194 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:47:26.497 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package xmlstarlet. 2024-09-15T22:47:26.513 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-15T22:47:26.547 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:47:26.910 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-test. 2024-09-15T22:47:26.925 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../099-ceph-test_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:26.968 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:28.218 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T22:47:28.232 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:28.284 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:28.714 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T22:47:28.728 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:28.780 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:28.839 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ceph-volume. 2024-09-15T22:47:28.855 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../100-ceph-volume_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:28.889 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:29.158 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T22:47:29.172 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T22:47:29.225 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T22:47:29.326 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-mirror. 2024-09-15T22:47:29.342 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../101-cephfs-mirror_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:29.393 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:29.544 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T22:47:29.558 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:29.610 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:29.746 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-colorama. 2024-09-15T22:47:29.761 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-09-15T22:47:29.804 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-09-15T22:47:29.905 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T22:47:29.919 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:29.963 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:30.107 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-shell. 2024-09-15T22:47:30.122 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../103-cephfs-shell_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:30.173 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:30.232 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T22:47:30.247 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:30.299 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:30.484 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package cephfs-top. 2024-09-15T22:47:30.500 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../104-cephfs-top_19.1.1-326-g8921c8ef-1jammy_all.deb ... 2024-09-15T22:47:30.551 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:30.718 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T22:47:30.733 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T22:47:30.785 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:47:30.837 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-15T22:47:30.853 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../105-libcephfs-dev_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:30.928 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:31.131 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T22:47:31.146 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T22:47:31.189 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:47:31.223 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-15T22:47:31.238 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-15T22:47:31.281 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:47:31.527 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T22:47:31.541 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T22:47:31.643 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:47:31.711 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-15T22:47:31.726 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-09-15T22:47:31.777 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:47:32.082 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pkg-config. 2024-09-15T22:47:32.096 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T22:47:32.140 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:47:32.173 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package nvme-cli. 2024-09-15T22:47:32.188 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.3_amd64.deb ... 2024-09-15T22:47:32.231 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:47:32.401 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T22:47:32.416 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T22:47:32.459 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:47:32.678 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pkg-config. 2024-09-15T22:47:32.693 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-15T22:47:32.736 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:47:32.863 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T22:47:32.877 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T22:47:32.921 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T22:47:32.998 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-15T22:47:33.013 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-15T22:47:33.056 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:47:33.249 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T22:47:33.263 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T22:47:33.310 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T22:47:33.492 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-15T22:47:33.507 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-15T22:47:33.550 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-15T22:47:33.644 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T22:47:33.658 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T22:47:33.702 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:47:33.845 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pastescript. 2024-09-15T22:47:33.859 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-09-15T22:47:33.894 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-15T22:47:33.997 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T22:47:34.011 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T22:47:34.055 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T22:47:34.240 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pluggy. 2024-09-15T22:47:34.255 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-15T22:47:34.298 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:47:34.366 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-py. 2024-09-15T22:47:34.381 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T22:47:34.416 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T22:47:34.609 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-psutil. 2024-09-15T22:47:34.624 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-15T22:47:34.667 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-15T22:47:34.744 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T22:47:34.758 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T22:47:34.803 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:47:35.012 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-py. 2024-09-15T22:47:35.027 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-09-15T22:47:35.070 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-15T22:47:35.248 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T22:47:35.261 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T22:47:35.306 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:47:35.424 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pygments. 2024-09-15T22:47:35.439 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-15T22:47:35.482 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:47:35.601 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-toml. 2024-09-15T22:47:35.614 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T22:47:35.892 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T22:47:35.944 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-15T22:47:35.959 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-15T22:47:35.994 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:47:36.153 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T22:47:36.168 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T22:47:36.203 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:47:36.255 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-toml. 2024-09-15T22:47:36.270 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-09-15T22:47:36.313 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-15T22:47:36.540 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T22:47:36.555 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T22:47:36.598 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:47:36.641 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-pytest. 2024-09-15T22:47:36.657 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-15T22:47:36.699 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:47:36.885 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T22:47:36.899 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T22:47:36.943 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:47:36.995 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package python3-simplejson. 2024-09-15T22:47:37.010 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-15T22:47:37.044 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:47:37.297 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-15T22:47:37.313 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-15T22:47:37.355 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:47:37.589 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package radosgw. 2024-09-15T22:47:37.602 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:37.647 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:38.135 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package radosgw. 2024-09-15T22:47:38.149 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../122-radosgw_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:38.201 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:38.275 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T22:47:38.289 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:38.333 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:38.609 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T22:47:38.796 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package rbd-fuse. 2024-09-15T22:47:38.811 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../123-rbd-fuse_19.1.1-326-g8921c8ef-1jammy_amd64.deb ... 2024-09-15T22:47:38.854 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:38.880 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:47:38.998 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:47:39.134 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-15T22:47:39.247 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T22:47:39.428 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-15T22:47:39.554 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up nvme-cli (1.16-3ubuntu0.3) ... 2024-09-15T22:47:39.653 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T22:47:39.829 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-15T22:47:40.213 INFO:teuthology.orchestra.run.smithi102.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T22:47:40.227 INFO:teuthology.orchestra.run.smithi102.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-15T22:47:40.245 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-15T22:47:40.274 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:40.819 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user cephadm....done 2024-09-15T22:47:40.852 INFO:teuthology.orchestra.run.smithi031.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-15T22:47:40.910 INFO:teuthology.orchestra.run.smithi031.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-09-15T22:47:40.955 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:40.973 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:47:41.249 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:47:41.500 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:47:41.626 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:47:41.799 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user cephadm....done 2024-09-15T22:47:41.919 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T22:47:42.003 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-15T22:47:42.195 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:47:42.296 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-15T22:47:42.330 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T22:47:42.564 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-15T22:47:42.648 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:47:42.706 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-15T22:47:42.999 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-15T22:47:43.017 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T22:47:43.276 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T22:47:43.284 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-15T22:47:43.409 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-15T22:47:43.544 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T22:47:43.736 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-15T22:47:43.829 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:47:44.080 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:47:44.130 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-15T22:47:44.415 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-09-15T22:47:44.448 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:47:44.699 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-15T22:47:44.700 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:47:44.959 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:45.009 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-15T22:47:45.247 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:47:45.312 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-15T22:47:45.406 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:47:45.521 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T22:47:45.598 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-15T22:47:45.796 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:47:45.864 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-15T22:47:45.906 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:47:46.155 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-argparse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:46.174 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:47:46.440 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-15T22:47:46.590 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-15T22:47:46.593 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T22:47:46.637 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T22:47:46.702 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:47:46.742 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-09-15T22:47:46.827 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T22:47:47.034 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-15T22:47:47.160 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-15T22:47:47.196 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:47.322 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T22:47:47.436 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-15T22:47:47.590 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:47:47.857 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:47:47.858 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-15T22:47:47.917 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-15T22:47:47.990 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-15T22:47:48.141 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-15T22:47:48.175 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T22:47:48.276 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:47:48.542 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:48.668 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-15T22:47:48.945 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-15T22:47:48.953 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:47:49.253 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-15T22:47:49.262 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:47:49.389 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:47:49.514 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:47:49.687 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up zip (3.0-12build2) ... 2024-09-15T22:47:49.814 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-15T22:47:49.824 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T22:47:50.234 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T22:47:50.476 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:47:50.532 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-15T22:47:50.800 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-15T22:47:50.861 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:47:50.926 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-15T22:47:51.060 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-15T22:47:51.296 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T22:47:51.403 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-15T22:47:51.614 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:47:51.812 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-15T22:47:51.973 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:47:52.096 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-15T22:47:52.241 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:47:52.367 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:52.490 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-15T22:47:52.694 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:47:52.791 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-09-15T22:47:53.036 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:47:53.142 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-15T22:47:53.535 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-15T22:47:53.811 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-15T22:47:53.945 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:47:54.250 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:47:54.263 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-15T22:47:54.502 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:47:54.631 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-15T22:47:54.636 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T22:47:54.904 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:47:55.030 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:47:55.181 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:47:55.483 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:47:55.751 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T22:47:55.928 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-15T22:47:56.002 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:47:56.128 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:47:56.188 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:47:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:47:56.556 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-15T22:47:56.714 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T22:47:56.824 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-15T22:47:56.941 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-15T22:47:56.982 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T22:47:57.067 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-15T22:47:57.233 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:47:57.402 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-15T22:47:57.492 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T22:47:57.711 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-15T22:47:57.776 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:47:57.902 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T22:47:57.979 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:47:58.105 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-15T22:47:58.187 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:47:58.321 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:47:58.432 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-15T22:47:58.622 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:47:58.716 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-15T22:47:58.932 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:47:59.017 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-15T22:47:59.191 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:47:59.309 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:47:59.334 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-15T22:47:59.410 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:47:59.498 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T22:47:59.619 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-15T22:47:59.736 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:47:59.871 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:47:59.920 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-15T22:48:00.062 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-15T22:48:00.281 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:48:00.364 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-15T22:48:00.507 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-15T22:48:00.557 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T22:48:00.674 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T22:48:00.849 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-15T22:48:00.934 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:48:01.043 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:48:01.176 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-15T22:48:01.369 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:48:01.452 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-15T22:48:01.578 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-15T22:48:01.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:48:01.703 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-15T22:48:01.792 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-15T22:48:01.972 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T22:48:02.047 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-15T22:48:02.148 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-15T22:48:02.167 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T22:48:02.435 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T22:48:02.541 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-15T22:48:02.711 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:48:02.825 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-15T22:48:02.976 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-15T22:48:02.987 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:48:03.269 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-15T22:48:03.375 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T22:48:03.445 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-15T22:48:03.668 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:48:03.780 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-15T22:48:04.012 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:48:04.106 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-15T22:48:04.138 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:04.264 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:04.391 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:48:04.407 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-15T22:48:04.610 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-15T22:48:04.718 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:04.852 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:04.894 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-15T22:48:04.970 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T22:48:05.187 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-15T22:48:05.263 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:05.364 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:05.463 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-15T22:48:05.474 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:05.685 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:48:05.685 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:48:05.848 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-15T22:48:06.150 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-15T22:48:06.367 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.493 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.535 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-15T22:48:06.619 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.661 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librados2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.746 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.804 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libsqlite3-mod-ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:06.871 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:48:06.930 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-15T22:48:07.225 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:07.351 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libradosstriper1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:07.477 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-15T22:48:07.786 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librbd1 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:07.912 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-modules-core (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.038 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.147 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.253 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:48:08.253 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-15T22:48:08.265 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.382 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.525 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.651 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.777 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:08.982 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libcephfs-dev (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:09.321 INFO:teuthology.orchestra.run.smithi102.stdout:Adding group ceph....done 2024-09-15T22:48:09.484 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rados (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:09.601 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up librgw2 (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:09.702 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-top (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:09.723 INFO:teuthology.orchestra.run.smithi102.stdout:Adding system user ceph....done 2024-09-15T22:48:09.820 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-15T22:48:09.850 INFO:teuthology.orchestra.run.smithi102.stdout:Setting system user ceph properties....done 2024-09-15T22:48:09.869 INFO:teuthology.orchestra.run.smithi102.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T22:48:10.009 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T22:48:10.387 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T22:48:11.061 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.174 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rbd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.256 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:48:11.256 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:48:11.299 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up rbd-fuse (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.425 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-rgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.526 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up python3-cephfs (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.627 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-shell (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.879 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:11.989 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:12.167 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-common (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:12.548 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:48:12.549 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:48:12.653 INFO:teuthology.orchestra.run.smithi031.stdout:Adding group ceph....done 2024-09-15T22:48:12.954 INFO:teuthology.orchestra.run.smithi031.stdout:Adding system user ceph....done 2024-09-15T22:48:13.123 INFO:teuthology.orchestra.run.smithi031.stdout:Setting system user ceph properties....done 2024-09-15T22:48:13.132 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:13.146 INFO:teuthology.orchestra.run.smithi031.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-15T22:48:13.299 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-15T22:48:13.493 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T22:48:13.704 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-15T22:48:14.159 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:14.376 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up cephfs-mirror (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:14.399 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:48:14.399 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:48:14.593 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:48:14.593 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-09-15T22:48:15.036 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:15.185 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-test (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:15.249 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:48:15.249 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:48:15.286 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up radosgw (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:15.817 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:48:15.817 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-15T22:48:15.871 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:16.157 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:48:16.158 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:48:16.455 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-base (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:16.786 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-15T22:48:17.219 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:17.362 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:17.458 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mds (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:17.513 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:17.697 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:48:17.697 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-15T22:48:17.711 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:48:17.711 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:48:18.302 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:18.339 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:18.499 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:48:18.521 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-15T22:48:18.625 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:18.767 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:19.128 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:48:19.186 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-osd (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:19.237 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:48:19.381 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:48:19.491 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:48:19.491 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-15T22:48:20.121 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-k8sevents (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:20.181 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:48:20.222 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-diskprediction-local (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:20.340 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mon (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:20.578 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:48:20.579 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-15T22:48:20.874 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:48:20.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T22:48:20.954 INFO:teuthology.orchestra.run.smithi102.stdout:Reading package lists... 2024-09-15T22:48:21.146 INFO:teuthology.orchestra.run.smithi102.stdout:Building dependency tree... 2024-09-15T22:48:21.146 INFO:teuthology.orchestra.run.smithi102.stdout:Reading state information... 2024-09-15T22:48:21.208 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-cephadm (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:21.341 INFO:teuthology.orchestra.run.smithi102.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:48:21.342 INFO:teuthology.orchestra.run.smithi102.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:48:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:48:21.343 INFO:teuthology.orchestra.run.smithi102.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:48:21.343 INFO:teuthology.orchestra.run.smithi102.stdout:The following additional packages will be installed: 2024-09-15T22:48:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T22:48:21.343 INFO:teuthology.orchestra.run.smithi102.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T22:48:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T22:48:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T22:48:21.344 INFO:teuthology.orchestra.run.smithi102.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:48:21.345 INFO:teuthology.orchestra.run.smithi102.stdout:Suggested packages: 2024-09-15T22:48:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T22:48:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T22:48:21.345 INFO:teuthology.orchestra.run.smithi102.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T22:48:21.350 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:21.402 INFO:teuthology.orchestra.run.smithi102.stdout:The following NEW packages will be installed: 2024-09-15T22:48:21.402 INFO:teuthology.orchestra.run.smithi102.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T22:48:21.402 INFO:teuthology.orchestra.run.smithi102.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T22:48:21.403 INFO:teuthology.orchestra.run.smithi102.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T22:48:21.403 INFO:teuthology.orchestra.run.smithi102.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T22:48:21.403 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T22:48:21.403 INFO:teuthology.orchestra.run.smithi102.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T22:48:21.403 INFO:teuthology.orchestra.run.smithi102.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:48:21.404 INFO:teuthology.orchestra.run.smithi102.stdout:The following packages will be upgraded: 2024-09-15T22:48:21.405 INFO:teuthology.orchestra.run.smithi102.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T22:48:21.461 INFO:teuthology.orchestra.run.smithi102.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-15T22:48:21.461 INFO:teuthology.orchestra.run.smithi102.stdout:Need to get 55.8 MB of archives. 2024-09-15T22:48:21.462 INFO:teuthology.orchestra.run.smithi102.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T22:48:21.462 INFO:teuthology.orchestra.run.smithi102.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T22:48:21.476 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-mgr-dashboard (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:21.592 INFO:teuthology.orchestra.run.smithi102.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T22:48:21.596 INFO:teuthology.orchestra.run.smithi102.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T22:48:21.623 INFO:teuthology.orchestra.run.smithi102.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T22:48:21.623 INFO:teuthology.orchestra.run.smithi102.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T22:48:21.624 INFO:teuthology.orchestra.run.smithi102.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T22:48:21.627 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ceph-volume (19.1.1-326-g8921c8ef-1jammy) ... 2024-09-15T22:48:21.631 INFO:teuthology.orchestra.run.smithi102.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T22:48:21.632 INFO:teuthology.orchestra.run.smithi102.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T22:48:21.633 INFO:teuthology.orchestra.run.smithi102.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T22:48:21.634 INFO:teuthology.orchestra.run.smithi102.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T22:48:21.635 INFO:teuthology.orchestra.run.smithi102.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T22:48:21.636 INFO:teuthology.orchestra.run.smithi102.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T22:48:21.644 INFO:teuthology.orchestra.run.smithi102.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T22:48:21.645 INFO:teuthology.orchestra.run.smithi102.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T22:48:21.645 INFO:teuthology.orchestra.run.smithi102.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T22:48:21.661 INFO:teuthology.orchestra.run.smithi102.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T22:48:21.872 INFO:teuthology.orchestra.run.smithi102.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T22:48:21.874 INFO:teuthology.orchestra.run.smithi102.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T22:48:21.874 INFO:teuthology.orchestra.run.smithi102.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T22:48:21.876 INFO:teuthology.orchestra.run.smithi102.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T22:48:21.877 INFO:teuthology.orchestra.run.smithi102.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T22:48:21.881 INFO:teuthology.orchestra.run.smithi102.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T22:48:21.883 INFO:teuthology.orchestra.run.smithi102.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T22:48:21.891 INFO:teuthology.orchestra.run.smithi102.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T22:48:21.891 INFO:teuthology.orchestra.run.smithi102.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T22:48:21.911 INFO:teuthology.orchestra.run.smithi102.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T22:48:21.911 INFO:teuthology.orchestra.run.smithi102.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T22:48:21.921 INFO:teuthology.orchestra.run.smithi102.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T22:48:21.941 INFO:teuthology.orchestra.run.smithi102.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T22:48:21.944 INFO:teuthology.orchestra.run.smithi102.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T22:48:21.945 INFO:teuthology.orchestra.run.smithi102.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T22:48:21.945 INFO:teuthology.orchestra.run.smithi102.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T22:48:21.946 INFO:teuthology.orchestra.run.smithi102.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T22:48:21.958 INFO:teuthology.orchestra.run.smithi102.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T22:48:21.960 INFO:teuthology.orchestra.run.smithi102.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T22:48:22.005 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:48:22.114 INFO:teuthology.orchestra.run.smithi102.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T22:48:22.114 INFO:teuthology.orchestra.run.smithi102.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T22:48:22.114 INFO:teuthology.orchestra.run.smithi102.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T22:48:22.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T22:48:22.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T22:48:22.115 INFO:teuthology.orchestra.run.smithi102.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T22:48:22.116 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:48:22.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T22:48:22.127 INFO:teuthology.orchestra.run.smithi102.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T22:48:22.249 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:48:22.508 INFO:teuthology.orchestra.run.smithi102.stdout:Preconfiguring packages ... 2024-09-15T22:48:22.656 INFO:teuthology.orchestra.run.smithi102.stdout:Fetched 55.8 MB in 1s (78.1 MB/s) 2024-09-15T22:48:22.940 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-15T22:48:22.943 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:23.088 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:23.583 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:48:23.679 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:24.270 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:48:24.274 DEBUG:teuthology.orchestra.run.smithi031:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-09-15T22:48:24.353 INFO:teuthology.orchestra.run.smithi031.stdout:Reading package lists... 2024-09-15T22:48:24.549 INFO:teuthology.orchestra.run.smithi031.stdout:Building dependency tree... 2024-09-15T22:48:24.550 INFO:teuthology.orchestra.run.smithi031.stdout:Reading state information... 2024-09-15T22:48:24.751 INFO:teuthology.orchestra.run.smithi031.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages were automatically installed and are no longer required: 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-15T22:48:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-15T22:48:24.753 INFO:teuthology.orchestra.run.smithi031.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-15T22:48:24.753 INFO:teuthology.orchestra.run.smithi031.stdout:The following additional packages will be installed: 2024-09-15T22:48:24.754 INFO:teuthology.orchestra.run.smithi031.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-09-15T22:48:24.754 INFO:teuthology.orchestra.run.smithi031.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-09-15T22:48:24.754 INFO:teuthology.orchestra.run.smithi031.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-09-15T22:48:24.754 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-09-15T22:48:24.754 INFO:teuthology.orchestra.run.smithi031.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:48:24.756 INFO:teuthology.orchestra.run.smithi031.stdout:Suggested packages: 2024-09-15T22:48:24.756 INFO:teuthology.orchestra.run.smithi031.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-09-15T22:48:24.756 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-09-15T22:48:24.756 INFO:teuthology.orchestra.run.smithi031.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-09-15T22:48:24.769 INFO:teuthology.orchestra.run.smithi102.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T22:48:24.814 INFO:teuthology.orchestra.run.smithi031.stdout:The following NEW packages will be installed: 2024-09-15T22:48:24.815 INFO:teuthology.orchestra.run.smithi031.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-09-15T22:48:24.815 INFO:teuthology.orchestra.run.smithi031.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-09-15T22:48:24.816 INFO:teuthology.orchestra.run.smithi031.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-09-15T22:48:24.816 INFO:teuthology.orchestra.run.smithi031.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-09-15T22:48:24.816 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-09-15T22:48:24.816 INFO:teuthology.orchestra.run.smithi031.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-09-15T22:48:24.816 INFO:teuthology.orchestra.run.smithi031.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-09-15T22:48:24.817 INFO:teuthology.orchestra.run.smithi031.stdout:The following packages will be upgraded: 2024-09-15T22:48:24.818 INFO:teuthology.orchestra.run.smithi031.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-09-15T22:48:24.874 INFO:teuthology.orchestra.run.smithi031.stdout:4 upgraded, 39 newly installed, 0 to remove and 330 not upgraded. 2024-09-15T22:48:24.875 INFO:teuthology.orchestra.run.smithi031.stdout:Need to get 55.8 MB of archives. 2024-09-15T22:48:24.875 INFO:teuthology.orchestra.run.smithi031.stdout:After this operation, 203 MB of additional disk space will be used. 2024-09-15T22:48:24.875 INFO:teuthology.orchestra.run.smithi031.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-09-15T22:48:25.007 INFO:teuthology.orchestra.run.smithi031.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-09-15T22:48:25.010 INFO:teuthology.orchestra.run.smithi031.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.18 [1,905 kB] 2024-09-15T22:48:25.026 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package flex. 2024-09-15T22:48:25.037 INFO:teuthology.orchestra.run.smithi031.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-09-15T22:48:25.038 INFO:teuthology.orchestra.run.smithi031.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-09-15T22:48:25.039 INFO:teuthology.orchestra.run.smithi031.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-09-15T22:48:25.046 INFO:teuthology.orchestra.run.smithi031.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-09-15T22:48:25.047 INFO:teuthology.orchestra.run.smithi031.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-09-15T22:48:25.048 INFO:teuthology.orchestra.run.smithi031.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-09-15T22:48:25.049 INFO:teuthology.orchestra.run.smithi031.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-09-15T22:48:25.050 INFO:teuthology.orchestra.run.smithi031.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.3 [86.9 kB] 2024-09-15T22:48:25.051 INFO:teuthology.orchestra.run.smithi031.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-09-15T22:48:25.059 INFO:teuthology.orchestra.run.smithi031.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-09-15T22:48:25.059 INFO:teuthology.orchestra.run.smithi031.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-09-15T22:48:25.059 INFO:teuthology.orchestra.run.smithi031.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-09-15T22:48:25.076 INFO:teuthology.orchestra.run.smithi031.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-09-15T22:48:25.096 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-15T22:48:25.099 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:25.133 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T22:48:25.290 INFO:teuthology.orchestra.run.smithi031.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-09-15T22:48:25.291 INFO:teuthology.orchestra.run.smithi031.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-09-15T22:48:25.292 INFO:teuthology.orchestra.run.smithi031.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-09-15T22:48:25.294 INFO:teuthology.orchestra.run.smithi031.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libndp0 amd64 1.8-0ubuntu3.1 [12.4 kB] 2024-09-15T22:48:25.295 INFO:teuthology.orchestra.run.smithi031.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-09-15T22:48:25.299 INFO:teuthology.orchestra.run.smithi031.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.13-0ubuntu0.22.04.1 [149 kB] 2024-09-15T22:48:25.301 INFO:teuthology.orchestra.run.smithi031.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-09-15T22:48:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-09-15T22:48:25.308 INFO:teuthology.orchestra.run.smithi031.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.18 [2,375 kB] 2024-09-15T22:48:25.330 INFO:teuthology.orchestra.run.smithi031.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-09-15T22:48:25.330 INFO:teuthology.orchestra.run.smithi031.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-09-15T22:48:25.340 INFO:teuthology.orchestra.run.smithi031.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-09-15T22:48:25.360 INFO:teuthology.orchestra.run.smithi031.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-09-15T22:48:25.364 INFO:teuthology.orchestra.run.smithi031.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-09-15T22:48:25.364 INFO:teuthology.orchestra.run.smithi031.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-09-15T22:48:25.365 INFO:teuthology.orchestra.run.smithi031.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-09-15T22:48:25.365 INFO:teuthology.orchestra.run.smithi031.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.13-0ubuntu0.22.04.1 [1,225 kB] 2024-09-15T22:48:25.377 INFO:teuthology.orchestra.run.smithi031.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-09-15T22:48:25.379 INFO:teuthology.orchestra.run.smithi031.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.13-0ubuntu0.22.04.1 [16.2 MB] 2024-09-15T22:48:25.524 INFO:teuthology.orchestra.run.smithi031.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-09-15T22:48:25.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-09-15T22:48:25.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-09-15T22:48:25.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-09-15T22:48:25.525 INFO:teuthology.orchestra.run.smithi031.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-09-15T22:48:25.526 INFO:teuthology.orchestra.run.smithi031.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2.1 [1,482 kB] 2024-09-15T22:48:25.538 INFO:teuthology.orchestra.run.smithi031.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-09-15T22:48:25.539 INFO:teuthology.orchestra.run.smithi031.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-09-15T22:48:25.594 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:48:25.789 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T22:48:25.942 INFO:teuthology.orchestra.run.smithi031.stdout:Preconfiguring packages ... 2024-09-15T22:48:26.119 INFO:teuthology.orchestra.run.smithi031.stdout:Fetched 55.8 MB in 1s (78.3 MB/s) 2024-09-15T22:48:26.178 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:26.437 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-15T22:48:26.441 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:26.581 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:26.700 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-15T22:48:26.705 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:26.822 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:27.190 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:27.251 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:27.387 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:27.677 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:28.071 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package bison. 2024-09-15T22:48:28.144 INFO:teuthology.orchestra.run.smithi102.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-15T22:48:28.147 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T22:48:28.199 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:48:28.305 INFO:teuthology.orchestra.run.smithi031.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-09-15T22:48:28.568 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package flex. 2024-09-15T22:48:28.616 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T22:48:28.630 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T22:48:28.640 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140925 files and directories currently installed.) 2024-09-15T22:48:28.644 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:28.674 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:48:28.683 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking flex (2.6.4-8build2) ... 2024-09-15T22:48:28.977 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package dump. 2024-09-15T22:48:28.992 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T22:48:29.027 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T22:48:29.220 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:48:29.306 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package indent. 2024-09-15T22:48:29.320 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:29.389 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.18) over (3.0.2-0ubuntu1.7) ... 2024-09-15T22:48:29.398 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:48:29.693 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T22:48:29.708 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T22:48:29.751 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:48:29.780 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:30.063 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T22:48:30.079 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T22:48:30.113 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:48:30.325 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-15T22:48:30.329 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:30.341 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T22:48:30.356 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T22:48:30.399 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:48:30.463 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:30.769 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T22:48:30.785 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:30.809 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-09-15T22:48:30.828 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:30.911 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-09-15T22:48:31.080 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T22:48:31.096 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:31.138 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:31.236 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:31.358 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T22:48:31.373 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T22:48:31.416 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T22:48:31.569 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package bison. 2024-09-15T22:48:31.646 INFO:teuthology.orchestra.run.smithi031.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140998 files and directories currently installed.) 2024-09-15T22:48:31.650 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-09-15T22:48:31.703 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T22:48:31.718 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T22:48:31.722 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:48:31.761 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:48:32.133 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-09-15T22:48:32.149 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-09-15T22:48:32.191 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:48:32.452 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package dump. 2024-09-15T22:48:32.469 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-09-15T22:48:32.502 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking dump (0.4b47-3) ... 2024-09-15T22:48:32.797 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package indent. 2024-09-15T22:48:32.814 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:32.847 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:48:33.122 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-09-15T22:48:33.131 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T22:48:33.138 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-09-15T22:48:33.146 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:48:33.183 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:48:33.189 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:33.450 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T22:48:33.466 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:48:33.504 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-09-15T22:48:33.508 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:33.520 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.3_amd64.deb ... 2024-09-15T22:48:33.554 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:48:33.786 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T22:48:33.802 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:48:33.806 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-09-15T22:48:33.823 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-09-15T22:48:33.845 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:33.865 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:48:34.189 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T22:48:34.201 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl2:amd64. 2024-09-15T22:48:34.204 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T22:48:34.218 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:34.260 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:34.264 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:48:34.504 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-09-15T22:48:34.520 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-09-15T22:48:34.570 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:34.601 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T22:48:34.616 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:48:34.659 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:48:34.790 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libjson-perl. 2024-09-15T22:48:34.806 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-09-15T22:48:34.848 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-09-15T22:48:34.987 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T22:48:35.002 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:35.045 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:35.151 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libllvm14:amd64. 2024-09-15T22:48:35.168 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-09-15T22:48:35.209 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:48:35.357 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T22:48:35.372 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:35.438 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:48:35.726 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T22:48:35.741 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:35.784 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:48:36.012 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T22:48:36.027 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:48:36.061 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:36.515 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T22:48:36.521 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-09-15T22:48:36.531 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T22:48:36.537 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:48:36.565 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:48:36.579 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:36.823 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmbim-proxy. 2024-09-15T22:48:36.839 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-09-15T22:48:36.881 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:36.944 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package modemmanager. 2024-09-15T22:48:36.960 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:48:37.002 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:37.176 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-09-15T22:48:37.192 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:48:37.226 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:37.612 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libndp0:amd64. 2024-09-15T22:48:37.617 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager. 2024-09-15T22:48:37.628 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3.1_amd64.deb ... 2024-09-15T22:48:37.632 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:48:37.670 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:48:37.683 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:48:37.998 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libnm0:amd64. 2024-09-15T22:48:38.015 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:48:38.056 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:48:38.291 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package ppp. 2024-09-15T22:48:38.306 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T22:48:38.359 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libpq5:amd64. 2024-09-15T22:48:38.376 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../16-libpq5_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:38.409 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:38.638 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:48:38.745 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-09-15T22:48:38.762 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:38.803 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:48:38.954 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T22:48:38.969 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T22:48:39.013 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T22:48:39.123 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libqmi-proxy. 2024-09-15T22:48:39.140 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:39.185 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:48:39.282 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T22:48:39.297 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T22:48:39.331 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T22:48:39.434 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-09-15T22:48:39.450 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.18_amd64.deb ... 2024-09-15T22:48:39.483 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:39.618 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T22:48:39.633 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T22:48:39.677 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T22:48:39.970 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-09-15T22:48:39.980 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T22:48:39.986 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-09-15T22:48:39.995 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:40.029 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:48:40.038 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:40.382 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package modemmanager. 2024-09-15T22:48:40.398 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-09-15T22:48:40.456 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:40.577 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T22:48:40.592 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T22:48:40.644 INFO:teuthology.orchestra.run.smithi102.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T22:48:40.675 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-common (238) ... 2024-09-15T22:48:41.054 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager. 2024-09-15T22:48:41.071 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-09-15T22:48:41.121 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:48:41.142 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T22:48:41.157 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:41.203 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:41.745 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package ppp. 2024-09-15T22:48:41.920 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-09-15T22:48:42.164 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:48:42.371 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql. 2024-09-15T22:48:42.386 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T22:48:42.429 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql (14+238) ... 2024-09-15T22:48:42.491 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package pptp-linux. 2024-09-15T22:48:42.507 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-09-15T22:48:42.550 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-09-15T22:48:42.673 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T22:48:42.687 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T22:48:42.756 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T22:48:42.777 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package network-manager-pptp. 2024-09-15T22:48:42.793 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-09-15T22:48:42.835 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-09-15T22:48:42.983 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T22:48:42.998 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T22:48:43.041 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T22:48:43.122 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-common. 2024-09-15T22:48:43.137 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-09-15T22:48:43.180 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-common (238) ... 2024-09-15T22:48:43.346 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T22:48:43.361 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T22:48:43.404 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:48:43.517 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client-14. 2024-09-15T22:48:43.533 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../27-postgresql-client-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:43.575 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:43.690 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package tcl. 2024-09-15T22:48:43.706 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T22:48:43.753 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T22:48:44.127 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T22:48:44.142 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T22:48:44.184 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:48:44.506 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T22:48:44.523 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T22:48:44.564 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T22:48:44.573 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-common. 2024-09-15T22:48:44.589 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-09-15T22:48:44.675 INFO:teuthology.orchestra.run.smithi031.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-09-15T22:48:44.704 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-common (238) ... 2024-09-15T22:48:44.942 INFO:teuthology.orchestra.run.smithi102.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T22:48:44.961 INFO:teuthology.orchestra.run.smithi102.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T22:48:45.009 INFO:teuthology.orchestra.run.smithi102.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:48:45.171 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-14. 2024-09-15T22:48:45.187 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../29-postgresql-14_14.13-0ubuntu0.22.04.1_amd64.deb ... 2024-09-15T22:48:45.232 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:45.318 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T22:48:45.506 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T22:48:45.624 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:48:45.750 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:45.901 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:48:46.027 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:48:46.153 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:46.364 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql. 2024-09-15T22:48:46.380 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-09-15T22:48:46.431 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql (14+238) ... 2024-09-15T22:48:46.733 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-client. 2024-09-15T22:48:46.749 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-09-15T22:48:46.800 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-client (14+238) ... 2024-09-15T22:48:47.094 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package postgresql-contrib. 2024-09-15T22:48:47.111 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-09-15T22:48:47.114 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T22:48:47.160 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking postgresql-contrib (14+238) ... 2024-09-15T22:48:47.209 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:48:47.546 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl8.6. 2024-09-15T22:48:47.563 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-09-15T22:48:47.589 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:48:47.589 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:48:47.605 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:48:47.923 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package tcl. 2024-09-15T22:48:47.940 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-09-15T22:48:47.995 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-09-15T22:48:48.311 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:48.435 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package wpasupplicant. 2024-09-15T22:48:48.446 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:48:48.452 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2.1_amd64.deb ... 2024-09-15T22:48:48.501 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:48:48.572 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:48.864 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-09-15T22:48:48.881 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-09-15T22:48:48.914 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-09-15T22:48:49.098 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T22:48:49.207 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:48:49.267 INFO:teuthology.orchestra.run.smithi031.stdout:Selecting previously unselected package usb-modeswitch. 2024-09-15T22:48:49.284 INFO:teuthology.orchestra.run.smithi031.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-09-15T22:48:49.333 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:49.342 INFO:teuthology.orchestra.run.smithi031.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:48:49.517 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:48:49.637 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-common (238) ... 2024-09-15T22:48:49.643 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:48:49.839 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up flex (2.6.4-8build2) ... 2024-09-15T22:48:49.965 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-09-15T22:48:50.091 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libpq5:amd64 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:50.209 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-09-15T22:48:50.299 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:48:50.335 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-09-15T22:48:50.425 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T22:48:50.444 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:50.519 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T22:48:50.585 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:50.711 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:48:50.837 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T22:48:50.963 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T22:48:51.089 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:48:51.178 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T22:48:51.240 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:48:51.349 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:48:51.404 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-09-15T22:48:51.516 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2.1) ... 2024-09-15T22:48:51.550 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:48:51.677 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:51.802 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T22:48:51.919 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:48:51.919 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-09-15T22:48:51.979 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T22:48:52.105 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:48:52.561 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-09-15T22:48:52.687 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:which means they are currently configured by ifupdown: 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:- enp3s0f1 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T22:48:52.705 INFO:teuthology.orchestra.run.smithi102.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T22:48:52.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:52.812 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.18) ... 2024-09-15T22:48:52.836 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T22:48:52.938 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-09-15T22:48:53.096 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-09-15T22:48:53.224 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:53.247 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T22:48:53.350 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-09-15T22:48:53.451 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-09-15T22:48:53.656 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T22:48:54.064 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-09-15T22:48:54.190 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up dump (0.4b47-3) ... 2024-09-15T22:48:54.285 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-09-15T22:48:54.358 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:54.358 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:48:54.509 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:54.627 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T22:48:54.728 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-common (238) ... 2024-09-15T22:48:54.859 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.3) ... 2024-09-15T22:48:54.969 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up tcl (8.6.11+1build2) ... 2024-09-15T22:48:55.070 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libjson-perl (4.04000-1) ... 2024-09-15T22:48:55.171 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-09-15T22:48:55.252 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-09-15T22:48:55.314 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-09-15T22:48:55.439 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-09-15T22:48:55.616 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3.1) ... 2024-09-15T22:48:55.648 INFO:teuthology.orchestra.run.smithi102.stdout:Adding user postgres to group ssl-cert 2024-09-15T22:48:55.750 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:55.876 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-09-15T22:48:55.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:55.908 INFO:teuthology.orchestra.run.smithi102.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T22:48:56.027 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-client (14+238) ... 2024-09-15T22:48:56.128 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-09-15T22:48:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T22:48:56.152 INFO:teuthology.orchestra.run.smithi102.stdout:Removing obsolete dictionary files: 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout:The following network interfaces were found in /etc/network/interfaces 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout:which means they are currently configured by ifupdown: 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout:- ens1f0 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout:If you want to manage those interfaces with NetworkManager instead 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout:remove their configuration from /etc/network/interfaces. 2024-09-15T22:48:56.727 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:48:56.866 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-09-15T22:48:56.887 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T22:48:57.289 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-09-15T22:48:57.346 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:48:57.707 INFO:teuthology.orchestra.run.smithi102.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T22:48:57.719 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-09-15T22:48:57.723 INFO:teuthology.orchestra.run.smithi102.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:This user must also own the server process. 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:The default text search configuration will be set to "english". 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout:Data page checksums are disabled. 2024-09-15T22:48:57.773 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:48:57.774 INFO:teuthology.orchestra.run.smithi102.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T22:48:57.774 INFO:teuthology.orchestra.run.smithi102.stdout:creating subdirectories ... ok 2024-09-15T22:48:57.774 INFO:teuthology.orchestra.run.smithi102.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T22:48:57.798 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default max_connections ... 100 2024-09-15T22:48:57.832 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default shared_buffers ... 128MB 2024-09-15T22:48:57.846 INFO:teuthology.orchestra.run.smithi102.stdout:selecting default time zone ... Etc/UTC 2024-09-15T22:48:57.846 INFO:teuthology.orchestra.run.smithi102.stdout:creating configuration files ... ok 2024-09-15T22:48:58.007 INFO:teuthology.orchestra.run.smithi102.stdout:running bootstrap script ... ok 2024-09-15T22:48:58.447 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-09-15T22:48:58.590 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-09-15T22:48:58.620 INFO:teuthology.orchestra.run.smithi102.stdout:performing post-bootstrap initialization ... ok 2024-09-15T22:48:58.725 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-09-15T22:48:58.851 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-common (238) ... 2024-09-15T22:48:59.241 INFO:teuthology.orchestra.run.smithi102.stdout:syncing data to disk ... ok 2024-09-15T22:48:59.752 INFO:teuthology.orchestra.run.smithi102.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T22:48:59.804 INFO:teuthology.orchestra.run.smithi031.stdout:Adding user postgres to group ssl-cert 2024-09-15T22:49:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:00.058 INFO:teuthology.orchestra.run.smithi031.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-09-15T22:49:00.319 INFO:teuthology.orchestra.run.smithi031.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-09-15T22:49:00.319 INFO:teuthology.orchestra.run.smithi031.stdout:Removing obsolete dictionary files: 2024-09-15T22:49:01.047 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-09-15T22:49:01.552 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-14 (14.13-0ubuntu0.22.04.1) ... 2024-09-15T22:49:01.884 INFO:teuthology.orchestra.run.smithi031.stdout:Creating new PostgreSQL cluster 14/main ... 2024-09-15T22:49:01.901 INFO:teuthology.orchestra.run.smithi031.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:The files belonging to this database system will be owned by user "postgres". 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi031.stdout:This user must also own the server process. 2024-09-15T22:49:01.946 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:The database cluster will be initialized with locale "en_US". 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:The default text search configuration will be set to "english". 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:Data page checksums are disabled. 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:01.947 INFO:teuthology.orchestra.run.smithi031.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-09-15T22:49:01.948 INFO:teuthology.orchestra.run.smithi031.stdout:creating subdirectories ... ok 2024-09-15T22:49:01.948 INFO:teuthology.orchestra.run.smithi031.stdout:selecting dynamic shared memory implementation ... posix 2024-09-15T22:49:01.972 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default max_connections ... 100 2024-09-15T22:49:02.007 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default shared_buffers ... 128MB 2024-09-15T22:49:02.022 INFO:teuthology.orchestra.run.smithi031.stdout:selecting default time zone ... Etc/UTC 2024-09-15T22:49:02.023 INFO:teuthology.orchestra.run.smithi031.stdout:creating configuration files ... ok 2024-09-15T22:49:02.193 INFO:teuthology.orchestra.run.smithi031.stdout:running bootstrap script ... ok 2024-09-15T22:49:02.712 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:49:02.816 INFO:teuthology.orchestra.run.smithi031.stdout:performing post-bootstrap initialization ... ok 2024-09-15T22:49:02.855 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T22:49:02.981 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up postgresql (14+238) ... 2024-09-15T22:49:03.090 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:49:03.208 INFO:teuthology.orchestra.run.smithi102.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:49:03.389 INFO:teuthology.orchestra.run.smithi031.stdout:syncing data to disk ... ok 2024-09-15T22:49:03.465 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:49:03.466 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:49:03.916 INFO:teuthology.orchestra.run.smithi031.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-09-15T22:49:04.201 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:49:04.286 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T22:49:04.613 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:49:04.798 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:49:06.184 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T22:49:06.284 INFO:teuthology.orchestra.run.smithi102.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:49:06.830 INFO:teuthology.orchestra.run.smithi102.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:49:06.838 DEBUG:teuthology.parallel:result is None 2024-09-15T22:49:07.010 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:49:07.135 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql-contrib (14+238) ... 2024-09-15T22:49:07.261 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up postgresql (14+238) ... 2024-09-15T22:49:07.387 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-09-15T22:49:07.546 INFO:teuthology.orchestra.run.smithi031.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-09-15T22:49:07.815 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:49:07.815 INFO:teuthology.orchestra.run.smithi031.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-09-15T22:49:08.598 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-15T22:49:08.691 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-15T22:49:08.993 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-15T22:49:09.162 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-15T22:49:10.806 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-09-15T22:49:10.906 INFO:teuthology.orchestra.run.smithi031.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-15T22:49:11.451 INFO:teuthology.orchestra.run.smithi031.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-15T22:49:11.458 DEBUG:teuthology.parallel:result is None 2024-09-15T22:49:11.458 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:49:11.618 DEBUG:teuthology.orchestra.run.smithi031:> dpkg-query -W -f '${Version}' ceph 2024-09-15T22:49:11.642 INFO:teuthology.orchestra.run.smithi031.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:49:11.643 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:49:11.644 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T22:49:11.646 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8921c8ef947807b717db041d85f0761b7914d5fc 2024-09-15T22:49:11.792 DEBUG:teuthology.orchestra.run.smithi102:> dpkg-query -W -f '${Version}' ceph 2024-09-15T22:49:11.818 INFO:teuthology.orchestra.run.smithi102.stdout:19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:49:11.818 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-326-g8921c8ef-1jammy 2024-09-15T22:49:11.818 INFO:teuthology.task.install:The correct ceph version 19.1.1-326-g8921c8ef-1jammy is installed. 2024-09-15T22:49:11.820 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-15T22:49:11.821 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:11.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:49:11.844 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:11.845 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-15T22:49:11.884 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-15T22:49:11.884 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:11.885 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:49:11.906 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:49:11.966 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:11.966 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-15T22:49:11.986 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-15T22:49:12.049 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-15T22:49:12.049 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:12.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:49:12.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:49:12.130 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:12.130 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-15T22:49:12.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-15T22:49:12.214 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-15T22:49:12.214 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:12.214 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:49:12.235 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:49:12.303 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:12.304 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-15T22:49:12.324 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-15T22:49:12.387 INFO:teuthology.run_tasks:Running task ceph... 2024-09-15T22:49:13.177 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-15T22:49:13.180 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2024-09-15T22:49:13.185 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-15T22:49:13.205 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-15T22:49:13.205 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:49:13.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-15T22:49:13.277 INFO:tasks.ceph:Creating extra log directories... 2024-09-15T22:49:13.277 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:49:13.320 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-15T22:49:13.616 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-15T22:49:13.617 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-15T22:49:13.617 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-15T22:49:13.617 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:13.617 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:49:13.626 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:13.717 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:13.717 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-15T22:49:13.726 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:13.822 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-15T22:49:13.823 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-15T22:49:13.823 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272', 'branch': 'squid', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/openfiletable}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7906272', 'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, 'kclient': {'syntax': 'v1'}, 'subvolume_version': 1, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3393, 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'sleep_before_teardown': 0, 'subset': '294/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_ad35db06e8924912f01e32b35576297c0f1352b4/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'ad35db06e8924912f01e32b35576297c0f1352b4', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBIILBj6g3PljsUDj0w4WmpgNIQYBdiYxTLzFbylhPCRszr7XjydH/H4iyEGJn73V721UrBFWNeLTQmIvDMEyjH4=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM86ZmAbNqm483qSSELe5WSHxrRrhifA1D69yfSJMPPGfrHF4PbDcJ+qXfhKCHgsZoqBFWP4ECLYEFEwpcS4b2s='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '8921c8ef947807b717db041d85f0761b7914d5fc', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_openfiletable']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-15_21:24:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-15T22:49:13.823 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:49:13.827 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-15T22:49:13.870 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:49:13.878 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-15T22:49:13.937 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:13.937 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:49:13.947 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:49:13.948 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 902 Links: 1 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-15 22:42:37.988470671 +0000 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-15 22:42:37.704473208 +0000 2024-09-15T22:49:14.000 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-15 22:42:37.704473208 +0000 2024-09-15T22:49:14.001 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-15 22:42:37.704473208 +0000 2024-09-15T22:49:14.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:49:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:49:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:49:14.062 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000388115 s, 1.3 MB/s 2024-09-15T22:49:14.064 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:49:14.119 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2024-09-15T22:49:14.173 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 917 Links: 1 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-15 22:42:38.608465133 +0000 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-15 22:42:38.312467777 +0000 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-15 22:42:38.312467777 +0000 2024-09-15T22:49:14.174 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-15 22:42:38.312467777 +0000 2024-09-15T22:49:14.174 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:49:14.234 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:49:14.234 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:49:14.234 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000378854 s, 1.4 MB/s 2024-09-15T22:49:14.236 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:49:14.294 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 936 Links: 1 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-15 22:42:39.176460060 +0000 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-15 22:42:38.912462417 +0000 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-15 22:42:38.912462417 +0000 2024-09-15T22:49:14.349 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-15 22:42:38.912462417 +0000 2024-09-15T22:49:14.350 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:49:14.410 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:49:14.410 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:49:14.410 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000368703 s, 1.4 MB/s 2024-09-15T22:49:14.412 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:49:14.470 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 951 Links: 1 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2024-09-15 22:42:39.764454807 +0000 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2024-09-15 22:42:39.472457416 +0000 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2024-09-15 22:42:39.472457416 +0000 2024-09-15T22:49:14.521 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: 2024-09-15 22:42:39.472457416 +0000 2024-09-15T22:49:14.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:49:14.583 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:49:14.583 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:49:14.583 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000390375 s, 1.3 MB/s 2024-09-15T22:49:14.585 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:49:14.638 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:14.638 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:14.638 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-15T22:49:14.647 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-15T22:49:14.647 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 896 Links: 1 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-15 22:42:33.205062950 +0000 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-15 22:42:32.945065273 +0000 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-15 22:42:32.945065273 +0000 2024-09-15T22:49:14.698 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-15 22:42:32.945065273 +0000 2024-09-15T22:49:14.699 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-15T22:49:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-15T22:49:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-15T22:49:14.764 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000381272 s, 1.3 MB/s 2024-09-15T22:49:14.766 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-15T22:49:14.824 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-15T22:49:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-15T22:49:14.873 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:14.873 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 916 Links: 1 2024-09-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-15 22:42:33.773057877 +0000 2024-09-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-15 22:42:33.517060162 +0000 2024-09-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-15 22:42:33.517060162 +0000 2024-09-15T22:49:14.874 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-15 22:42:33.517060162 +0000 2024-09-15T22:49:14.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-15T22:49:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-15T22:49:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-15T22:49:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000373158 s, 1.4 MB/s 2024-09-15T22:49:14.937 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-15T22:49:14.991 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:15.041 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 932 Links: 1 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-15 22:42:34.349052732 +0000 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-15 22:42:34.085055089 +0000 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-15 22:42:34.085055089 +0000 2024-09-15T22:49:15.042 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-15 22:42:34.085055089 +0000 2024-09-15T22:49:15.042 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-15T22:49:15.103 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-15T22:49:15.103 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-15T22:49:15.103 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000364891 s, 1.4 MB/s 2024-09-15T22:49:15.105 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-15T22:49:15.159 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-15T22:49:15.210 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 6h/6d Inode: 947 Links: 1 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-15 22:42:34.901047801 +0000 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-15 22:42:34.645050088 +0000 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-15 22:42:34.645050088 +0000 2024-09-15T22:49:15.211 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-15 22:42:34.645050088 +0000 2024-09-15T22:49:15.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-15T22:49:15.271 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-15T22:49:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-15T22:49:15.272 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000661715 s, 774 kB/s 2024-09-15T22:49:15.273 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-15T22:49:15.327 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:15.327 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:49:15.327 INFO:tasks.ceph:Generating config... 2024-09-15T22:49:15.328 INFO:tasks.ceph:[client] client mount timeout = 600 2024-09-15T22:49:15.329 INFO:tasks.ceph:[client] debug client = 20 2024-09-15T22:49:15.329 INFO:tasks.ceph:[client] debug ms = 1 2024-09-15T22:49:15.329 INFO:tasks.ceph:[client] pid file = 2024-09-15T22:49:15.329 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-09-15T22:49:15.329 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-09-15T22:49:15.329 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] debug mds = 20 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] debug ms = 1 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] mds debug frag = True 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-09-15T22:49:15.329 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-09-15T22:49:15.330 INFO:tasks.ceph:[mon] mon warn on pool no app = False 2024-09-15T22:49:15.330 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-15T22:49:15.330 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-15T22:49:15.330 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-15T22:49:15.331 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-09-15T22:49:15.331 INFO:tasks.ceph:Setting up mon.a... 2024-09-15T22:49:15.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-15T22:49:15.379 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.keyring 2024-09-15T22:49:15.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-15T22:49:15.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:49:15.506 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.31'), ('mon.b', '172.21.15.102'), ('mon.c', '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]')] 2024-09-15T22:49:15.506 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-09-15T22:49:15.508 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:15.508 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:49:15.559 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.31 --add b 172.21.15.102 --addv c '[v2:172.21.15.102:3301,v1:172.21.15.102:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:15.655 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: generated fsid e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:setting min_mon_release = quincy 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:epoch 0 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:fsid e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:last_changed 2024-09-15T22:49:15.656905+0000 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:created 2024-09-15T22:49:15.656905+0000 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:min_mon_release 17 (quincy) 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:election_strategy: 1 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:0: [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] mon.a 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:1: [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] mon.b 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:2: [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] mon.c 2024-09-15T22:49:15.656 INFO:teuthology.orchestra.run.smithi031.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-15T22:49:15.659 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-15T22:49:15.666 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID e1487968-efb4-47ad-8070-6e7082115957... 2024-09-15T22:49:15.667 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:49:15.711 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:49:15.750 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.751 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-15T22:49:15.752 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.753 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-15T22:49:15.754 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.755 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-15T22:49:15.756 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.757 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:49:15.758 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:49:15.759 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.760 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-15T22:49:15.761 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-15T22:49:15.762 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-09-15T22:49:15.763 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-09-15T22:49:15.764 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-09-15T22:49:15.764 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-09-15T22:49:15.764 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:49:15.764 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:49:15.764 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-15T22:49:15.765 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.766 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-15T22:49:15.767 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:49:15.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:49:15.769 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.770 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-15T22:49:15.771 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.772 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-15T22:49:15.773 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:49:15.774 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-15T22:49:15.775 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:49:15.776 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-15T22:49:15.777 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:49:15.778 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:49:15.779 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:49:15.780 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:49:15.782 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-15T22:49:15.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-15T22:49:15.881 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-15T22:49:15.881 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:15.881 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-15T22:49:15.891 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:15.891 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-15T22:49:15.946 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:49:15.947 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:15.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:49:15.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:49:16.022 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:16.022 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:16.071 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:49:16.072 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:16.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-15T22:49:16.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-15T22:49:16.105 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:16.105 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:16.157 INFO:tasks.ceph:Setting up mon nodes... 2024-09-15T22:49:16.157 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-15T22:49:16.157 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:49:16.213 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-15T22:49:16.218 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:49:16.274 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-15T22:49:16.293 INFO:tasks.ceph:Setting up mds nodes... 2024-09-15T22:49:16.294 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:49:16.350 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-15T22:49:16.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-15T22:49:16.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:49:16.470 INFO:teuthology.orchestra.run.smithi031.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-15T22:49:16.474 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-15T22:49:16.493 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:49:16.551 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-15T22:49:16.555 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-15T22:49:16.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:49:16.671 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-15T22:49:16.675 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-15T22:49:16.694 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-15T22:49:16.695 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-15T22:49:16.738 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-15T22:49:16.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-15T22:49:16.837 INFO:teuthology.orchestra.run.smithi031.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-15T22:49:16.854 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-15T22:49:16.896 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-15T22:49:16.912 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-15T22:49:16.994 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-15T22:49:17.011 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-15T22:49:17.011 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-15T22:49:17.012 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-15T22:49:17.032 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:17.032 INFO:tasks.ceph:role: osd.0 2024-09-15T22:49:17.032 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:49:17.032 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:49:17.101 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:17.101 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:17.101 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:17.101 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:17.101 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:17.102 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:17.102 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:17.102 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:17.102 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:17.102 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:17.514 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-15T22:49:17.516 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-15T22:49:17.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-15T22:49:17.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-15T22:49:17.662 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:17.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:17.663 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-15T22:49:17.727 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:17.727 INFO:tasks.ceph:role: osd.1 2024-09-15T22:49:17.727 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:49:17.727 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:49:17.799 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:17.800 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:18.169 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-15T22:49:18.172 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-15T22:49:18.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-15T22:49:18.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-15T22:49:18.309 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:18.309 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:18.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-15T22:49:18.376 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:18.376 INFO:tasks.ceph:role: osd.2 2024-09-15T22:49:18.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:49:18.377 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:18.448 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:18.449 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:18.449 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:18.449 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:18.849 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-15T22:49:18.852 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-15T22:49:18.852 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-15T22:49:18.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-15T22:49:18.999 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:18.999 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:19.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-15T22:49:19.064 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:19.064 INFO:tasks.ceph:role: osd.3 2024-09-15T22:49:19.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:49:19.065 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:19.137 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:19.536 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2024-09-15T22:49:19.539 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2024-09-15T22:49:19.539 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-15T22:49:19.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-15T22:49:19.659 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:19.660 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:19.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:19.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:19.783+0000 7fa70d6957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-15T22:49:19.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:19.791+0000 7fa70d6957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-15T22:49:19.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:19.791+0000 7fa70d6957c0 -1 bdev(0x55a93b62f800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:19.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:19.791+0000 7fa70d6957c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-15T22:49:23.055 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-15T22:49:23.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:23.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:23.171+0000 7f1c7d4ab7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-15T22:49:23.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:23.171+0000 7f1c7d4ab7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-15T22:49:23.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:23.171+0000 7f1c7d4ab7c0 -1 bdev(0x555ff87c7800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:23.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:23.171+0000 7f1c7d4ab7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-15T22:49:26.419 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-15T22:49:26.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:26.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:26.535+0000 7f0f96b9f7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-15T22:49:26.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:26.535+0000 7f0f96b9f7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-15T22:49:26.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:26.535+0000 7f0f96b9f7c0 -1 bdev(0x55a15ef13800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:26.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:26.535+0000 7f0f96b9f7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-15T22:49:30.065 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-15T22:49:30.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:30.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:30.179+0000 7f3dfd02e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-15T22:49:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:30.179+0000 7f3dfd02e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-15T22:49:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:30.179+0000 7f3dfd02e7c0 -1 bdev(0x560220e59800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:30.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:30.179+0000 7f3dfd02e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-15T22:49:33.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-15T22:49:33.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-15T22:49:33.482 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:33.483 INFO:tasks.ceph:role: osd.4 2024-09-15T22:49:33.483 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:49:33.483 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:33.554 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:33.555 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:33.555 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:33.555 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:33.958 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-15T22:49:33.961 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-15T22:49:33.961 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-15T22:49:34.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-15T22:49:34.107 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:34.108 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:34.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-15T22:49:34.172 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:34.173 INFO:tasks.ceph:role: osd.5 2024-09-15T22:49:34.173 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:49:34.173 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-15T22:49:34.240 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:34.240 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:34.240 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:34.240 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:34.241 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:34.611 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-15T22:49:34.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-15T22:49:34.614 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-15T22:49:34.691 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-15T22:49:34.753 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:34.754 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:34.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-15T22:49:34.822 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:34.822 INFO:tasks.ceph:role: osd.6 2024-09-15T22:49:34.822 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:49:34.823 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-15T22:49:34.893 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:34.893 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:34.894 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:35.295 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-15T22:49:35.298 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-15T22:49:35.298 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-15T22:49:35.391 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-15T22:49:35.450 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:35.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:35.451 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-15T22:49:35.513 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-15T22:49:35.513 INFO:tasks.ceph:role: osd.7 2024-09-15T22:49:35.513 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:49:35.513 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-15T22:49:35.586 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-15T22:49:35.587 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-15T22:49:35.985 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-15T22:49:35.987 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-15T22:49:35.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-15T22:49:36.110 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-15T22:49:36.127 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: /sbin/restorecon: command not found 2024-09-15T22:49:36.128 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:49:36.128 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:36.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:36.259+0000 7f62130597c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-15T22:49:36.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:36.263+0000 7f62130597c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-15T22:49:36.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:36.263+0000 7f62130597c0 -1 bdev(0x55af169f1800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:36.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:36.263+0000 7f62130597c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-15T22:49:39.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-15T22:49:39.553 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:39.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:39.651+0000 7f74ec6c17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-15T22:49:39.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:39.651+0000 7f74ec6c17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-15T22:49:39.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:39.651+0000 7f74ec6c17c0 -1 bdev(0x55b12fe93800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:39.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:39.651+0000 7f74ec6c17c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-15T22:49:42.863 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-15T22:49:42.884 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:42.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:42.979+0000 7fd1693a17c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-15T22:49:42.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:42.979+0000 7fd1693a17c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-15T22:49:42.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:42.979+0000 7fd1693a17c0 -1 bdev(0x561bed213800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:42.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:42.979+0000 7fd1693a17c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-15T22:49:43.825 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:43.829 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:49:46.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-15T22:49:46.250 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:46.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:46.343+0000 7f46d08957c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-15T22:49:46.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:46.343+0000 7f46d08957c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-15T22:49:46.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:46.343+0000 7f46d08957c0 -1 bdev(0x557f7cf75800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-15T22:49:46.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:46.343+0000 7f46d08957c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-15T22:49:49.563 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-15T22:49:49.583 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-15T22:49:49.583 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-15T22:49:49.606 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.606 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-15T22:49:49.668 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.668 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-15T22:49:49.732 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-15T22:49:49.797 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.797 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-15T22:49:49.859 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.860 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-15T22:49:49.923 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:49.923 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-15T22:49:49.987 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:49.987 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-15T22:49:50.008 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.008 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-15T22:49:50.072 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.072 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-15T22:49:50.131 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.131 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-15T22:49:50.191 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.191 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-15T22:49:50.251 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.251 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-15T22:49:50.311 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-15T22:49:50.370 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:50.371 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-15T22:49:50.379 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:50.379 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-15T22:49:50.431 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.431 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-15T22:49:50.439 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:50.439 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-15T22:49:50.488 INFO:tasks.ceph:Adding keys to all mons... 2024-09-15T22:49:50.488 DEBUG:teuthology.orchestra.run.smithi031:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:49:50.491 DEBUG:teuthology.orchestra.run.smithi102:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-15T22:49:50.532 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.y] 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmVYbJDBAAUAngBLy5hl9+p7TNGVLXPw== 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdm9BbzFBAAh2krY1L9Wkr95inp5Aq6bg== 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmRk8cHBAAeqI7fUCoJV3gJg9Oioc5Tg== 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.0] 2024-09-15T22:49:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBvZOdmx3vuLhAA7zs4BxFmuT8des6sufICgg== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.1] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBzZOdmVDxwChAAQu6SLevRyCQETBSsTxQ5dA== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.2] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB2ZOdm7WMnIBAA0d3cDV8zSeyZYMz980Onug== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.3] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQB6ZOdmoV/nChAA3ATYaJdz/3xyw7fRhXUPRQ== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr.x] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmw9CDEBAAb7U4j7o6ZSig5nbXE52GCQ== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmhB0FIRAA3mEZDlQgVAwlFjGHz574fA== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmUJQsKBAAJ3V6BnnIR6KNLPHZE/DDwg== 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.4] 2024-09-15T22:49:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCAZOdmMamwDxAAvnLbvnUZouVSVp/Ga8akcg== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.5] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCDZOdmicPoJhAA+L3TkVT/ou/gTr/l3oewUQ== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.6] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCGZOdmXnN5OhAA9yDDXVneKaH4xm9sV06sZQ== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[osd.7] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQCKZOdmK/adFBAAEPOZtpFn//S8b6bSnd+u6A== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[client.2] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmCeb6MRAAE7MMgVGIePOdK09iw/Ktfw== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[client.1] 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmhs+UNRAAaXrMB5Y6bgHy3AjQj15MAg== 2024-09-15T22:49:50.535 INFO:teuthology.orchestra.run.smithi031.stdout:[client.3] 2024-09-15T22:49:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmYLZ2OxAAkWX7K+9kTnOFWCNklDBCzQ== 2024-09-15T22:49:50.545 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.y] 2024-09-15T22:49:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmVYbJDBAAUAngBLy5hl9+p7TNGVLXPw== 2024-09-15T22:49:50.545 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:49:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdm9BbzFBAAh2krY1L9Wkr95inp5Aq6bg== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmRk8cHBAAeqI7fUCoJV3gJg9Oioc5Tg== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.0] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBvZOdmx3vuLhAA7zs4BxFmuT8des6sufICgg== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.1] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBzZOdmVDxwChAAQu6SLevRyCQETBSsTxQ5dA== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.2] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB2ZOdm7WMnIBAA0d3cDV8zSeyZYMz980Onug== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.3] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQB6ZOdmoV/nChAA3ATYaJdz/3xyw7fRhXUPRQ== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr.x] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmw9CDEBAAb7U4j7o6ZSig5nbXE52GCQ== 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:49:50.546 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmhB0FIRAA3mEZDlQgVAwlFjGHz574fA== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmUJQsKBAAJ3V6BnnIR6KNLPHZE/DDwg== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.4] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCAZOdmMamwDxAAvnLbvnUZouVSVp/Ga8akcg== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.5] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCDZOdmicPoJhAA+L3TkVT/ou/gTr/l3oewUQ== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.6] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCGZOdmXnN5OhAA9yDDXVneKaH4xm9sV06sZQ== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[osd.7] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQCKZOdmK/adFBAAEPOZtpFn//S8b6bSnd+u6A== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[client.0] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg== 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout:[client.2] 2024-09-15T22:49:50.547 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmCeb6MRAAE7MMgVGIePOdK09iw/Ktfw== 2024-09-15T22:49:50.548 INFO:teuthology.orchestra.run.smithi102.stdout:[client.1] 2024-09-15T22:49:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmhs+UNRAAaXrMB5Y6bgHy3AjQj15MAg== 2024-09-15T22:49:50.548 INFO:teuthology.orchestra.run.smithi102.stdout:[client.3] 2024-09-15T22:49:50.548 INFO:teuthology.orchestra.run.smithi102.stdout: key = AQBsZOdmYLZ2OxAAkWX7K+9kTnOFWCNklDBCzQ== 2024-09-15T22:49:50.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:49:50.582 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:49:50.645 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:50.649 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:50.705 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:50.708 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:50.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.767 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.821 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.883 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.936 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.941 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:50.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:49:50.997 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-15T22:49:51.049 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:51.053 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:51.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:51.111 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-15T22:49:51.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.171 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.227 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.280 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.283 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.336 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.340 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-15T22:49:51.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.395 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.451 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.516 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.572 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.575 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-15T22:49:51.631 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-15T22:49:51.632 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-15T22:49:51.651 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:49:51.763 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-15T22:49:51.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-15T22:49:51.803 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:49:51.910 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-15T22:49:51.930 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-15T22:49:51.995 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-15T22:49:52.101 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-15T22:49:52.121 DEBUG:teuthology.orchestra.run.smithi031:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:52.124 DEBUG:teuthology.orchestra.run.smithi102:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-15T22:49:52.172 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-15T22:49:52.172 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-15T22:49:52.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-15T22:49:52.177 INFO:tasks.ceph.mon.a:Started 2024-09-15T22:49:52.177 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-15T22:49:52.177 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-15T22:49:52.216 INFO:tasks.ceph.mon.b:Started 2024-09-15T22:49:52.216 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-15T22:49:52.216 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-15T22:49:52.219 INFO:tasks.ceph.mon.c:Started 2024-09-15T22:49:52.219 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-15T22:49:52.219 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-15T22:49:52.220 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-15T22:49:52.223 INFO:tasks.ceph.mgr.y:Started 2024-09-15T22:49:52.223 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-15T22:49:52.223 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-15T22:49:52.226 INFO:tasks.ceph.mgr.x:Started 2024-09-15T22:49:52.227 INFO:tasks.ceph:Setting crush tunables to default 2024-09-15T22:49:52.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph osd crush tunables default 2024-09-15T22:49:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 Processor -- start 2024-09-15T22:49:52.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 -- start start 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f78071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 0x7f1f7809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f780b1b60 con 0x7f1f78071750 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1f781601a0 con 0x7f1f7809bb10 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f80600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f78160440 con 0x7f1f780b1780 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7e600640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1f78071750 0x7f1f78070170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45080/0 (socket says 172.21.15.31:45080) 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7d200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 0x7f1f7809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7e600640 1 -- 172.21.15.31:0/2608514556 learned_addr learned my addr 172.21.15.31:0/2608514556 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f78071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7d200640 1 -- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 msgr2=0x7f1f7809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-09-15T22:49:52.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7d200640 1 -- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 msgr2=0x7f1f7809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 0x7f1f7809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 msgr2=0x7f1f78071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 msgr2=0x7f1f78071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f78071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f78071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:49:52.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.367+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 0x7f1f7809aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-15T22:49:52.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.523+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 110966091 0 0) 0x7f1f780b1b60 con 0x7f1f78071750 2024-09-15T22:49:52.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.523+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f60003530 con 0x7f1f78071750 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2812631826 0 0) 0x7f1f60003530 con 0x7f1f78071750 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 msgr2=0x7f1f78071210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f78071210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 msgr2=0x7f1f7809aa40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 --2- 172.21.15.31:0/2608514556 >> v2:172.21.15.31:3300/0 conn(0x7f1f7809bb10 0x7f1f7809aa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f78160720 con 0x7f1f78071750 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f1f70001a20 con 0x7f1f78071750 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 >> v1:172.21.15.31:6789/0 conn(0x7f1f78071750 legacy=0x7f1f78070170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f600039c0 0x7f1f60003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f60004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f60004d50 0x7f1f600051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f781601a0 con 0x7f1f600039c0 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f78160440 con 0x7f1f60004d50 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6000bb60 con 0x7f1f780b1780 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f600039c0 0x7f1f60003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f60004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7e600640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f60004d50 0x7f1f600051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f60004d50 msgr2=0x7f1f600051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f60004d50 0x7f1f600051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f600039c0 msgr2=0x7f1f60003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f600039c0 0x7f1f60003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7d200640 1 -- 172.21.15.31:0/2608514556 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f60003530 con 0x7f1f780b1780 2024-09-15T22:49:52.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.527+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f600039c0 0x7f1f60003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:52.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f60004810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f780a0400 tx=0x7f1f6401c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae05f69ddaeee35e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:52.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f640b2070 con 0x7f1f780b1780 2024-09-15T22:49:52.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f780ce090 con 0x7f1f780b1780 2024-09-15T22:49:52.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f77e00640 1 -- 172.21.15.31:0/2608514556 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6400b5e0 con 0x7f1f780b1780 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 -- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 msgr2=0x7f1f60004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 --2- 172.21.15.31:0/2608514556 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f780b1780 0x7f1f60004810 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1f780a0400 tx=0x7f1f6401c620 comp rx=0 tx=0).stop 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f7e600640 1 -- 172.21.15.31:0/2608514556 reap_dead start 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 -- 172.21.15.31:0/2608514556 shutdown_connections 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 -- 172.21.15.31:0/2608514556 >> 172.21.15.31:0/2608514556 conn(0x7f1f780b3df0 msgr2=0x7f1f780b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 -- 172.21.15.31:0/2608514556 shutdown_connections 2024-09-15T22:49:52.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.531+0000 7f1f80600640 1 -- 172.21.15.31:0/2608514556 wait complete. 2024-09-15T22:49:52.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 Processor -- start 2024-09-15T22:49:52.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 -- start start 2024-09-15T22:49:52.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7815c680 0x7f1f7815cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f78163410 0x7f1f78163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7809b310 con 0x7f1f780b1780 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1f7809b190 con 0x7f1f78163410 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f80600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1f78167430 con 0x7f1f7815c680 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38198/0 (socket says 172.21.15.31:38198) 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2582852052 learned_addr learned my addr 172.21.15.31:0/2582852052 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7d200640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7815c680 0x7f1f7815cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7e600640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f78163410 0x7f1f78163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7815c680 msgr2=0x7f1f7815cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:52.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7815c680 0x7f1f7815cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f78163410 msgr2=0x7f1f78163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:52.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f78163410 0x7f1f78163890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.535+0000 7f1f7dc00640 1 -- 172.21.15.31:0/2582852052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f7815d100 con 0x7f1f780b1780 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f7dc00640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c3d0 tx=0x7f1f6c0119f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c019070 con 0x7f1f780b1780 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f6c015890 con 0x7f1f780b1780 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f6c015c40 con 0x7f1f780b1780 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f7815d3e0 con 0x7f1f780b1780 2024-09-15T22:49:52.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f780c9900 con 0x7f1f780b1780 2024-09-15T22:49:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1f6c01c070 con 0x7f1f780b1780 2024-09-15T22:49:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1f6c013740 con 0x7f1f780b1780 2024-09-15T22:49:52.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.539+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f7809aa40 con 0x7f1f780b1780 2024-09-15T22:49:52.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.559+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1f6c013940 con 0x7f1f780b1780 2024-09-15T22:49:52.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.623+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f1f780b4d00 con 0x7f1f780b1780 2024-09-15T22:49:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.623+0000 7f1f75600640 1 -- 172.21.15.31:0/2582852052 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1f6c013b20 con 0x7f1f780b1780 2024-09-15T22:49:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:adjusted tunables profile to default 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 msgr2=0x7f1f780b7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c00c3d0 tx=0x7f1f6c0119f0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 shutdown_connections 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1f78163410 0x7f1f78163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1f7815c680 0x7f1f7815cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 --2- 172.21.15.31:0/2582852052 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1f780b1780 0x7f1f780b7af0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 >> 172.21.15.31:0/2582852052 conn(0x7f1f780b3df0 msgr2=0x7f1f7815e730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 shutdown_connections 2024-09-15T22:49:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:52.627+0000 7f1f80600640 1 -- 172.21.15.31:0/2582852052 wait complete. 2024-09-15T22:49:52.648 INFO:tasks.ceph:check_enable_crimson: False 2024-09-15T22:49:52.648 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-15T22:49:52.649 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:52.649 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-15T22:49:52.669 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:52.669 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-15T22:49:52.730 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:52.730 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-15T22:49:52.746 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:52.747+0000 7fe67d82c180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:49:52.777 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:52.775+0000 7ff857c2e180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-15T22:49:52.790 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:49:52.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-15T22:49:52.855 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:52.855 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-15T22:49:52.874 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:52.874 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-15T22:49:52.936 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:52.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-15T22:49:52.999 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:49:53.000 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-15T22:49:53.060 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new e983633f-f8df-4b53-a4d5-b53a21b0e27e 0 2024-09-15T22:49:53.238 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:53.239+0000 7fe67d82c180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:49:53.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.239+0000 7f3a29e00640 1 Processor -- start 2024-09-15T22:49:53.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.239+0000 7f3a29e00640 1 -- start start 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a29e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a240b5890 0x7f3a2409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a29e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a240738b0 con 0x7f3a2415b530 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a29e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a2415c820 con 0x7f3a2415b150 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a29e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3a2415cb00 con 0x7f3a240b5890 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f3a2415b150 0x7f3a2415d8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56088/0 (socket says 172.21.15.102:56088) 2024-09-15T22:49:53.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22a00640 1 -- 172.21.15.102:0/53913396 learned_addr learned my addr 172.21.15.102:0/53913396 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:53.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a23400640 1 --2- 172.21.15.102:0/53913396 >> v2:172.21.15.31:3300/0 conn(0x7f3a240b5890 0x7f3a2409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 377720364 0 0) 0x7f3a2415c820 con 0x7f3a2415b150 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a08003530 con 0x7f3a2415b150 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712230695 0 0) 0x7f3a240738b0 con 0x7f3a2415b530 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a2415c820 con 0x7f3a2415b530 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a23400640 1 -- 172.21.15.102:0/53913396 >> v1:172.21.15.102:6789/0 conn(0x7f3a2415b150 legacy=0x7f3a2415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3444472058 0 0) 0x7f3a08003530 con 0x7f3a2415b150 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a23400640 1 -- 172.21.15.102:0/53913396 >> v1:172.21.15.31:6789/0 conn(0x7f3a2415b530 legacy=0x7f3a240b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a23400640 1 -- 172.21.15.102:0/53913396 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2415cde0 con 0x7f3a240b5890 2024-09-15T22:49:53.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.243+0000 7f3a23400640 1 --2- 172.21.15.102:0/53913396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a2409aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009d90 tx=0x7f3a1c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f20e143f2f5846 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0b2070 con 0x7f3a240b5890 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a1c0a5a00 con 0x7f3a240b5890 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a22000640 1 -- 172.21.15.102:0/53913396 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a1c0a5dd0 con 0x7f3a240b5890 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- 172.21.15.102:0/53913396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 msgr2=0x7f3a2409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 --2- 172.21.15.102:0/53913396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a2409aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3a1c009d90 tx=0x7f3a1c01c940 comp rx=0 tx=0).stop 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- 172.21.15.102:0/53913396 shutdown_connections 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 --2- 172.21.15.102:0/53913396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a2409aa40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- 172.21.15.102:0/53913396 >> 172.21.15.102:0/53913396 conn(0x7f3a240b68b0 msgr2=0x7f3a240b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- 172.21.15.102:0/53913396 shutdown_connections 2024-09-15T22:49:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- 172.21.15.102:0/53913396 wait complete. 2024-09-15T22:49:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 Processor -- start 2024-09-15T22:49:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- start start 2024-09-15T22:49:53.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a24150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 0x7f3a241fadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2415ebf0 con 0x7f3a240b5890 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a2415ea70 con 0x7f3a2415b150 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a29e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a2406bcc0 con 0x7f3a2415b530 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a1be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a22a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a24150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a23400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 0x7f3a241fadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a1be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49710/0 (socket says 172.21.15.102:49710) 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.247+0000 7f3a1be00640 1 -- 172.21.15.102:0/857179257 learned_addr learned my addr 172.21.15.102:0/857179257 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 -- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 msgr2=0x7f3a241fadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 0x7f3a241fadc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 -- 172.21.15.102:0/857179257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 msgr2=0x7f3a24150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a24150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 -- 172.21.15.102:0/857179257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a2414d2c0 con 0x7f3a2415b150 2024-09-15T22:49:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a23400640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 0x7f3a241fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1be00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c430 tx=0x7f3a0c00c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c017070 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a0c0052f0 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a240b0dc0 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a0c003840 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a240b1380 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a0c01a070 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f3a0c01c440 con 0x7f3a2415b150 2024-09-15T22:49:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.251+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a2409aa40 con 0x7f3a2415b150 2024-09-15T22:49:53.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.259+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f3a0c021020 con 0x7f3a2415b150 2024-09-15T22:49:53.298 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:53.295+0000 7ff857c2e180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-15T22:49:53.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.323+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e983633f-f8df-4b53-a4d5-b53a21b0e27e", "id": 0} v 0) -- 0x7f3a24158180 con 0x7f3a2415b150 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.327+0000 7f3a1b400640 1 -- 172.21.15.102:0/857179257 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e983633f-f8df-4b53-a4d5-b53a21b0e27e", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f3a0c011590 con 0x7f3a2415b150 2024-09-15T22:49:53.329 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-09-15T22:49:53.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 msgr2=0x7f3a241fa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3a0c00c430 tx=0x7f3a0c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 shutdown_connections 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a2415b530 0x7f3a241fadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a2415b150 0x7f3a241fa880 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 --2- 172.21.15.102:0/857179257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a240b5890 0x7f3a24150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 >> 172.21.15.102:0/857179257 conn(0x7f3a240b68b0 msgr2=0x7f3a2406c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 shutdown_connections 2024-09-15T22:49:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.331+0000 7f3a29e00640 1 -- 172.21.15.102:0/857179257 wait complete. 2024-09-15T22:49:53.348 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new d541b283-b44d-41a6-b4a9-4cca6906e954 1 2024-09-15T22:49:53.456 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:53.455+0000 7fe67d82c180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:49:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.483+0000 7f18b9800640 1 Processor -- start 2024-09-15T22:49:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.483+0000 7f18b9800640 1 -- start start 2024-09-15T22:49:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f18b40b1780 0x7f18b4071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f18b40b1b60 con 0x7f18b40b1780 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f18b41601a0 con 0x7f18b409bb10 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b9800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f18b4160440 con 0x7f18b4071750 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18abe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18abe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49724/0 (socket says 172.21.15.102:49724) 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:37326/0 (socket says 172.21.15.102:37326) 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18abe00640 1 -- 172.21.15.102:0/1190145387 learned_addr learned my addr 172.21.15.102:0/1190145387 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b2a00640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.31:3300/0 conn(0x7f18b40b1780 0x7f18b4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 -- 172.21.15.102:0/1190145387 >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 msgr2=0x7f18b409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 -- 172.21.15.102:0/1190145387 >> v2:172.21.15.31:3300/0 conn(0x7f18b40b1780 msgr2=0x7f18b4071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.31:3300/0 conn(0x7f18b40b1780 0x7f18b4071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 -- 172.21.15.102:0/1190145387 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b4160720 con 0x7f18b4071750 2024-09-15T22:49:53.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18abe00640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:53.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.487+0000 7f18b3400640 1 --2- 172.21.15.102:0/1190145387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18b40a0400 tx=0x7f18ac01c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b43f1fdd6790549b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2000640 1 -- 172.21.15.102:0/1190145387 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0b2070 con 0x7f18b4071750 2024-09-15T22:49:53.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2000640 1 -- 172.21.15.102:0/1190145387 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ac0a5940 con 0x7f18b4071750 2024-09-15T22:49:53.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2000640 1 -- 172.21.15.102:0/1190145387 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18ac0a5d10 con 0x7f18b4071750 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- 172.21.15.102:0/1190145387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 msgr2=0x7f18b409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- 172.21.15.102:0/1190145387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f18b40a0400 tx=0x7f18ac01c8a0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- 172.21.15.102:0/1190145387 shutdown_connections 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- 172.21.15.102:0/1190145387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b4071750 0x7f18b409af80 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.102:3300/0 conn(0x7f18b409bb10 0x7f18b409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- 172.21.15.102:0/1190145387 >> v2:172.21.15.31:3300/0 conn(0x7f18b40b1780 0x7f18b4071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- 172.21.15.102:0/1190145387 >> 172.21.15.102:0/1190145387 conn(0x7f18b40b3df0 msgr2=0x7f18b40b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- 172.21.15.102:0/1190145387 shutdown_connections 2024-09-15T22:49:53.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- 172.21.15.102:0/1190145387 wait complete. 2024-09-15T22:49:53.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 Processor -- start 2024-09-15T22:49:53.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- start start 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 0x7f18b415f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b40b1780 0x7f18b406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4070d10 con 0x7f18b40b1780 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f18b4070b90 con 0x7f18b4071750 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b9800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f18b4070e90 con 0x7f18b409bb10 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18abe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 0x7f18b415f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49740/0 (socket says 172.21.15.102:49740) 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b2a00640 1 -- 172.21.15.102:0/4030326093 learned_addr learned my addr 172.21.15.102:0/4030326093 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.491+0000 7f18b3400640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b40b1780 0x7f18b406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 -- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 msgr2=0x7f18b415f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 0x7f18b415f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 -- 172.21.15.102:0/4030326093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b40b1780 msgr2=0x7f18b406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b40b1780 0x7f18b406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 -- 172.21.15.102:0/4030326093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b406d890 con 0x7f18b4071750 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18abe00640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 0x7f18b415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b2a00640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e960 tx=0x7f18a400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4017070 con 0x7f18b4071750 2024-09-15T22:49:53.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18a400c940 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b406db70 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a400ccf0 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b415f160 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f18a401a070 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f18a401c8d0 con 0x7f18b4071750 2024-09-15T22:49:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.495+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18b4071210 con 0x7f18b4071750 2024-09-15T22:49:53.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.499+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f18a401cad0 con 0x7f18b4071750 2024-09-15T22:49:53.533 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:53.531+0000 7ff857c2e180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-15T22:49:53.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.567+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d541b283-b44d-41a6-b4a9-4cca6906e954", "id": 1} v 0) -- 0x7f18b40b4d00 con 0x7f18b4071750 2024-09-15T22:49:53.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.571+0000 7f18aaa00640 1 -- 172.21.15.102:0/4030326093 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d541b283-b44d-41a6-b4a9-4cca6906e954", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f18a401ccb0 con 0x7f18b4071750 2024-09-15T22:49:53.573 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 msgr2=0x7f18b4158170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f18a400e960 tx=0x7f18a400ed60 comp rx=0 tx=0).stop 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 shutdown_connections 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f18b40b1780 0x7f18b406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f18b409bb10 0x7f18b415f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 --2- 172.21.15.102:0/4030326093 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f18b4071750 0x7f18b4158170 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 >> 172.21.15.102:0/4030326093 conn(0x7f18b40b3df0 msgr2=0x7f18b40b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 shutdown_connections 2024-09-15T22:49:53.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.575+0000 7f18b9800640 1 -- 172.21.15.102:0/4030326093 wait complete. 2024-09-15T22:49:53.592 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 46507bc7-a82a-4e01-977d-6c3c08f30949 2 2024-09-15T22:49:53.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 Processor -- start 2024-09-15T22:49:53.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 -- start start 2024-09-15T22:49:53.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff0162a90 0x7feff00d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feff009ba50 0x7feff00cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feff006ea40 con 0x7feff00c5130 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feff00d30c0 con 0x7feff009ba50 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7feff5800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feff00d0e30 con 0x7feff0162a90 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7fefe7400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff0162a90 0x7feff00d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.727+0000 7fefe7400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feff0162a90 0x7feff00d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49746/0 (socket says 172.21.15.102:49746) 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 -- 172.21.15.102:0/1485745595 learned_addr learned my addr 172.21.15.102:0/1485745595 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7feff4e00640 1 --2- 172.21.15.102:0/1485745595 >> v2:172.21.15.31:3300/0 conn(0x7feff009ba50 0x7feff00cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 -- 172.21.15.102:0/1485745595 >> v2:172.21.15.31:3300/0 conn(0x7feff009ba50 msgr2=0x7feff00cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 --2- 172.21.15.102:0/1485745595 >> v2:172.21.15.31:3300/0 conn(0x7feff009ba50 0x7feff00cc7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 -- 172.21.15.102:0/1485745595 >> v1:172.21.15.31:6789/0 conn(0x7feff00c5130 legacy=0x7feff00c5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 -- 172.21.15.102:0/1485745595 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff006ed20 con 0x7feff0162a90 2024-09-15T22:49:53.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefe7400640 1 --2- 172.21.15.102:0/1485745595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff0162a90 0x7feff00d12c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feff01662f0 tx=0x7fefd801c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=83978fe9187626e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefef400640 1 -- 172.21.15.102:0/1485745595 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80aa650 con 0x7feff0162a90 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefef400640 1 -- 172.21.15.102:0/1485745595 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd80af070 con 0x7feff0162a90 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.731+0000 7fefef400640 1 -- 172.21.15.102:0/1485745595 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80aaa10 con 0x7feff0162a90 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- 172.21.15.102:0/1485745595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff0162a90 msgr2=0x7feff00d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- 172.21.15.102:0/1485745595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff0162a90 0x7feff00d12c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feff01662f0 tx=0x7fefd801c4f0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- 172.21.15.102:0/1485745595 shutdown_connections 2024-09-15T22:49:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- 172.21.15.102:0/1485745595 >> v2:172.21.15.31:3300/0 conn(0x7feff009ba50 0x7feff00cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- 172.21.15.102:0/1485745595 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff0162a90 0x7feff00d12c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- 172.21.15.102:0/1485745595 >> 172.21.15.102:0/1485745595 conn(0x7feff00d2160 msgr2=0x7feff00d2570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- 172.21.15.102:0/1485745595 shutdown_connections 2024-09-15T22:49:53.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- 172.21.15.102:0/1485745595 wait complete. 2024-09-15T22:49:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 Processor -- start 2024-09-15T22:49:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- start start 2024-09-15T22:49:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feff009ba50 0x7feff015f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 0x7feff0161230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feff00cd100 con 0x7feff009ba50 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feff006e6f0 con 0x7feff00c5130 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feff00cd280 con 0x7feff0162a90 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49758/0 (socket says 172.21.15.102:49758) 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 -- 172.21.15.102:0/974470382 learned_addr learned my addr 172.21.15.102:0/974470382 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff4e00640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 0x7feff0161230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefefe00640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feff009ba50 0x7feff015f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 -- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 msgr2=0x7feff0161230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 0x7feff0161230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 -- 172.21.15.102:0/974470382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feff009ba50 msgr2=0x7feff015f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feff009ba50 0x7feff015f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7fefe7400640 1 -- 172.21.15.102:0/974470382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feff00ca480 con 0x7feff00c5130 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.735+0000 7feff4e00640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 0x7feff0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefe7400640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefd80ac040 tx=0x7fefd801ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80bd5f0 con 0x7feff00c5130 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefd80a6040 con 0x7feff00c5130 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feff00ca760 con 0x7feff00c5130 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd80bd9b0 con 0x7feff00c5130 2024-09-15T22:49:53.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feff00cad20 con 0x7feff00c5130 2024-09-15T22:49:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fefd80b33f0 con 0x7feff00c5130 2024-09-15T22:49:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fefd80b2840 con 0x7feff00c5130 2024-09-15T22:49:53.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.739+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feff00cc7b0 con 0x7feff00c5130 2024-09-15T22:49:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.743+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fefd80c3060 con 0x7feff00c5130 2024-09-15T22:49:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.811+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46507bc7-a82a-4e01-977d-6c3c08f30949", "id": 2} v 0) -- 0x7feff00b7fd0 con 0x7feff00c5130 2024-09-15T22:49:53.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7fefecc00640 1 -- 172.21.15.102:0/974470382 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46507bc7-a82a-4e01-977d-6c3c08f30949", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fefd8016110 con 0x7feff00c5130 2024-09-15T22:49:53.818 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-09-15T22:49:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 msgr2=0x7feff00cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fefd80ac040 tx=0x7fefd801ad30 comp rx=0 tx=0).stop 2024-09-15T22:49:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 shutdown_connections 2024-09-15T22:49:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feff0162a90 0x7feff0161230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feff00c5130 0x7feff00cbd70 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 --2- 172.21.15.102:0/974470382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feff009ba50 0x7feff015f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 >> 172.21.15.102:0/974470382 conn(0x7feff00d2160 msgr2=0x7feff00b52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 shutdown_connections 2024-09-15T22:49:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.819+0000 7feff5800640 1 -- 172.21.15.102:0/974470382 wait complete. 2024-09-15T22:49:53.837 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 762dec9c-4049-45ab-94ae-ad29fdc88c0f 3 2024-09-15T22:49:53.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.971+0000 7fc892000640 1 Processor -- start 2024-09-15T22:49:53.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.971+0000 7fc892000640 1 -- start start 2024-09-15T22:49:53.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc892000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc88c15b330 0x7fc88c0b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc892000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 0x7fc88c15d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc892000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88c0b3de0 con 0x7fc88c09aa40 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc892000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc88c15cb40 con 0x7fc88c15b330 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc892000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c15cde0 con 0x7fc88c0b53e0 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc882a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fc88c09aa40 0x7fc88c0b4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56096/0 (socket says 172.21.15.102:56096) 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc882a00640 1 -- 172.21.15.102:0/1206479341 learned_addr learned my addr 172.21.15.102:0/1206479341 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 --2- 172.21.15.102:0/1206479341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 0x7fc88c15d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88b400640 1 --2- 172.21.15.102:0/1206479341 >> v2:172.21.15.31:3300/0 conn(0x7fc88c15b330 0x7fc88c0b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 -- 172.21.15.102:0/1206479341 >> v2:172.21.15.31:3300/0 conn(0x7fc88c15b330 msgr2=0x7fc88c0b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:53.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 --2- 172.21.15.102:0/1206479341 >> v2:172.21.15.31:3300/0 conn(0x7fc88c15b330 0x7fc88c0b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 -- 172.21.15.102:0/1206479341 >> v1:172.21.15.102:6789/0 conn(0x7fc88c09aa40 legacy=0x7fc88c0b4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 -- 172.21.15.102:0/1206479341 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c15d0c0 con 0x7fc88c0b53e0 2024-09-15T22:49:53.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.975+0000 7fc88be00640 1 --2- 172.21.15.102:0/1206479341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 0x7fc88c15d8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8840097c0 tx=0x7fc88401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e605f7440b4503bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88aa00640 1 -- 172.21.15.102:0/1206479341 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8840aa5f0 con 0x7fc88c0b53e0 2024-09-15T22:49:53.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88aa00640 1 -- 172.21.15.102:0/1206479341 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8840af070 con 0x7fc88c0b53e0 2024-09-15T22:49:53.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88aa00640 1 -- 172.21.15.102:0/1206479341 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8840aa9b0 con 0x7fc88c0b53e0 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- 172.21.15.102:0/1206479341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 msgr2=0x7fc88c15d8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- 172.21.15.102:0/1206479341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 0x7fc88c15d8c0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc8840097c0 tx=0x7fc88401c470 comp rx=0 tx=0).stop 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- 172.21.15.102:0/1206479341 shutdown_connections 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- 172.21.15.102:0/1206479341 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c0b53e0 0x7fc88c15d8c0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- 172.21.15.102:0/1206479341 >> v2:172.21.15.31:3300/0 conn(0x7fc88c15b330 0x7fc88c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- 172.21.15.102:0/1206479341 >> 172.21.15.102:0/1206479341 conn(0x7fc88c073560 msgr2=0x7fc88c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:53.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- 172.21.15.102:0/1206479341 shutdown_connections 2024-09-15T22:49:53.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- 172.21.15.102:0/1206479341 wait complete. 2024-09-15T22:49:53.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 Processor -- start 2024-09-15T22:49:53.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- start start 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88c0b53e0 0x7fc88c1563c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c15b330 0x7fc88c1fb080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c15e790 con 0x7fc88c0b53e0 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc88c15e610 con 0x7fc88c09aa40 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc892000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc88c15e910 con 0x7fc88c15b330 2024-09-15T22:49:53.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88b400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88b400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49772/0 (socket says 172.21.15.102:49772) 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88b400640 1 -- 172.21.15.102:0/3579309182 learned_addr learned my addr 172.21.15.102:0/3579309182 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc88be00640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c15b330 0x7fc88c1fb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.979+0000 7fc882a00640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88c0b53e0 0x7fc88c1563c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 -- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c15b330 msgr2=0x7fc88c1fb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c15b330 0x7fc88c1fb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 -- 172.21.15.102:0/3579309182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88c0b53e0 msgr2=0x7fc88c1563c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88c0b53e0 0x7fc88c1563c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 -- 172.21.15.102:0/3579309182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88c155da0 con 0x7fc88c09aa40 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc88b400640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00efc0 tx=0x7fc87c00c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:53.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c018020 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc87c014480 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88c156070 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc87c014850 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc88c145410 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc87c01b020 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fc87c014d80 con 0x7fc88c09aa40 2024-09-15T22:49:53.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.983+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc88c15d8c0 con 0x7fc88c09aa40 2024-09-15T22:49:53.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:53.987+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc87c022030 con 0x7fc88c09aa40 2024-09-15T22:49:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.055+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "762dec9c-4049-45ab-94ae-ad29fdc88c0f", "id": 3} v 0) -- 0x7fc88c151590 con 0x7fc88c09aa40 2024-09-15T22:49:54.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.059+0000 7fc883e00640 1 -- 172.21.15.102:0/3579309182 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "762dec9c-4049-45ab-94ae-ad29fdc88c0f", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fc87c010040 con 0x7fc88c09aa40 2024-09-15T22:49:54.061 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-09-15T22:49:54.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 msgr2=0x7fc88c147360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc87c00efc0 tx=0x7fc87c00c490 comp rx=0 tx=0).stop 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 shutdown_connections 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc88c15b330 0x7fc88c1fb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc88c0b53e0 0x7fc88c1563c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 --2- 172.21.15.102:0/3579309182 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc88c09aa40 0x7fc88c147360 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 >> 172.21.15.102:0/3579309182 conn(0x7fc88c073560 msgr2=0x7fc88c0b4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 shutdown_connections 2024-09-15T22:49:54.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.063+0000 7fc892000640 1 -- 172.21.15.102:0/3579309182 wait complete. 2024-09-15T22:49:54.080 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new edbda74d-1465-4bbc-9630-e7d9828d4bb1 4 2024-09-15T22:49:54.114 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.115+0000 7fe67d82c180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:49:54.180 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.179+0000 7ff857c2e180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-15T22:49:54.185 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.183+0000 7fe67d82c180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:49:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 Processor -- start 2024-09-15T22:49:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 -- start start 2024-09-15T22:49:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f619409b2b0 0x7f61940d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61940d0ae0 con 0x7f619409aed0 2024-09-15T22:49:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61940d0dc0 con 0x7f6194070b60 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f619a800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f61940d10a0 con 0x7f619409b2b0 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f6193e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6194070b60 0x7f619415df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56098/0 (socket says 172.21.15.102:56098) 2024-09-15T22:49:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f6193e00640 1 -- 172.21.15.102:0/3429393561 learned_addr learned my addr 172.21.15.102:0/3429393561 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.215+0000 7f618aa00640 1 --2- 172.21.15.102:0/3429393561 >> v2:172.21.15.31:3300/0 conn(0x7f619409b2b0 0x7f61940d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716376976 0 0) 0x7f61940d0dc0 con 0x7f6194070b60 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6178003530 con 0x7f6194070b60 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790124989 0 0) 0x7f61940d0ae0 con 0x7f619409aed0 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61940d0dc0 con 0x7f619409aed0 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f618aa00640 1 -- 172.21.15.102:0/3429393561 >> v1:172.21.15.102:6789/0 conn(0x7f6194070b60 legacy=0x7f619415df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f618aa00640 1 -- 172.21.15.102:0/3429393561 >> v1:172.21.15.31:6789/0 conn(0x7f619409aed0 legacy=0x7f6194070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f618aa00640 1 -- 172.21.15.102:0/3429393561 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61940d1380 con 0x7f619409b2b0 2024-09-15T22:49:54.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f618aa00640 1 --2- 172.21.15.102:0/3429393561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f61940d0490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097c0 tx=0x7f617c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb07f73da3d4fef6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0b0070 con 0x7f619409b2b0 2024-09-15T22:49:54.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c0ab600 con 0x7f619409b2b0 2024-09-15T22:49:54.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.219+0000 7f6192a00640 1 -- 172.21.15.102:0/3429393561 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0ab9b0 con 0x7f619409b2b0 2024-09-15T22:49:54.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- 172.21.15.102:0/3429393561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 msgr2=0x7f61940d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 --2- 172.21.15.102:0/3429393561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f61940d0490 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f617c0097c0 tx=0x7f617c01c410 comp rx=0 tx=0).stop 2024-09-15T22:49:54.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- 172.21.15.102:0/3429393561 shutdown_connections 2024-09-15T22:49:54.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 --2- 172.21.15.102:0/3429393561 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f61940d0490 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- 172.21.15.102:0/3429393561 >> 172.21.15.102:0/3429393561 conn(0x7f61940b3df0 msgr2=0x7f61940b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- 172.21.15.102:0/3429393561 shutdown_connections 2024-09-15T22:49:54.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- 172.21.15.102:0/3429393561 wait complete. 2024-09-15T22:49:54.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 Processor -- start 2024-09-15T22:49:54.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- start start 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6194070b60 0x7f619415aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f6194157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f61940713c0 con 0x7f619409b2b0 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6194071240 con 0x7f619409aed0 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f619a800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f619416cdd0 con 0x7f6194070b60 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f6193400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6194070b60 0x7f619415aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49788/0 (socket says 172.21.15.102:49788) 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 -- 172.21.15.102:0/2643366677 learned_addr learned my addr 172.21.15.102:0/2643366677 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:54.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f6193e00640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f6194157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 -- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6194070b60 msgr2=0x7f619415aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6194070b60 0x7f619415aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 -- 172.21.15.102:0/2643366677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 msgr2=0x7f6194157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f6194157c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.223+0000 7f618aa00640 1 -- 172.21.15.102:0/2643366677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619415a000 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618aa00640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f617c0ae040 tx=0x7f617c0191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0b0040 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f617c0b9070 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f617c0aa9d0 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f619415a2e0 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f619415e150 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f617c0aab70 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f617c0becd0 con 0x7f619409aed0 2024-09-15T22:49:54.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61940d0490 con 0x7f619409aed0 2024-09-15T22:49:54.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.227+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f617c016090 con 0x7f619409aed0 2024-09-15T22:49:54.245 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.243+0000 7ff857c2e180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-15T22:49:54.249 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.251+0000 7fe67d82c180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:49:54.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.295+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edbda74d-1465-4bbc-9630-e7d9828d4bb1", "id": 4} v 0) -- 0x7f61940ce900 con 0x7f619409aed0 2024-09-15T22:49:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f618be00640 1 -- 172.21.15.102:0/2643366677 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edbda74d-1465-4bbc-9630-e7d9828d4bb1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f617c0be460 con 0x7f619409aed0 2024-09-15T22:49:54.302 INFO:teuthology.orchestra.run.smithi102.stdout:4 2024-09-15T22:49:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 msgr2=0x7f619415dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f617c0ae040 tx=0x7f617c0191b0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 shutdown_connections 2024-09-15T22:49:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f619409b2b0 0x7f6194157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f619409aed0 0x7f619415dc10 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 --2- 172.21.15.102:0/2643366677 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6194070b60 0x7f619415aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 >> 172.21.15.102:0/2643366677 conn(0x7f61940b3df0 msgr2=0x7f61940af620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 shutdown_connections 2024-09-15T22:49:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.303+0000 7f619a800640 1 -- 172.21.15.102:0/2643366677 wait complete. 2024-09-15T22:49:54.309 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.307+0000 7ff857c2e180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-15T22:49:54.321 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 9999e18f-1532-4383-bad2-b81c6fb5d480 5 2024-09-15T22:49:54.340 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.339+0000 7fe67d82c180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:49:54.402 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.399+0000 7ff857c2e180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-15T22:49:54.402 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.403+0000 7fe67d82c180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:49:54.465 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.463+0000 7ff857c2e180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-15T22:49:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 Processor -- start 2024-09-15T22:49:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 -- start start 2024-09-15T22:49:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194c09aed0 con 0x7f194c15e640 2024-09-15T22:49:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f194c0b6670 con 0x7f194c06c3d0 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1952a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f194c0b6420 con 0x7f194c09aa40 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1950a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1943e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f194c06c3d0 0x7f194c0ae150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56108/0 (socket says 172.21.15.102:56108) 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1950a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:37382/0 (socket says 172.21.15.102:37382) 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1943e00640 1 -- 172.21.15.102:0/760982678 learned_addr learned my addr 172.21.15.102:0/760982678 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1950a00640 1 -- 172.21.15.102:0/760982678 >> v1:172.21.15.102:6789/0 conn(0x7f194c06c3d0 legacy=0x7f194c0ae150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1950a00640 1 -- 172.21.15.102:0/760982678 >> v1:172.21.15.31:6789/0 conn(0x7f194c15e640 legacy=0x7f194c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f1950a00640 1 -- 172.21.15.102:0/760982678 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c15ea20 con 0x7f194c09aa40 2024-09-15T22:49:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.475+0000 7f194b400640 1 -- 172.21.15.102:0/760982678 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078510881 0 0) 0x7f194c09aed0 con 0x7f194c15e640 2024-09-15T22:49:54.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1950a00640 1 --2- 172.21.15.102:0/760982678 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1944009dc0 tx=0x7f194401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b06f14d6d7c8cd51 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f194b400640 1 -- 172.21.15.102:0/760982678 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440b2070 con 0x7f194c09aa40 2024-09-15T22:49:54.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f194b400640 1 -- 172.21.15.102:0/760982678 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19440a5a20 con 0x7f194c09aa40 2024-09-15T22:49:54.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f194b400640 1 -- 172.21.15.102:0/760982678 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440a5df0 con 0x7f194c09aa40 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 -- 172.21.15.102:0/760982678 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 msgr2=0x7f194c0b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 --2- 172.21.15.102:0/760982678 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f1944009dc0 tx=0x7f194401c960 comp rx=0 tx=0).stop 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 -- 172.21.15.102:0/760982678 shutdown_connections 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 --2- 172.21.15.102:0/760982678 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c09aa40 0x7f194c0b5ee0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 -- 172.21.15.102:0/760982678 >> 172.21.15.102:0/760982678 conn(0x7f194c0b68b0 msgr2=0x7f194c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 -- 172.21.15.102:0/760982678 shutdown_connections 2024-09-15T22:49:54.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.479+0000 7f1952a00640 1 -- 172.21.15.102:0/760982678 wait complete. 2024-09-15T22:49:54.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 Processor -- start 2024-09-15T22:49:54.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- start start 2024-09-15T22:49:54.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f194c06c3d0 0x7f194c148fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f194c09aa40 0x7f194c149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f194c0b2b30 con 0x7f194c09aa40 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f194c0b2610 con 0x7f194c06c3d0 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f194c158100 con 0x7f194c15e640 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:37386/0 (socket says 172.21.15.102:37386) 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 -- 172.21.15.102:0/1754499761 learned_addr learned my addr 172.21.15.102:0/1754499761 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f194be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f194c06c3d0 0x7f194c148fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1943e00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f194c09aa40 0x7f194c149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 -- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f194c06c3d0 msgr2=0x7f194c148fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f194c06c3d0 0x7f194c148fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 -- 172.21.15.102:0/1754499761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f194c09aa40 msgr2=0x7f194c149750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f194c09aa40 0x7f194c149750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 -- 172.21.15.102:0/1754499761 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f194c0cb480 con 0x7f194c15e640 2024-09-15T22:49:54.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1950a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19440b0040 tx=0x7f1944019700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440bd070 con 0x7f194c15e640 2024-09-15T22:49:54.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1944003ba0 con 0x7f194c15e640 2024-09-15T22:49:54.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19440b2040 con 0x7f194c15e640 2024-09-15T22:49:54.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f194c0cb760 con 0x7f194c15e640 2024-09-15T22:49:54.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f194c1494e0 con 0x7f194c15e640 2024-09-15T22:49:54.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f19440ada10 con 0x7f194c15e640 2024-09-15T22:49:54.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f19440047b0 con 0x7f194c15e640 2024-09-15T22:49:54.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.483+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f194c0b5ee0 con 0x7f194c15e640 2024-09-15T22:49:54.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.487+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f1944016580 con 0x7f194c15e640 2024-09-15T22:49:54.495 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.495+0000 7fe67d82c180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:49:54.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.559+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9999e18f-1532-4383-bad2-b81c6fb5d480", "id": 5} v 0) -- 0x7f194c1582b0 con 0x7f194c15e640 2024-09-15T22:49:54.558 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.555+0000 7ff857c2e180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-15T22:49:54.561 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.559+0000 7fe67d82c180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:49:54.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.559+0000 7f1948c00640 1 -- 172.21.15.102:0/1754499761 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9999e18f-1532-4383-bad2-b81c6fb5d480", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f19440add00 con 0x7f194c15e640 2024-09-15T22:49:54.561 INFO:teuthology.orchestra.run.smithi102.stdout:5 2024-09-15T22:49:54.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 msgr2=0x7f194c150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f19440b0040 tx=0x7f1944019700 comp rx=0 tx=0).stop 2024-09-15T22:49:54.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 shutdown_connections 2024-09-15T22:49:54.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f194c15e640 0x7f194c150bd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f194c09aa40 0x7f194c149750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 --2- 172.21.15.102:0/1754499761 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f194c06c3d0 0x7f194c148fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 >> 172.21.15.102:0/1754499761 conn(0x7f194c0b68b0 msgr2=0x7f194c0ae150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 shutdown_connections 2024-09-15T22:49:54.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.563+0000 7f1952a00640 1 -- 172.21.15.102:0/1754499761 wait complete. 2024-09-15T22:49:54.581 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new f9096bba-6933-4732-bf4d-acce049c90f8 6 2024-09-15T22:49:54.627 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.627+0000 7ff857c2e180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-15T22:49:54.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 Processor -- start 2024-09-15T22:49:54.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 -- start start 2024-09-15T22:49:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e40b1b60 con 0x7fd1e40b1780 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1e41601a0 con 0x7fd1e409af80 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e9800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e4160440 con 0x7fd1e409bb10 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1dbe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e3400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd1e409af80 0x7fd1e40ccc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56118/0 (socket says 172.21.15.102:56118) 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e3400640 1 -- 172.21.15.102:0/17610179 learned_addr learned my addr 172.21.15.102:0/17610179 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:54.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1dbe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.102:37396/0 (socket says 172.21.15.102:37396) 2024-09-15T22:49:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1dbe00640 1 -- 172.21.15.102:0/17610179 >> v1:172.21.15.102:6789/0 conn(0x7fd1e409af80 legacy=0x7fd1e40ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1dbe00640 1 -- 172.21.15.102:0/17610179 >> v1:172.21.15.31:6789/0 conn(0x7fd1e40b1780 legacy=0x7fd1e4071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1e2000640 1 -- 172.21.15.102:0/17610179 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646295739 0 0) 0x7fd1e41601a0 con 0x7fd1e409af80 2024-09-15T22:49:54.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.719+0000 7fd1dbe00640 1 -- 172.21.15.102:0/17610179 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e4160720 con 0x7fd1e409bb10 2024-09-15T22:49:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1dbe00640 1 --2- 172.21.15.102:0/17610179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0097f0 tx=0x7fd1cc01c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8ac5755f284fb11 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e2000640 1 -- 172.21.15.102:0/17610179 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0b0070 con 0x7fd1e409bb10 2024-09-15T22:49:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e2000640 1 -- 172.21.15.102:0/17610179 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1cc0ab400 con 0x7fd1e409bb10 2024-09-15T22:49:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e2000640 1 -- 172.21.15.102:0/17610179 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1cc0ab7d0 con 0x7fd1e409bb10 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 -- 172.21.15.102:0/17610179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 msgr2=0x7fd1e409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 --2- 172.21.15.102:0/17610179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fd1cc0097f0 tx=0x7fd1cc01c2e0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 -- 172.21.15.102:0/17610179 shutdown_connections 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 --2- 172.21.15.102:0/17610179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e409bb10 0x7fd1e409aa40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 -- 172.21.15.102:0/17610179 >> 172.21.15.102:0/17610179 conn(0x7fd1e40b3df0 msgr2=0x7fd1e40b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 -- 172.21.15.102:0/17610179 shutdown_connections 2024-09-15T22:49:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.723+0000 7fd1e9800640 1 -- 172.21.15.102:0/17610179 wait complete. 2024-09-15T22:49:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 Processor -- start 2024-09-15T22:49:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- start start 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 0x7fd1e406e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e409bb10 0x7fd1e414f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 0x7fd1e40cfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40cdf20 con 0x7fd1e409bb10 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1e40cdda0 con 0x7fd1e409af80 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1e40ce0a0 con 0x7fd1e40b1780 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 0x7fd1e406e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 0x7fd1e40cfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 0x7fd1e406e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49802/0 (socket says 172.21.15.102:49802) 2024-09-15T22:49:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e2a00640 1 -- 172.21.15.102:0/904421301 learned_addr learned my addr 172.21.15.102:0/904421301 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1dbe00640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e409bb10 0x7fd1e414f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 -- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 msgr2=0x7fd1e406e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 0x7fd1e406e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 -- 172.21.15.102:0/904421301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e409bb10 msgr2=0x7fd1e414f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e409bb10 0x7fd1e414f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 -- 172.21.15.102:0/904421301 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1e41659f0 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e3400640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 0x7fd1e40cfed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c750 tx=0x7fd1dc00cc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc018070 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1dc004d80 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1e4165cd0 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1dc00a880 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.727+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1e40c93d0 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.731+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd1dc01b070 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.731+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fd1dc007760 con 0x7fd1e40b1780 2024-09-15T22:49:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.731+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1e40c96f0 con 0x7fd1e40b1780 2024-09-15T22:49:54.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.735+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fd1dc0070d0 con 0x7fd1e40b1780 2024-09-15T22:49:54.740 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.739+0000 7fe67d82c180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:49:54.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.803+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f9096bba-6933-4732-bf4d-acce049c90f8", "id": 6} v 0) -- 0x7fd1e409aa40 con 0x7fd1e40b1780 2024-09-15T22:49:54.804 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.803+0000 7ff857c2e180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-15T22:49:54.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1daa00640 1 -- 172.21.15.102:0/904421301 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9096bba-6933-4732-bf4d-acce049c90f8", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fd1dc0072b0 con 0x7fd1e40b1780 2024-09-15T22:49:54.805 INFO:teuthology.orchestra.run.smithi102.stdout:6 2024-09-15T22:49:54.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 msgr2=0x7fd1e40cfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 0x7fd1e40cfed0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fd1dc00c750 tx=0x7fd1dc00cc10 comp rx=0 tx=0).stop 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 shutdown_connections 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1e40b1780 0x7fd1e40cfed0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1e409bb10 0x7fd1e414f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 --2- 172.21.15.102:0/904421301 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1e409af80 0x7fd1e406e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 >> 172.21.15.102:0/904421301 conn(0x7fd1e40b3df0 msgr2=0x7fd1e40b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 shutdown_connections 2024-09-15T22:49:54.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.807+0000 7fd1e9800640 1 -- 172.21.15.102:0/904421301 wait complete. 2024-09-15T22:49:54.814 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:54.815+0000 7fe67d82c180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:49:54.825 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 8fdb18df-b9ef-4577-803b-1292f61dd25f 7 2024-09-15T22:49:54.878 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:54.875+0000 7ff857c2e180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-15T22:49:54.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 Processor -- start 2024-09-15T22:49:54.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 -- start start 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa82c15fda0 0x7fa82c1601f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0b5d30 con 0x7fa82c160940 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0b4580 con 0x7fa82c156900 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.959+0000 7fa831e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa82c156ce0 con 0x7fa82c15fda0 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82aa00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa82c156900 0x7fa82c0b3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.102:56132/0 (socket says 172.21.15.102:56132) 2024-09-15T22:49:54.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82aa00640 1 -- 172.21.15.102:0/2976441842 learned_addr learned my addr 172.21.15.102:0/2976441842 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-15T22:49:54.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82b400640 1 --2- 172.21.15.102:0/2976441842 >> v2:172.21.15.31:3300/0 conn(0x7fa82c15fda0 0x7fa82c1601f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1766929025 0 0) 0x7fa82c0b4580 con 0x7fa82c156900 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa810003530 con 0x7fa82c156900 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012232290 0 0) 0x7fa82c0b5d30 con 0x7fa82c160940 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa82c0b4580 con 0x7fa82c160940 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2854847023 0 0) 0x7fa810003530 con 0x7fa82c156900 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82b400640 1 -- 172.21.15.102:0/2976441842 >> v1:172.21.15.102:6789/0 conn(0x7fa82c156900 legacy=0x7fa82c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82b400640 1 -- 172.21.15.102:0/2976441842 >> v1:172.21.15.31:6789/0 conn(0x7fa82c160940 legacy=0x7fa82c0b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82b400640 1 -- 172.21.15.102:0/2976441842 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0b4860 con 0x7fa82c15fda0 2024-09-15T22:49:54.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.963+0000 7fa82b400640 1 --2- 172.21.15.102:0/2976441842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c15fda0 0x7fa82c1601f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa824009740 tx=0x7fa82401c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20303c9bfcf5bbc3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8240b0070 con 0x7fa82c15fda0 2024-09-15T22:49:54.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8240ab400 con 0x7fa82c15fda0 2024-09-15T22:49:54.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa829600640 1 -- 172.21.15.102:0/2976441842 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81c001a00 con 0x7fa82c15fda0 2024-09-15T22:49:54.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- 172.21.15.102:0/2976441842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c15fda0 msgr2=0x7fa82c1601f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 --2- 172.21.15.102:0/2976441842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c15fda0 0x7fa82c1601f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa824009740 tx=0x7fa82401c360 comp rx=0 tx=0).stop 2024-09-15T22:49:54.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- 172.21.15.102:0/2976441842 shutdown_connections 2024-09-15T22:49:54.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 --2- 172.21.15.102:0/2976441842 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c15fda0 0x7fa82c1601f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- 172.21.15.102:0/2976441842 >> 172.21.15.102:0/2976441842 conn(0x7fa82c073680 msgr2=0x7fa82c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:54.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- 172.21.15.102:0/2976441842 shutdown_connections 2024-09-15T22:49:54.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- 172.21.15.102:0/2976441842 wait complete. 2024-09-15T22:49:54.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 Processor -- start 2024-09-15T22:49:54.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- start start 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c156900 0x7fa82c14a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 0x7fa82c149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c16a0c0 con 0x7fa82c156900 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa82c169f40 con 0x7fa82c15fda0 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa831e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa82c16a240 con 0x7fa82c160940 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa82a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa82aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c156900 0x7fa82c14a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa82b400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 0x7fa82c149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa82a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.102:49810/0 (socket says 172.21.15.102:49810) 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.967+0000 7fa82a000640 1 -- 172.21.15.102:0/4143576205 learned_addr learned my addr 172.21.15.102:0/4143576205 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-15T22:49:54.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 -- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 msgr2=0x7fa82c149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 0x7fa82c149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 -- 172.21.15.102:0/4143576205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c156900 msgr2=0x7fa82c14a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c156900 0x7fa82c14a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 -- 172.21.15.102:0/4143576205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c14bc00 con 0x7fa82c15fda0 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82b400640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 0x7fa82c149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa82a000640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c430 tx=0x7fa81800c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818017070 con 0x7fa82c15fda0 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8180052f0 con 0x7fa82c15fda0 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c0707c0 con 0x7fa82c15fda0 2024-09-15T22:49:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa818003840 con 0x7fa82c15fda0 2024-09-15T22:49:54.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa82c14c180 con 0x7fa82c15fda0 2024-09-15T22:49:54.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa81801a070 con 0x7fa82c15fda0 2024-09-15T22:49:54.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fa818011590 con 0x7fa82c15fda0 2024-09-15T22:49:54.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa82c1601f0 con 0x7fa82c15fda0 2024-09-15T22:49:54.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:54.971+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa818021020 con 0x7fa82c15fda0 2024-09-15T22:49:55.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.043+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8fdb18df-b9ef-4577-803b-1292f61dd25f", "id": 7} v 0) -- 0x7fa82c15ee20 con 0x7fa82c15fda0 2024-09-15T22:49:55.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.047+0000 7fa823400640 1 -- 172.21.15.102:0/4143576205 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8fdb18df-b9ef-4577-803b-1292f61dd25f", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fa818011bd0 con 0x7fa82c15fda0 2024-09-15T22:49:55.049 INFO:teuthology.orchestra.run.smithi102.stdout:7 2024-09-15T22:49:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 msgr2=0x7fa82c070280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c430 tx=0x7fa81800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 shutdown_connections 2024-09-15T22:49:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa82c160940 0x7fa82c149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa82c15fda0 0x7fa82c070280 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 --2- 172.21.15.102:0/4143576205 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa82c156900 0x7fa82c14a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 >> 172.21.15.102:0/4143576205 conn(0x7fa82c073680 msgr2=0x7fa82c0b3c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 shutdown_connections 2024-09-15T22:49:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:49:55.051+0000 7fa831e00640 1 -- 172.21.15.102:0/4143576205 wait complete. 2024-09-15T22:49:55.068 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-15T22:49:55.068 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-15T22:49:55.071 INFO:tasks.ceph.osd.0:Started 2024-09-15T22:49:55.071 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-15T22:49:55.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-15T22:49:55.074 INFO:tasks.ceph.osd.1:Started 2024-09-15T22:49:55.074 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-15T22:49:55.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-15T22:49:55.077 INFO:tasks.ceph.osd.2:Started 2024-09-15T22:49:55.078 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-15T22:49:55.078 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-15T22:49:55.081 INFO:tasks.ceph.osd.3:Started 2024-09-15T22:49:55.081 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-15T22:49:55.081 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-15T22:49:55.084 INFO:tasks.ceph.osd.4:Started 2024-09-15T22:49:55.084 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-15T22:49:55.085 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-15T22:49:55.088 INFO:tasks.ceph.osd.5:Started 2024-09-15T22:49:55.088 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-15T22:49:55.088 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-15T22:49:55.091 INFO:tasks.ceph.osd.6:Started 2024-09-15T22:49:55.091 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-15T22:49:55.092 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-15T22:49:55.094 INFO:tasks.ceph.osd.7:Started 2024-09-15T22:49:55.095 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:49:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 Processor -- start 2024-09-15T22:49:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 -- start start 2024-09-15T22:49:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2dc15e6d0 0x7fa2dc15f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2dc0d0c70 con 0x7fa2dc09af80 2024-09-15T22:49:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa2dc15fcb0 con 0x7fa2dc15e6d0 2024-09-15T22:49:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.295+0000 7fa2e2c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc160040 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2dbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2dc15e6d0 0x7fa2dc15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:55398/0 (socket says 172.21.15.31:55398) 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 -- 172.21.15.31:0/1922587250 learned_addr learned my addr 172.21.15.31:0/1922587250 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 -- 172.21.15.31:0/1922587250 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc15e6d0 msgr2=0x7fa2dc15f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 --2- 172.21.15.31:0/1922587250 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc15e6d0 0x7fa2dc15f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 -- 172.21.15.31:0/1922587250 >> v1:172.21.15.31:6789/0 conn(0x7fa2dc09af80 legacy=0x7fa2dc161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 -- 172.21.15.31:0/1922587250 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc0d0f50 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2d3400640 1 --2- 172.21.15.31:0/1922587250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098a0 tx=0x7fa2c401c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5499299fd49445a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2db400640 1 -- 172.21.15.31:0/1922587250 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40ab430 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2db400640 1 -- 172.21.15.31:0/1922587250 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2c40b0070 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.299+0000 7fa2db400640 1 -- 172.21.15.31:0/1922587250 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40ab7f0 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1922587250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 msgr2=0x7fa2dc09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1922587250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa2c40098a0 tx=0x7fa2c401c540 comp rx=0 tx=0).stop 2024-09-15T22:49:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1922587250 shutdown_connections 2024-09-15T22:49:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1922587250 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc0d04b0 0x7fa2dc09aa40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1922587250 >> v2:172.21.15.31:3300/0 conn(0x7fa2dc15e6d0 0x7fa2dc15f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1922587250 >> 172.21.15.31:0/1922587250 conn(0x7fa2dc0d23b0 msgr2=0x7fa2dc0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1922587250 shutdown_connections 2024-09-15T22:49:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1922587250 wait complete. 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 Processor -- start 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- start start 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2dc0d04b0 0x7fa2dc0b2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc15e6d0 0x7fa2dc15c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc161f30 con 0x7fa2dc09af80 2024-09-15T22:49:55.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa2dc0d17f0 con 0x7fa2dc0d04b0 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e2c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa2dc0d08f0 con 0x7fa2dc15e6d0 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45648/0 (socket says 172.21.15.31:45648) 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 -- 172.21.15.31:0/1516738261 learned_addr learned my addr 172.21.15.31:0/1516738261 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2e0c00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc15e6d0 0x7fa2dc15c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2d3400640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2dc0d04b0 0x7fa2dc0b2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 -- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc15e6d0 msgr2=0x7fa2dc15c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc15e6d0 0x7fa2dc15c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 -- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2dc0d04b0 msgr2=0x7fa2dc0b2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2dc0d04b0 0x7fa2dc0b2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.303+0000 7fa2dbe00640 1 -- 172.21.15.31:0/1516738261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2dc1592d0 con 0x7fa2dc09af80 2024-09-15T22:49:55.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2dbe00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00e870 tx=0x7fa2cc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc017070 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2cc00c940 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2dc159570 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2cc00ccf0 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2dc159b30 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa2cc01a070 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa2cc013b40 con 0x7fa2dc09af80 2024-09-15T22:49:55.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2dc09aa40 con 0x7fa2dc09af80 2024-09-15T22:49:55.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.307+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa2cc013e20 con 0x7fa2dc09af80 2024-09-15T22:49:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2dc09b570 con 0x7fa2dc09af80 2024-09-15T22:49:55.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2d8c00640 1 -- 172.21.15.31:0/1516738261 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa2cc0064d0 con 0x7fa2dc09af80 2024-09-15T22:49:55.385 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:49:55.385 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":10,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:49:55.045078+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 msgr2=0x7fa2dc14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc00e870 tx=0x7fa2cc00ec70 comp rx=0 tx=0).stop 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 shutdown_connections 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2dc15e6d0 0x7fa2dc15c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2dc0d04b0 0x7fa2dc0b2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 --2- 172.21.15.31:0/1516738261 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2dc09af80 0x7fa2dc14e870 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 >> 172.21.15.31:0/1516738261 conn(0x7fa2dc0d23b0 msgr2=0x7fa2dc0d1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 shutdown_connections 2024-09-15T22:49:55.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:49:55.383+0000 7fa2e2c00640 1 -- 172.21.15.31:0/1516738261 wait complete. 2024-09-15T22:49:55.407 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-15T22:49:55.407 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-15T22:49:55.476 INFO:tasks.ceph.mgr.x.smithi102.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T22:49:55.477 INFO:tasks.ceph.mgr.x.smithi102.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T22:49:55.477 INFO:tasks.ceph.mgr.x.smithi102.stderr: from numpy import show_config as show_numpy_config 2024-09-15T22:49:55.535 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:55.535+0000 7fe67d82c180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:49:55.587 INFO:tasks.ceph.mgr.y.smithi031.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-15T22:49:55.587 INFO:tasks.ceph.mgr.y.smithi031.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-15T22:49:55.587 INFO:tasks.ceph.mgr.y.smithi031.stderr: from numpy import show_config as show_numpy_config 2024-09-15T22:49:55.625 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:55.623+0000 7ff857c2e180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-15T22:49:55.684 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:55.683+0000 7fe67d82c180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:49:55.781 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:55.779+0000 7ff857c2e180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:49:55.861 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:55.859+0000 7fe67d82c180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:49:55.934 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:55.935+0000 7fe67d82c180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:49:55.965 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:55.963+0000 7ff857c2e180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-15T22:49:56.041 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:56.039+0000 7ff857c2e180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-15T22:49:56.086 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:56.087+0000 7fe67d82c180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:49:56.200 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:56.199+0000 7ff857c2e180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-15T22:49:56.213 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:49:56.344 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 Processor -- start 2024-09-15T22:49:56.492 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 -- start start 2024-09-15T22:49:56.496 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 0x7f28140add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.496 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f28140b41c0 0x7f28140cd4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f281415c520 con 0x7f28140ae290 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f28140cd040 con 0x7f28140b41c0 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f28140ae6d0 con 0x7f281415c140 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f280a000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f28140ae290 0x7f28140b3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53274/0 (socket says 172.21.15.31:53274) 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f280a000640 1 -- 172.21.15.31:0/3764485654 learned_addr learned my addr 172.21.15.31:0/3764485654 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813400640 1 --2- 172.21.15.31:0/3764485654 >> v2:172.21.15.102:3300/0 conn(0x7f28140b41c0 0x7f28140cd4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2812a00640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 0x7f28140add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2812000640 1 -- 172.21.15.31:0/3764485654 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009608819 0 0) 0x7f281415c520 con 0x7f28140ae290 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2812000640 1 -- 172.21.15.31:0/3764485654 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f27f8003530 con 0x7f28140ae290 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813400640 1 -- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 msgr2=0x7f28140add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813400640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 0x7f28140add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.497 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813400640 1 -- 172.21.15.31:0/3764485654 >> v1:172.21.15.31:6789/0 conn(0x7f28140ae290 legacy=0x7f28140b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2813400640 1 -- 172.21.15.31:0/3764485654 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28140b47c0 con 0x7f28140b41c0 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.343+0000 7f2812a00640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 0x7f28140add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813400640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140b41c0 0x7f28140cd4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f280c009d90 tx=0x7f280c01c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516d4888f5b66cb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2812000640 1 -- 172.21.15.31:0/3764485654 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0b2070 con 0x7f28140b41c0 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2812000640 1 -- 172.21.15.31:0/3764485654 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c0a5a00 con 0x7f28140b41c0 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2812000640 1 -- 172.21.15.31:0/3764485654 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0a5db0 con 0x7f28140b41c0 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 -- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140b41c0 msgr2=0x7f28140cd4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140b41c0 0x7f28140cd4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f280c009d90 tx=0x7f280c01c940 comp rx=0 tx=0).stop 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 -- 172.21.15.31:0/3764485654 shutdown_connections 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140b41c0 0x7f28140cd4d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 --2- 172.21.15.31:0/3764485654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f281415c140 0x7f28140add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 -- 172.21.15.31:0/3764485654 >> 172.21.15.31:0/3764485654 conn(0x7f281406bcc0 msgr2=0x7f281406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.498 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 -- 172.21.15.31:0/3764485654 shutdown_connections 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.347+0000 7f2813e00640 1 -- 172.21.15.31:0/3764485654 wait complete. 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 Processor -- start 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- start start 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140ae290 0x7f281415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28140b41c0 0x7f281415e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f28140ce3a0 con 0x7f281415c140 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f28140ce220 con 0x7f28140ae290 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f28140ce520 con 0x7f28140b41c0 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45654/0 (socket says 172.21.15.31:45654) 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28140b41c0 0x7f281415e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.499 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 -- 172.21.15.31:0/3005543431 learned_addr learned my addr 172.21.15.31:0/3005543431 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2812a00640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140ae290 0x7f281415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 -- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28140b41c0 msgr2=0x7f281415e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28140b41c0 0x7f281415e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 -- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140ae290 msgr2=0x7f281415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140ae290 0x7f281415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 -- 172.21.15.31:0/3005543431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f281415f1c0 con 0x7f281415c140 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813400640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f280c0b0040 tx=0x7f280c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0b2050 con 0x7f281415c140 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f280c0be070 con 0x7f281415c140 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f280c0ada70 con 0x7f281415c140 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28141574b0 con 0x7f281415c140 2024-09-15T22:49:56.500 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f281415eee0 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f280c0adc10 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f280c0b9450 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.351+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28140cd4d0 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.355+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f280c016560 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2814072f50 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f280b400640 1 -- 172.21.15.31:0/3005543431 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f280c0c3460 con 0x7f281415c140 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-15T22:49:56.501 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":10,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:49:55.045078+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:49:56.502 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 msgr2=0x7f2814165780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f280c0b0040 tx=0x7f280c0196e0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 shutdown_connections 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f281415c140 0x7f2814165780 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f28140b41c0 0x7f281415e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 --2- 172.21.15.31:0/3005543431 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f28140ae290 0x7f281415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 >> 172.21.15.31:0/3005543431 conn(0x7f281406bcc0 msgr2=0x7f2814073750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.455+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 shutdown_connections 2024-09-15T22:49:56.503 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:49:56.459+0000 7f2813e00640 1 -- 172.21.15.31:0/3005543431 wait complete. 2024-09-15T22:49:56.504 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:49:56.529 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-15T22:49:56.527+0000 7f30d26287c0 -1 Falling back to public interface 2024-09-15T22:49:56.529 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-15T22:49:56.527+0000 7fa207e5b7c0 -1 Falling back to public interface 2024-09-15T22:49:56.529 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-15T22:49:56.527+0000 7fa206a00640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6801/0: (98) Address already in use 2024-09-15T22:49:56.548 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-15T22:49:56.547+0000 7f2af91517c0 -1 Falling back to public interface 2024-09-15T22:49:56.571 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-15T22:49:56.571+0000 7fc68059b7c0 -1 Falling back to public interface 2024-09-15T22:49:56.725 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-15T22:49:56.723+0000 7fe30f1887c0 -1 Falling back to public interface 2024-09-15T22:49:56.759 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:56.759+0000 7fe67d82c180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:49:56.846 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:56.847+0000 7fe67d82c180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:49:56.858 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-15T22:49:56.859+0000 7f7ce324a7c0 -1 Falling back to public interface 2024-09-15T22:49:56.870 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-15T22:49:56.871+0000 7f49015fb7c0 -1 Falling back to public interface 2024-09-15T22:49:56.996 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:56.995+0000 7ff857c2e180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-15T22:49:57.050 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:57.051+0000 7fe67d82c180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:49:57.088 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:57.087+0000 7ff857c2e180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-15T22:49:57.134 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:57.135+0000 7fe67d82c180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:49:57.191 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-15T22:49:57.191+0000 7f31f92ba7c0 -1 Falling back to public interface 2024-09-15T22:49:57.302 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:57.299+0000 7ff857c2e180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-15T22:49:57.392 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:57.391+0000 7ff857c2e180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-15T22:49:57.464 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:57.463+0000 7fe67d82c180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:49:57.535 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:57.535+0000 7fe67d82c180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:49:57.746 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:57.743+0000 7ff857c2e180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-15T22:49:57.821 INFO:tasks.ceph.mgr.y.smithi031.stderr:2024-09-15T22:49:57.819+0000 7ff857c2e180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-15T22:49:58.558 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:58.559+0000 7fe621e00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-15T22:49:58.558 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-15T22:49:58.559+0000 7fe621e00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-15T22:50:00.811 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-15T22:50:00.811+0000 7fc68059b7c0 -1 osd.4 0 log_to_monitors true 2024-09-15T22:50:00.974 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-15T22:50:00.970+0000 7fa207e5b7c0 -1 osd.2 0 log_to_monitors true 2024-09-15T22:50:00.999 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-15T22:50:00.994+0000 7fe30f1887c0 -1 osd.1 0 log_to_monitors true 2024-09-15T22:50:01.051 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-15T22:50:01.050+0000 7f7ce324a7c0 -1 osd.6 0 log_to_monitors true 2024-09-15T22:50:01.170 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-15T22:50:01.166+0000 7f2af91517c0 -1 osd.3 0 log_to_monitors true 2024-09-15T22:50:01.286 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-15T22:50:01.282+0000 7f30d26287c0 -1 osd.0 0 log_to_monitors true 2024-09-15T22:50:01.483 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-15T22:50:01.478+0000 7f49015fb7c0 -1 osd.7 0 log_to_monitors true 2024-09-15T22:50:01.689 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-15T22:50:01.686+0000 7f31f92ba7c0 -1 osd.5 0 log_to_monitors true 2024-09-15T22:50:03.310 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:03.477 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 Processor -- start 2024-09-15T22:50:03.477 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 -- start start 2024-09-15T22:50:03.478 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 0x7f7acc0b6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:03.478 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7acc15c850 con 0x7f7acc159ca0 2024-09-15T22:50:03.478 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7acc15cb30 con 0x7f7acc09b130 2024-09-15T22:50:03.478 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad3a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc15ce10 con 0x7f7acc15e980 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7acc159ca0 0x7f7acc09aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:53284/0 (socket says 172.21.15.31:53284) 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1000640 1 -- 172.21.15.31:0/276248102 learned_addr learned my addr 172.21.15.31:0/276248102 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1a00640 1 --2- 172.21.15.31:0/276248102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 0x7f7acc0b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598203112 0 0) 0x7f7acc15c850 con 0x7f7acc159ca0 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab4003530 con 0x7f7acc159ca0 2024-09-15T22:50:03.479 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640016854 0 0) 0x7f7acc15cb30 con 0x7f7acc09b130 2024-09-15T22:50:03.480 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7acc15c850 con 0x7f7acc09b130 2024-09-15T22:50:03.480 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1a00640 1 -- 172.21.15.31:0/276248102 >> v1:172.21.15.102:6789/0 conn(0x7f7acc09b130 legacy=0x7f7acc0b5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.480 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1a00640 1 -- 172.21.15.31:0/276248102 >> v1:172.21.15.31:6789/0 conn(0x7f7acc159ca0 legacy=0x7f7acc09aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.480 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.474+0000 7f7ad1a00640 1 -- 172.21.15.31:0/276248102 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc15d0f0 con 0x7f7acc15e980 2024-09-15T22:50:03.482 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad1a00640 1 --2- 172.21.15.31:0/276248102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 0x7f7acc0b6630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009dc0 tx=0x7f7ac401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d41b565b4d2118f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:03.483 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b2070 con 0x7f7acc15e980 2024-09-15T22:50:03.483 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40a5a00 con 0x7f7acc15e980 2024-09-15T22:50:03.483 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7acb400640 1 -- 172.21.15.31:0/276248102 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40a5dd0 con 0x7f7acc15e980 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 -- 172.21.15.31:0/276248102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 msgr2=0x7f7acc0b6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/276248102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 0x7f7acc0b6630 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009dc0 tx=0x7f7ac401c960 comp rx=0 tx=0).stop 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 -- 172.21.15.31:0/276248102 shutdown_connections 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/276248102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc15e980 0x7f7acc0b6630 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 -- 172.21.15.31:0/276248102 >> 172.21.15.31:0/276248102 conn(0x7f7acc0b7a00 msgr2=0x7f7acc0b3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 -- 172.21.15.31:0/276248102 shutdown_connections 2024-09-15T22:50:03.484 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.478+0000 7f7ad3a00640 1 -- 172.21.15.31:0/276248102 wait complete. 2024-09-15T22:50:03.485 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 Processor -- start 2024-09-15T22:50:03.485 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 -- start start 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc09b130 0x7f7acc14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7acc159ca0 0x7f7acc0b2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc169a40 con 0x7f7acc15e980 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7acc1698c0 con 0x7f7acc159ca0 2024-09-15T22:50:03.487 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad3a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7acc169bc0 con 0x7f7acc09b130 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:45680/0 (socket says 172.21.15.31:45680) 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 -- 172.21.15.31:0/1310239697 learned_addr learned my addr 172.21.15.31:0/1310239697 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1000640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc09b130 0x7f7acc14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7acbe00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7acc159ca0 0x7f7acc0b2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 -- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc09b130 msgr2=0x7f7acc14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc09b130 0x7f7acc14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 -- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7acc159ca0 msgr2=0x7f7acc0b2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7acc159ca0 0x7f7acc0b2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 -- 172.21.15.31:0/1310239697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7acc0b15b0 con 0x7f7acc15e980 2024-09-15T22:50:03.488 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.482+0000 7f7ad1a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4019570 tx=0x7f7ac4019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:03.489 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40b2050 con 0x7f7acc15e980 2024-09-15T22:50:03.489 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac40be070 con 0x7f7acc15e980 2024-09-15T22:50:03.490 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7acc0b1890 con 0x7f7acc15e980 2024-09-15T22:50:03.490 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40ada90 con 0x7f7acc15e980 2024-09-15T22:50:03.490 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7acc0b1e50 con 0x7f7acc15e980 2024-09-15T22:50:03.490 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7acc09aa20 con 0x7f7acc15e980 2024-09-15T22:50:03.490 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 4) ==== 87389+0+0 (secure 0 0 0) 0x7f7ac40adc30 con 0x7f7acc15e980 2024-09-15T22:50:03.491 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 0x7f7aac069cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:03.491 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2215+0+0 (secure 0 0 0) 0x7f7ac411ff50 con 0x7f7acc15e980 2024-09-15T22:50:03.491 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.486+0000 7f7ad1000640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 0x7f7aac069cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:03.492 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.490+0000 7f7ad1000640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 0x7f7aac069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0007fd0 tx=0x7f7ac0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:03.496 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.494+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ac4016580 con 0x7f7acc15e980 2024-09-15T22:50:03.719 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.714+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7acc15c0f0 con 0x7f7acc15e980 2024-09-15T22:50:03.720 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.718+0000 7f7ac8c00640 1 -- 172.21.15.31:0/1310239697 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7f7ac40f1220 con 0x7f7acc15e980 2024-09-15T22:50:03.721 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-15T22:50:03.721 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":12,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:02.603734+0000","last_up_change":"0.000000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:03.723 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.718+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 msgr2=0x7f7aac069cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.723 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.718+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 0x7f7aac069cf0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0007fd0 tx=0x7f7ac0009040 comp rx=0 tx=0).stop 2024-09-15T22:50:03.723 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.718+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 msgr2=0x7f7acc0d1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:03.723 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.718+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4019570 tx=0x7f7ac4019700 comp rx=0 tx=0).stop 2024-09-15T22:50:03.724 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 shutdown_connections 2024-09-15T22:50:03.724 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7aac067830 0x7f7aac069cf0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.724 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7acc15e980 0x7f7acc0d1400 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.724 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7acc159ca0 0x7f7acc0b2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.724 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 --2- 172.21.15.31:0/1310239697 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7acc09b130 0x7f7acc14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:03.725 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 >> 172.21.15.31:0/1310239697 conn(0x7f7acc0b7a00 msgr2=0x7f7acc070d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:03.725 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 shutdown_connections 2024-09-15T22:50:03.725 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:03.722+0000 7f7ad3a00640 1 -- 172.21.15.31:0/1310239697 wait complete. 2024-09-15T22:50:03.744 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-15T22:50:04.535 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-15T22:50:04.534+0000 7f7cde200640 -1 osd.6 0 waiting for initial osdmap 2024-09-15T22:50:04.567 INFO:tasks.ceph.osd.6.smithi102.stderr:2024-09-15T22:50:04.566+0000 7f7cd4200640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:04.626 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-15T22:50:04.626+0000 7f48fc400640 -1 osd.7 0 waiting for initial osdmap 2024-09-15T22:50:04.654 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-15T22:50:04.654+0000 7fc67b400640 -1 osd.4 0 waiting for initial osdmap 2024-09-15T22:50:04.656 INFO:tasks.ceph.osd.7.smithi102.stderr:2024-09-15T22:50:04.654+0000 7f48f2400640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:04.687 INFO:tasks.ceph.osd.4.smithi102.stderr:2024-09-15T22:50:04.686+0000 7fc671400640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:04.928 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-15T22:50:04.922+0000 7f2af4000640 -1 osd.3 0 waiting for initial osdmap 2024-09-15T22:50:04.953 INFO:tasks.ceph.osd.3.smithi031.stderr:2024-09-15T22:50:04.950+0000 7f2aea000640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:04.977 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-15T22:50:04.974+0000 7f31f4200640 -1 osd.5 0 waiting for initial osdmap 2024-09-15T22:50:04.989 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-15T22:50:04.986+0000 7f30cd400640 -1 osd.0 0 waiting for initial osdmap 2024-09-15T22:50:04.998 INFO:tasks.ceph.osd.5.smithi102.stderr:2024-09-15T22:50:04.998+0000 7f31ea200640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:05.006 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-15T22:50:05.002+0000 7fa202e00640 -1 osd.2 0 waiting for initial osdmap 2024-09-15T22:50:05.021 INFO:tasks.ceph.osd.0.smithi031.stderr:2024-09-15T22:50:05.018+0000 7f30c3400640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:05.023 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-15T22:50:05.018+0000 7fe30a000640 -1 osd.1 0 waiting for initial osdmap 2024-09-15T22:50:05.032 INFO:tasks.ceph.osd.2.smithi031.stderr:2024-09-15T22:50:05.030+0000 7fa1f8e00640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:05.073 INFO:tasks.ceph.osd.1.smithi031.stderr:2024-09-15T22:50:05.070+0000 7fe300000640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-15T22:50:10.551 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:10.689 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 Processor -- start 2024-09-15T22:50:10.689 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 -- start start 2024-09-15T22:50:10.690 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d006ec20 0x7f03d009b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.691 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f03d006d440 0x7f03d006d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.691 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03d00d0c90 con 0x7f03d0161ea0 2024-09-15T22:50:10.691 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f03d0162280 con 0x7f03d006ec20 2024-09-15T22:50:10.691 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d7c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f03d00b3cc0 con 0x7f03d006d440 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d006ec20 0x7f03d009b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f03d006ec20 0x7f03d009b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58038/0 (socket says 172.21.15.31:58038) 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 -- 172.21.15.31:0/3353352898 learned_addr learned my addr 172.21.15.31:0/3353352898 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03d5c00640 1 --2- 172.21.15.31:0/3353352898 >> v2:172.21.15.102:3300/0 conn(0x7f03d006d440 0x7f03d006d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 -- 172.21.15.31:0/3353352898 >> v2:172.21.15.102:3300/0 conn(0x7f03d006d440 msgr2=0x7f03d006d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 --2- 172.21.15.31:0/3353352898 >> v2:172.21.15.102:3300/0 conn(0x7f03d006d440 0x7f03d006d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 -- 172.21.15.31:0/3353352898 >> v1:172.21.15.102:6789/0 conn(0x7f03d0161ea0 legacy=0x7f03d009aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.692 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.686+0000 7f03c7e00640 1 -- 172.21.15.31:0/3353352898 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d00b3200 con 0x7f03d006ec20 2024-09-15T22:50:10.694 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03c7e00640 1 --2- 172.21.15.31:0/3353352898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006ec20 0x7f03d009b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03d00b3f50 tx=0x7f03b801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf03e0d0b32cc08a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:10.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03cfe00640 1 -- 172.21.15.31:0/3353352898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b80ab430 con 0x7f03d006ec20 2024-09-15T22:50:10.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03cfe00640 1 -- 172.21.15.31:0/3353352898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03b80b0070 con 0x7f03d006ec20 2024-09-15T22:50:10.695 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03cfe00640 1 -- 172.21.15.31:0/3353352898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b80ab5f0 con 0x7f03d006ec20 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 -- 172.21.15.31:0/3353352898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006ec20 msgr2=0x7f03d009b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 --2- 172.21.15.31:0/3353352898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006ec20 0x7f03d009b130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f03d00b3f50 tx=0x7f03b801c520 comp rx=0 tx=0).stop 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 -- 172.21.15.31:0/3353352898 shutdown_connections 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 --2- 172.21.15.31:0/3353352898 >> v2:172.21.15.102:3300/0 conn(0x7f03d006d440 0x7f03d006d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 --2- 172.21.15.31:0/3353352898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006ec20 0x7f03d009b130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 -- 172.21.15.31:0/3353352898 >> 172.21.15.31:0/3353352898 conn(0x7f03d00d23d0 msgr2=0x7f03d00d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 -- 172.21.15.31:0/3353352898 shutdown_connections 2024-09-15T22:50:10.696 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.690+0000 7f03d7c00640 1 -- 172.21.15.31:0/3353352898 wait complete. 2024-09-15T22:50:10.697 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 Processor -- start 2024-09-15T22:50:10.697 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- start start 2024-09-15T22:50:10.699 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.699 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03d006ec20 0x7f03d01574e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.699 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03d0161ea0 0x7f03d0157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.699 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f03d009b7f0 con 0x7f03d006d440 2024-09-15T22:50:10.699 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f03d009b670 con 0x7f03d006ec20 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f03d016b4c0 con 0x7f03d0161ea0 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58054/0 (socket says 172.21.15.31:58054) 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 -- 172.21.15.31:0/4089919342 learned_addr learned my addr 172.21.15.31:0/4089919342 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03c7e00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03d006ec20 0x7f03d01574e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03d0161ea0 0x7f03d0157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 -- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03d0161ea0 msgr2=0x7f03d0157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03d0161ea0 0x7f03d0157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 -- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03d006ec20 msgr2=0x7f03d01574e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03d006ec20 0x7f03d01574e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 -- 172.21.15.31:0/4089919342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d015cc20 con 0x7f03d006d440 2024-09-15T22:50:10.700 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d5200640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c530 tx=0x7f03c000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:10.701 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0016020 con 0x7f03d006d440 2024-09-15T22:50:10.701 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03c0005220 con 0x7f03d006d440 2024-09-15T22:50:10.701 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d014cf60 con 0x7f03d006d440 2024-09-15T22:50:10.701 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c0007030 con 0x7f03d006d440 2024-09-15T22:50:10.701 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.694+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d00b6150 con 0x7f03d006d440 2024-09-15T22:50:10.702 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03d006d890 con 0x7f03d006d440 2024-09-15T22:50:10.702 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f03c00071d0 con 0x7f03d006d440 2024-09-15T22:50:10.702 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03cd600640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 0x7f03ac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:10.702 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f03c0085300 con 0x7f03d006d440 2024-09-15T22:50:10.702 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03c7e00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 0x7f03ac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:10.703 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.698+0000 7f03c7e00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 0x7f03ac069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03b80af000 tx=0x7f03b80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:10.706 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.702+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f03c0020020 con 0x7f03d006d440 2024-09-15T22:50:10.873 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.870+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f03d0071b80 con 0x7f03d006d440 2024-09-15T22:50:10.873 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.870+0000 7f03cd600640 1 -- 172.21.15.31:0/4089919342 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12860 (secure 0 0 0) 0x7f03c00074c0 con 0x7f03d006d440 2024-09-15T22:50:10.874 INFO:teuthology.misc.health.smithi031.stdout: 2024-09-15T22:50:10.874 INFO:teuthology.misc.health.smithi031.stdout:{"epoch":17,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:08.548576+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.870+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 msgr2=0x7f03ac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.870+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 0x7f03ac069d80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f03b80af000 tx=0x7f03b80a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 msgr2=0x7f03d014ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f03c000c530 tx=0x7f03c000c9f0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 shutdown_connections 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f03ac0678c0 0x7f03ac069d80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.876 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f03d0161ea0 0x7f03d0157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.877 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f03d006ec20 0x7f03d01574e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.877 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 --2- 172.21.15.31:0/4089919342 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f03d006d440 0x7f03d014ca20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:10.877 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 >> 172.21.15.31:0/4089919342 conn(0x7f03d00d23d0 msgr2=0x7f03d014efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:10.877 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 shutdown_connections 2024-09-15T22:50:10.877 INFO:teuthology.misc.health.smithi031.stderr:2024-09-15T22:50:10.874+0000 7f03d7c00640 1 -- 172.21.15.31:0/4089919342 wait complete. 2024-09-15T22:50:10.893 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-15T22:50:10.894 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-15T22:50:10.894 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:50:10.894 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:50:10.897 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:50:10.897 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:50:10.898 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:50:10.900 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:50:10.900 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:50:10.901 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:50:10.904 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:50:10.904 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:50:10.904 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:50:10.907 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:50:10.907 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-15T22:50:10.908 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:10.998 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:50:10.998 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:50:11.011 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-15T22:50:11.012 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-15T22:50:11.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 Processor -- start 2024-09-15T22:50:11.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 -- start start 2024-09-15T22:50:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 0x7f2ecc15f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ecc0d04b0 0x7f2ecc09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ecc0d0c70 con 0x7f2ecc09af80 2024-09-15T22:50:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2ecc15fcb0 con 0x7f2ecc0d04b0 2024-09-15T22:50:11.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc160040 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ecbe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 0x7f2ecc15f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ecb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2ecc0d04b0 0x7f2ecc09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed0a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f2ecc09af80 0x7f2ecc161410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:60586/0 (socket says 172.21.15.31:60586) 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.050+0000 7f2ed0a00640 1 -- 172.21.15.31:0/3549767186 learned_addr learned my addr 172.21.15.31:0/3549767186 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecbe00640 1 -- 172.21.15.31:0/3549767186 >> v2:172.21.15.102:3300/0 conn(0x7f2ecc0d04b0 msgr2=0x7f2ecc09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:11.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecbe00640 1 --2- 172.21.15.31:0/3549767186 >> v2:172.21.15.102:3300/0 conn(0x7f2ecc0d04b0 0x7f2ecc09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecbe00640 1 -- 172.21.15.31:0/3549767186 >> v1:172.21.15.102:6789/0 conn(0x7f2ecc09af80 legacy=0x7f2ecc161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecbe00640 1 -- 172.21.15.31:0/3549767186 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0d0f50 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecbe00640 1 --2- 172.21.15.31:0/3549767186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 0x7f2ecc15f770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097f0 tx=0x7f2ebc01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a68aad791adf51f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecaa00640 1 -- 172.21.15.31:0/3549767186 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0b2070 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecaa00640 1 -- 172.21.15.31:0/3549767186 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ebc0ad640 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ecaa00640 1 -- 172.21.15.31:0/3549767186 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0ada10 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ed2a00640 1 -- 172.21.15.31:0/3549767186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 msgr2=0x7f2ecc15f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.054+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/3549767186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 0x7f2ecc15f770 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0097f0 tx=0x7f2ebc01c4a0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- 172.21.15.31:0/3549767186 shutdown_connections 2024-09-15T22:50:11.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/3549767186 >> v2:172.21.15.102:3300/0 conn(0x7f2ecc0d04b0 0x7f2ecc09aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/3549767186 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc15e6d0 0x7f2ecc15f770 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- 172.21.15.31:0/3549767186 >> 172.21.15.31:0/3549767186 conn(0x7f2ecc0d23b0 msgr2=0x7f2ecc0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- 172.21.15.31:0/3549767186 shutdown_connections 2024-09-15T22:50:11.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- 172.21.15.31:0/3549767186 wait complete. 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 Processor -- start 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- start start 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc09af80 0x7f2ecc0b7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 0x7f2ecc159920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc161f30 con 0x7f2ecc0d04b0 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ecc0d17f0 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed2a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ecc0d0890 con 0x7f2ecc09af80 2024-09-15T22:50:11.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ecb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ecb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58130/0 (socket says 172.21.15.31:58130) 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 0x7f2ecc159920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ecb400640 1 -- 172.21.15.31:0/1634781623 learned_addr learned my addr 172.21.15.31:0/1634781623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ecbe00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc09af80 0x7f2ecc0b7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 -- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc09af80 msgr2=0x7f2ecc0b7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc09af80 0x7f2ecc0b7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 -- 172.21.15.31:0/1634781623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 msgr2=0x7f2ecc0b1fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 -- 172.21.15.31:0/1634781623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ecc0b7640 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ecb400640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ed0a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 0x7f2ecc159920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400cad0 tx=0x7f2ec400cf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4017070 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.058+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ec400ab70 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ecc0b7920 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4012400 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ecc15ba50 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ecc09aa40 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2ec401a070 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ec3e00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 0x7f2eac069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f2ec4085640 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.062+0000 7f2ecbe00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 0x7f2eac069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:11.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.066+0000 7f2ecbe00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 0x7f2eac069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0af000 tx=0x7f2ebc0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:11.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.066+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2ec4055e60 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.266+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2ecc09b570 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.266+0000 7f2ec3e00640 1 -- 172.21.15.31:0/1634781623 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7f2ec405a160 con 0x7f2ecc15e6d0 2024-09-15T22:50:11.271 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:11.271 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":2,"btime":"2024-09-15T22:50:11:005908+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:50:11.272 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 2 2024-09-15T22:50:11.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 msgr2=0x7f2eac069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 0x7f2eac069d80 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc0af000 tx=0x7f2ebc0a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 msgr2=0x7f2ecc159920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 0x7f2ecc159920 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400cad0 tx=0x7f2ec400cf90 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 shutdown_connections 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2eac0678c0 0x7f2eac069d80 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ecc15e6d0 0x7f2ecc159920 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ecc0d04b0 0x7f2ecc0b1fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 --2- 172.21.15.31:0/1634781623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ecc09af80 0x7f2ecc0b7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 >> 172.21.15.31:0/1634781623 conn(0x7f2ecc0d23b0 msgr2=0x7f2ecc0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 shutdown_connections 2024-09-15T22:50:11.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:11.270+0000 7f2ed2a00640 1 -- 172.21.15.31:0/1634781623 wait complete. 2024-09-15T22:50:13.292 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:13.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 Processor -- start 2024-09-15T22:50:13.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 -- start start 2024-09-15T22:50:13.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d80072160 0x7f8d80072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 0x7f8d8013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 0x7f8d80141e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8d8013f640 con 0x7f8d80072160 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8d801413c0 con 0x7f8d80141980 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d85600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8d80072a80 con 0x7f8d8013fa40 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d80072160 0x7f8d80072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8d80072160 0x7f8d80072540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58140/0 (socket says 172.21.15.31:58140) 2024-09-15T22:50:13.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 -- 172.21.15.31:0/3365222998 learned_addr learned my addr 172.21.15.31:0/3365222998 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7f400640 1 --2- 172.21.15.31:0/3365222998 >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 0x7f8d80141e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7e000640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 0x7f8d8013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 -- 172.21.15.31:0/3365222998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 msgr2=0x7f8d8013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 0x7f8d8013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 -- 172.21.15.31:0/3365222998 >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 msgr2=0x7f8d80141e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/3365222998 >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 0x7f8d80141e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7ea00640 1 -- 172.21.15.31:0/3365222998 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d801407b0 con 0x7f8d80072160 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7f400640 1 --2- 172.21.15.31:0/3365222998 >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 0x7f8d80141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:13.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.442+0000 7f8d7e000640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 0x7f8d8013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:13.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80072160 0x7f8d80072540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d80156d90 tx=0x7f8d7001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bdac86ac1cd70a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d7d600640 1 -- 172.21.15.31:0/3365222998 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a56f0 con 0x7f8d80072160 2024-09-15T22:50:13.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d7d600640 1 -- 172.21.15.31:0/3365222998 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d700a5890 con 0x7f8d80072160 2024-09-15T22:50:13.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d7d600640 1 -- 172.21.15.31:0/3365222998 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700a5c60 con 0x7f8d80072160 2024-09-15T22:50:13.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 -- 172.21.15.31:0/3365222998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80072160 msgr2=0x7f8d80072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80072160 0x7f8d80072540 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8d80156d90 tx=0x7f8d7001c960 comp rx=0 tx=0).stop 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 -- 172.21.15.31:0/3365222998 shutdown_connections 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 --2- 172.21.15.31:0/3365222998 >> v2:172.21.15.102:3300/0 conn(0x7f8d80141980 0x7f8d80141e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d8013fa40 0x7f8d8013fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 --2- 172.21.15.31:0/3365222998 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80072160 0x7f8d80072540 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 -- 172.21.15.31:0/3365222998 >> 172.21.15.31:0/3365222998 conn(0x7f8d80067e00 msgr2=0x7f8d8006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:13.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 -- 172.21.15.31:0/3365222998 shutdown_connections 2024-09-15T22:50:13.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.446+0000 7f8d85600640 1 -- 172.21.15.31:0/3365222998 wait complete. 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 Processor -- start 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- start start 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d80072160 0x7f8d80153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d8013fa40 0x7f8d8015a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d801403e0 con 0x7f8d80141980 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8d80141050 con 0x7f8d8013fa40 2024-09-15T22:50:13.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8d80140560 con 0x7f8d80072160 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58146/0 (socket says 172.21.15.31:58146) 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 -- 172.21.15.31:0/752192905 learned_addr learned my addr 172.21.15.31:0/752192905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d80072160 0x7f8d80153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7e000640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d8013fa40 0x7f8d8015a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 -- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d80072160 msgr2=0x7f8d80153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d80072160 0x7f8d80153960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 -- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d8013fa40 msgr2=0x7f8d8015a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d8013fa40 0x7f8d8015a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 -- 172.21.15.31:0/752192905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d800af220 con 0x7f8d80141980 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d7f400640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c7f0 tx=0x7f8d7800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78015070 con 0x7f8d80141980 2024-09-15T22:50:13.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d78007860 con 0x7f8d80141980 2024-09-15T22:50:13.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d800ae460 con 0x7f8d80141980 2024-09-15T22:50:13.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d78007c50 con 0x7f8d80141980 2024-09-15T22:50:13.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d800aea20 con 0x7f8d80141980 2024-09-15T22:50:13.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.450+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d80072540 con 0x7f8d80141980 2024-09-15T22:50:13.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.454+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d78018070 con 0x7f8d80141980 2024-09-15T22:50:13.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.454+0000 7f8d76a00640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 0x7f8d60069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.454+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8d78085ad0 con 0x7f8d80141980 2024-09-15T22:50:13.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.454+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 0x7f8d60069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.454+0000 7f8d7ea00640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 0x7f8d60069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d700ae000 tx=0x7f8d700a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.458+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d78056270 con 0x7f8d80141980 2024-09-15T22:50:13.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.658+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d800cf910 con 0x7f8d80141980 2024-09-15T22:50:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.658+0000 7f8d76a00640 1 -- 172.21.15.31:0/752192905 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f8d7805a570 con 0x7f8d80141980 2024-09-15T22:50:13.664 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:13.664 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":3,"btime":"2024-09-15T22:50:12:008548+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4281,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-15T22:50:13.664 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 3 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 msgr2=0x7f8d60069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 0x7f8d60069d80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f8d700ae000 tx=0x7f8d700a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 msgr2=0x7f8d8015a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8d7800c7f0 tx=0x7f8d7800ccb0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 shutdown_connections 2024-09-15T22:50:13.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d600678c0 0x7f8d60069d80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d80141980 0x7f8d8015a9b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d8013fa40 0x7f8d8015a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 --2- 172.21.15.31:0/752192905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d80072160 0x7f8d80153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 >> 172.21.15.31:0/752192905 conn(0x7f8d80067e00 msgr2=0x7f8d8015e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 shutdown_connections 2024-09-15T22:50:13.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.662+0000 7f8d85600640 1 -- 172.21.15.31:0/752192905 wait complete. 2024-09-15T22:50:13.685 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:50:13.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 Processor -- start 2024-09-15T22:50:13.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 -- start start 2024-09-15T22:50:13.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2980715a0 0x7fa2980ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 0x7fa298070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa29809aa40 con 0x7fa298070770 2024-09-15T22:50:13.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa298071980 con 0x7fa2980715a0 2024-09-15T22:50:13.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29f800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa2980cddd0 con 0x7fa2980cd8f0 2024-09-15T22:50:13.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa297e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 0x7fa298070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29ce00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa2980715a0 0x7fa2980ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29d800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fa298070770 0x7fa2980d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:60590/0 (socket says 172.21.15.31:60590) 2024-09-15T22:50:13.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.822+0000 7fa29d800640 1 -- 172.21.15.31:0/3540257969 learned_addr learned my addr 172.21.15.31:0/3540257969 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:13.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29ce00640 1 -- 172.21.15.31:0/3540257969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 msgr2=0x7fa298070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:13.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29ce00640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 0x7fa298070230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29ce00640 1 -- 172.21.15.31:0/3540257969 >> v1:172.21.15.102:6789/0 conn(0x7fa298070770 legacy=0x7fa2980d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29ce00640 1 -- 172.21.15.31:0/3540257969 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980ce0b0 con 0x7fa2980715a0 2024-09-15T22:50:13.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa297e00640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 0x7fa298070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:13.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29ce00640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980ce850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097c0 tx=0x7fa28801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb10d10d8e1202 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa297400640 1 -- 172.21.15.31:0/3540257969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880a7070 con 0x7fa2980715a0 2024-09-15T22:50:13.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa297400640 1 -- 172.21.15.31:0/3540257969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880b0070 con 0x7fa2980715a0 2024-09-15T22:50:13.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa297400640 1 -- 172.21.15.31:0/3540257969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880ab890 con 0x7fa2980715a0 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29f800640 1 -- 172.21.15.31:0/3540257969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 msgr2=0x7fa2980ce850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.826+0000 7fa29f800640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980ce850 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa2880097c0 tx=0x7fa28801c470 comp rx=0 tx=0).stop 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- 172.21.15.31:0/3540257969 shutdown_connections 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa2980cd8f0 0x7fa298070230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 --2- 172.21.15.31:0/3540257969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980ce850 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- 172.21.15.31:0/3540257969 >> 172.21.15.31:0/3540257969 conn(0x7fa2980d23b0 msgr2=0x7fa2980d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:13.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- 172.21.15.31:0/3540257969 shutdown_connections 2024-09-15T22:50:13.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- 172.21.15.31:0/3540257969 wait complete. 2024-09-15T22:50:13.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 Processor -- start 2024-09-15T22:50:13.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- start start 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa298070770 0x7fa29814e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2980cd8f0 0x7fa2980b6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa29809be90 con 0x7fa2980715a0 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa29809bd10 con 0x7fa2980cd8f0 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa2980d0fa0 con 0x7fa298070770 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58164/0 (socket says 172.21.15.31:58164) 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 -- 172.21.15.31:0/65587806 learned_addr learned my addr 172.21.15.31:0/65587806 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:13.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29ce00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa298070770 0x7fa29814e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29d800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2980cd8f0 0x7fa2980b6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 -- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa298070770 msgr2=0x7fa29814e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa298070770 0x7fa29814e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 -- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2980cd8f0 msgr2=0x7fa2980b6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2980cd8f0 0x7fa2980b6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 -- 172.21.15.31:0/65587806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29814ec50 con 0x7fa2980715a0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa297e00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa28400e980 tx=0x7fa28400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa284017070 con 0x7fa2980715a0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa28400ca00 con 0x7fa2980715a0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa28400cdd0 con 0x7fa2980715a0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.830+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29814ef30 con 0x7fa2980715a0 2024-09-15T22:50:13.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29814c5f0 con 0x7fa2980715a0 2024-09-15T22:50:13.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa298070230 con 0x7fa2980715a0 2024-09-15T22:50:13.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa28401a070 con 0x7fa2980715a0 2024-09-15T22:50:13.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa294c00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 0x7fa278069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:13.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fa284085b90 con 0x7fa2980715a0 2024-09-15T22:50:13.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.834+0000 7fa29ce00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 0x7fa278069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:13.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.838+0000 7fa29ce00640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 0x7fa278069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2880af000 tx=0x7fa2880a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:13.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:13.838+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa2840563d0 con 0x7fa2980715a0 2024-09-15T22:50:13.972 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:50:13.975 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:50:14.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.006+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fa2980b8330 con 0x7fa2980715a0 2024-09-15T22:50:14.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.006+0000 7fa294c00640 1 -- 172.21.15.31:0/65587806 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7fa28405a6d0 con 0x7fa2980715a0 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:50:14.011 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 msgr2=0x7fa278069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 0x7fa278069d80 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa2880af000 tx=0x7fa2880a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 msgr2=0x7fa2980cf490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa28400e980 tx=0x7fa28400ee40 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 shutdown_connections 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa2780678c0 0x7fa278069d80 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa2980cd8f0 0x7fa2980b6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa2980715a0 0x7fa2980cf490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 --2- 172.21.15.31:0/65587806 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa298070770 0x7fa29814e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 >> 172.21.15.31:0/65587806 conn(0x7fa2980d23b0 msgr2=0x7fa2980b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:14.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 shutdown_connections 2024-09-15T22:50:14.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.010+0000 7fa29f800640 1 -- 172.21.15.31:0/65587806 wait complete. 2024-09-15T22:50:14.033 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:50:14.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:50:14.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.214+0000 7ff617600640 1 Processor -- start 2024-09-15T22:50:14.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.214+0000 7ff617600640 1 -- start start 2024-09-15T22:50:14.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff617600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff6100b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff617600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff6100cd1e0 0x7ff61006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff617600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff610073a50 con 0x7ff610071ef0 2024-09-15T22:50:14.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff617600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff6100b3fe0 con 0x7ff6100cd1e0 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff617600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff6100b3050 con 0x7ff61015abd0 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff615600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff6100cd1e0 0x7ff61006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff607e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff610071ef0 0x7ff6100ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:39496/0 (socket says 172.21.15.31:39496) 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff607e00640 1 -- 172.21.15.31:0/963566467 learned_addr learned my addr 172.21.15.31:0/963566467 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff614c00640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff6100b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff615600640 1 -- 172.21.15.31:0/963566467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 msgr2=0x7ff6100b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff615600640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff6100b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff615600640 1 -- 172.21.15.31:0/963566467 >> v1:172.21.15.31:6789/0 conn(0x7ff610071ef0 legacy=0x7ff6100ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff615600640 1 -- 172.21.15.31:0/963566467 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff610073cf0 con 0x7ff6100cd1e0 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff614c00640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff6100b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:14.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.218+0000 7ff60fe00640 1 -- 172.21.15.31:0/963566467 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946446888 0 0) 0x7ff610073a50 con 0x7ff610071ef0 2024-09-15T22:50:14.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff615600640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff61006de70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff608009d90 tx=0x7ff60801c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a2ab8bcacf44cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:14.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff60fe00640 1 -- 172.21.15.31:0/963566467 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6080a66b0 con 0x7ff6100cd1e0 2024-09-15T22:50:14.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff60fe00640 1 -- 172.21.15.31:0/963566467 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6080a6850 con 0x7ff6100cd1e0 2024-09-15T22:50:14.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff60fe00640 1 -- 172.21.15.31:0/963566467 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6080a6c20 con 0x7ff6100cd1e0 2024-09-15T22:50:14.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- 172.21.15.31:0/963566467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 msgr2=0x7ff61006de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff61006de70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff608009d90 tx=0x7ff60801c970 comp rx=0 tx=0).stop 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- 172.21.15.31:0/963566467 shutdown_connections 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff61006de70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 --2- 172.21.15.31:0/963566467 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff6100b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- 172.21.15.31:0/963566467 >> 172.21.15.31:0/963566467 conn(0x7ff61006be90 msgr2=0x7ff61006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- 172.21.15.31:0/963566467 shutdown_connections 2024-09-15T22:50:14.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- 172.21.15.31:0/963566467 wait complete. 2024-09-15T22:50:14.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 Processor -- start 2024-09-15T22:50:14.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 -- start start 2024-09-15T22:50:14.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.222+0000 7ff617600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff610071ef0 0x7ff610150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff610152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff61006e3b0 con 0x7ff6100cd1e0 2024-09-15T22:50:14.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff6100b4fc0 con 0x7ff610071ef0 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff61006e530 con 0x7ff61015abd0 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:58194/0 (socket says 172.21.15.31:58194) 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 -- 172.21.15.31:0/1999297977 learned_addr learned my addr 172.21.15.31:0/1999297977 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff615600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff610152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff614c00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff610071ef0 0x7ff610150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 -- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 msgr2=0x7ff610152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff610152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 -- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff610071ef0 msgr2=0x7ff610150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff610071ef0 0x7ff610150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 -- 172.21.15.31:0/1999297977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff610159d30 con 0x7ff6100cd1e0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff615600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff610152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff607e00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800c4b0 tx=0x7ff5f800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8018070 con 0x7ff6100cd1e0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8007500 con 0x7ff6100cd1e0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff610158c90 con 0x7ff6100cd1e0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5f8004a30 con 0x7ff6100cd1e0 2024-09-15T22:50:14.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff610159250 con 0x7ff6100cd1e0 2024-09-15T22:50:14.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610156e00 con 0x7ff6100cd1e0 2024-09-15T22:50:14.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.226+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff5f801b070 con 0x7ff6100cd1e0 2024-09-15T22:50:14.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.230+0000 7ff60d600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:14.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.230+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7ff5f8084cc0 con 0x7ff6100cd1e0 2024-09-15T22:50:14.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.230+0000 7ff614c00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:14.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.230+0000 7ff614c00640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 0x7ff5ec069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff610157330 tx=0x7ff600008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:14.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.234+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff5f808b080 con 0x7ff6100cd1e0 2024-09-15T22:50:14.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:14.398+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff61006ced0 con 0x7ff6100cd1e0 2024-09-15T22:50:15.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.022+0000 7ff60d600640 1 -- 172.21.15.31:0/1999297977 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7ff610159d30 con 0x7ff6100cd1e0 2024-09-15T22:50:15.027 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 msgr2=0x7ff5ec069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 0x7ff5ec069db0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff610157330 tx=0x7ff600008040 comp rx=0 tx=0).stop 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 msgr2=0x7ff610168630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7ff5f800c4b0 tx=0x7ff5f800c970 comp rx=0 tx=0).stop 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 shutdown_connections 2024-09-15T22:50:15.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff5ec0678f0 0x7ff5ec069db0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff61015abd0 0x7ff610152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff6100cd1e0 0x7ff610168630 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 --2- 172.21.15.31:0/1999297977 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff610071ef0 0x7ff610150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 >> 172.21.15.31:0/1999297977 conn(0x7ff61006be90 msgr2=0x7ff610074780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.026+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 shutdown_connections 2024-09-15T22:50:15.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.030+0000 7ff617600640 1 -- 172.21.15.31:0/1999297977 wait complete. 2024-09-15T22:50:15.060 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-15T22:50:15.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 Processor -- start 2024-09-15T22:50:15.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 -- start start 2024-09-15T22:50:15.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e40b1780 0x7f02e4071210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 0x7f02e409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02e4071750 0x7f02e409af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f02e40b1b60 con 0x7f02e4071750 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f02e41601a0 con 0x7f02e409bb10 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e9400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f02e4160440 con 0x7f02e40b1780 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02e4071750 0x7f02e409af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f02e4071750 0x7f02e409af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55770/0 (socket says 172.21.15.31:55770) 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 -- 172.21.15.31:0/2416385969 learned_addr learned my addr 172.21.15.31:0/2416385969 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02dbe00640 1 --2- 172.21.15.31:0/2416385969 >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 0x7f02e409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e2800640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e40b1780 0x7f02e4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 -- 172.21.15.31:0/2416385969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e40b1780 msgr2=0x7f02e4071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e40b1780 0x7f02e4071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 -- 172.21.15.31:0/2416385969 >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 msgr2=0x7f02e409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 --2- 172.21.15.31:0/2416385969 >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 0x7f02e409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02e3200640 1 -- 172.21.15.31:0/2416385969 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4160720 con 0x7f02e4071750 2024-09-15T22:50:15.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.210+0000 7f02dbe00640 1 --2- 172.21.15.31:0/2416385969 >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 0x7f02e409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:15.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e3200640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e4071750 0x7f02e409af80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02e40d1250 tx=0x7f02dc01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66373a1fceb69cb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:15.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e1e00640 1 -- 172.21.15.31:0/2416385969 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0a5800 con 0x7f02e4071750 2024-09-15T22:50:15.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e1e00640 1 -- 172.21.15.31:0/2416385969 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02dc0a59a0 con 0x7f02e4071750 2024-09-15T22:50:15.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e1e00640 1 -- 172.21.15.31:0/2416385969 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc0a5d70 con 0x7f02e4071750 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- 172.21.15.31:0/2416385969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e4071750 msgr2=0x7f02e409af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e4071750 0x7f02e409af80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02e40d1250 tx=0x7f02dc01c960 comp rx=0 tx=0).stop 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- 172.21.15.31:0/2416385969 shutdown_connections 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e4071750 0x7f02e409af80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 --2- 172.21.15.31:0/2416385969 >> v2:172.21.15.102:3300/0 conn(0x7f02e409bb10 0x7f02e409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 --2- 172.21.15.31:0/2416385969 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e40b1780 0x7f02e4071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- 172.21.15.31:0/2416385969 >> 172.21.15.31:0/2416385969 conn(0x7f02e40b3df0 msgr2=0x7f02e40b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:15.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- 172.21.15.31:0/2416385969 shutdown_connections 2024-09-15T22:50:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- 172.21.15.31:0/2416385969 wait complete. 2024-09-15T22:50:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 Processor -- start 2024-09-15T22:50:15.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.214+0000 7f02e9400640 1 -- start start 2024-09-15T22:50:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e4071750 0x7f02e415d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02e40b1780 0x7f02e40c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4070d10 con 0x7f02e409bb10 2024-09-15T22:50:15.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f02e4070b90 con 0x7f02e40b1780 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f02e4070e90 con 0x7f02e4071750 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55780/0 (socket says 172.21.15.31:55780) 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 -- 172.21.15.31:0/734748713 learned_addr learned my addr 172.21.15.31:0/734748713 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e2800640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e4071750 0x7f02e415d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e3200640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02e40b1780 0x7f02e40c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 -- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e4071750 msgr2=0x7f02e415d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e4071750 0x7f02e415d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 -- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02e40b1780 msgr2=0x7f02e40c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02e40b1780 0x7f02e40c88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 -- 172.21.15.31:0/734748713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e406d170 con 0x7f02e409bb10 2024-09-15T22:50:15.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02dbe00640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d5a0 tx=0x7f02cc00da60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc018020 con 0x7f02e409bb10 2024-09-15T22:50:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f02cc014620 con 0x7f02e409bb10 2024-09-15T22:50:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02e406d450 con 0x7f02e409bb10 2024-09-15T22:50:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02cc0149d0 con 0x7f02e409bb10 2024-09-15T22:50:15.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02e406da10 con 0x7f02e409bb10 2024-09-15T22:50:15.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.218+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02e4071210 con 0x7f02e409bb10 2024-09-15T22:50:15.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.222+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f02cc01b020 con 0x7f02e409bb10 2024-09-15T22:50:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.222+0000 7f02daa00640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 0x7f02c0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.222+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f02cc085f00 con 0x7f02e409bb10 2024-09-15T22:50:15.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.222+0000 7f02e2800640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 0x7f02c0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:15.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.222+0000 7f02e2800640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 0x7f02c0069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b930 tx=0x7f02d4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:15.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.226+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f02cc022020 con 0x7f02e409bb10 2024-09-15T22:50:15.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:15.394+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f02e40b4ac0 con 0x7f02e409bb10 2024-09-15T22:50:16.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02daa00640 1 -- 172.21.15.31:0/734748713 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f02cc056c10 con 0x7f02e409bb10 2024-09-15T22:50:16.033 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-15T22:50:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 msgr2=0x7f02c0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 0x7f02c0069d80 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f02d400b930 tx=0x7f02d4008040 comp rx=0 tx=0).stop 2024-09-15T22:50:16.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 msgr2=0x7f02e406e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f02cc00d5a0 tx=0x7f02cc00da60 comp rx=0 tx=0).stop 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 shutdown_connections 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f02c00678c0 0x7f02c0069d80 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f02e40b1780 0x7f02e40c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f02e409bb10 0x7f02e406e210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 --2- 172.21.15.31:0/734748713 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f02e4071750 0x7f02e415d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 >> 172.21.15.31:0/734748713 conn(0x7f02e40b3df0 msgr2=0x7f02e40b7140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 shutdown_connections 2024-09-15T22:50:16.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.030+0000 7f02e9400640 1 -- 172.21.15.31:0/734748713 wait complete. 2024-09-15T22:50:16.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:50:16.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 Processor -- start 2024-09-15T22:50:16.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 -- start start 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff34c070a20 0x7ff34c0b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c15e850 0x7ff34c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff34c06dde0 con 0x7ff34c070e00 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff34c0b6fb0 con 0x7ff34c070a20 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff352200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff34c0b63a0 con 0x7ff34c15e850 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff34c070a20 0x7ff34c0b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff34c070a20 0x7ff34c0b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55782/0 (socket says 172.21.15.31:55782) 2024-09-15T22:50:16.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 -- 172.21.15.31:0/2108989216 learned_addr learned my addr 172.21.15.31:0/2108989216 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff342a00640 1 --1- 172.21.15.31:0/2108989216 >> v1:172.21.15.31:6789/0 conn(0x7ff34c070e00 0x7ff34c09b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51126/0 (socket says 172.21.15.31:51126) 2024-09-15T22:50:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34be00640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c15e850 0x7ff34c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 -- 172.21.15.31:0/2108989216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c15e850 msgr2=0x7ff34c15ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:16.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c15e850 0x7ff34c15ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 -- 172.21.15.31:0/2108989216 >> v1:172.21.15.31:6789/0 conn(0x7ff34c070e00 legacy=0x7ff34c09b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34b400640 1 -- 172.21.15.31:0/2108989216 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c0b6680 con 0x7ff34c070a20 2024-09-15T22:50:16.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.214+0000 7ff34aa00640 1 -- 172.21.15.31:0/2108989216 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068082992 0 0) 0x7ff334001120 con 0x7ff34c070e00 2024-09-15T22:50:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff34b400640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c0b5d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009870 tx=0x7ff33c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca90ae909729c78a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff34aa00640 1 -- 172.21.15.31:0/2108989216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a95f0 con 0x7ff34c070a20 2024-09-15T22:50:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff34aa00640 1 -- 172.21.15.31:0/2108989216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0a9790 con 0x7ff34c070a20 2024-09-15T22:50:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff34aa00640 1 -- 172.21.15.31:0/2108989216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0a9b60 con 0x7ff34c070a20 2024-09-15T22:50:16.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 -- 172.21.15.31:0/2108989216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 msgr2=0x7ff34c0b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c0b5d50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff33c009870 tx=0x7ff33c01c530 comp rx=0 tx=0).stop 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 -- 172.21.15.31:0/2108989216 shutdown_connections 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c15e850 0x7ff34c15ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 --2- 172.21.15.31:0/2108989216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c0b5d50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 -- 172.21.15.31:0/2108989216 >> 172.21.15.31:0/2108989216 conn(0x7ff34c0b3f40 msgr2=0x7ff34c0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 -- 172.21.15.31:0/2108989216 shutdown_connections 2024-09-15T22:50:16.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.218+0000 7ff352200640 1 -- 172.21.15.31:0/2108989216 wait complete. 2024-09-15T22:50:16.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 Processor -- start 2024-09-15T22:50:16.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- start start 2024-09-15T22:50:16.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c070e00 0x7ff34c14cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 0x7ff34c0af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c0713b0 con 0x7ff34c070a20 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff34c071230 con 0x7ff34c15e850 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff34c16b0e0 con 0x7ff34c070e00 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55794/0 (socket says 172.21.15.31:55794) 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 -- 172.21.15.31:0/1085504252 learned_addr learned my addr 172.21.15.31:0/1085504252 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff342a00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c070e00 0x7ff34c14cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34be00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 0x7ff34c0af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 -- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c070e00 msgr2=0x7ff34c14cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c070e00 0x7ff34c14cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 -- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 msgr2=0x7ff34c0af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:16.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 0x7ff34c0af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 -- 172.21.15.31:0/1085504252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff34c14f660 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34be00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 0x7ff34c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff34b400640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff33c01abe0 tx=0x7ff33c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b1800 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff33c0b19a0 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33c0b1d90 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff34c15bb40 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff34c15c560 con 0x7ff34c070a20 2024-09-15T22:50:16.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.222+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34c0b5d50 con 0x7ff34c070a20 2024-09-15T22:50:16.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.226+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff33c0ba480 con 0x7ff34c070a20 2024-09-15T22:50:16.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.226+0000 7ff343e00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.226+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7ff33c1203b0 con 0x7ff34c070a20 2024-09-15T22:50:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.226+0000 7ff342a00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:16.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.226+0000 7ff342a00640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 0x7ff328069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff34c15efc0 tx=0x7ff334007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:16.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.230+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff33c0ad020 con 0x7ff34c070a20 2024-09-15T22:50:16.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:16.430+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7ff34c15ec60 con 0x7ff34c070a20 2024-09-15T22:50:17.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.030+0000 7ff343e00640 1 -- 172.21.15.31:0/1085504252 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7ff33c016150 con 0x7ff34c070a20 2024-09-15T22:50:17.036 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 2 and data pool 3 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 msgr2=0x7ff328069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 0x7ff328069d80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff34c15efc0 tx=0x7ff334007df0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 msgr2=0x7ff34c14d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff33c01abe0 tx=0x7ff33c0192d0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 shutdown_connections 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff3280678c0 0x7ff328069d80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff34c15e850 0x7ff34c0af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff34c070e00 0x7ff34c14cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 --2- 172.21.15.31:0/1085504252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff34c070a20 0x7ff34c14d730 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 >> 172.21.15.31:0/1085504252 conn(0x7ff34c0b3f40 msgr2=0x7ff34c09b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:17.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 shutdown_connections 2024-09-15T22:50:17.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.034+0000 7ff352200640 1 -- 172.21.15.31:0/1085504252 wait complete. 2024-09-15T22:50:17.099 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-15T22:50:17.099 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-15T22:50:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 Processor -- start 2024-09-15T22:50:17.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 -- start start 2024-09-15T22:50:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4f40d05b0 0x7ff4f415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4f415f1a0 con 0x7ff4f41522d0 2024-09-15T22:50:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff4f40d0a20 con 0x7ff4f40d05b0 2024-09-15T22:50:17.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f41526b0 con 0x7ff4f415ed40 2024-09-15T22:50:17.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f3400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4f40d05b0 0x7ff4f415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f2000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:60606/0 (socket says 172.21.15.31:60606) 2024-09-15T22:50:17.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f2000640 1 -- 172.21.15.31:0/2207147386 learned_addr learned my addr 172.21.15.31:0/2207147386 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.242+0000 7ff4f2a00640 1 --1- 172.21.15.31:0/2207147386 >> v1:172.21.15.102:6789/0 conn(0x7ff4f41522d0 0x7ff4f40b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:53714/0 (socket says 172.21.15.31:53714) 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f3400640 1 -- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 msgr2=0x7ff4f40d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f3400640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f3400640 1 -- 172.21.15.31:0/2207147386 >> v1:172.21.15.102:6789/0 conn(0x7ff4f41522d0 legacy=0x7ff4f40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f3400640 1 -- 172.21.15.31:0/2207147386 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f40ce310 con 0x7ff4f40d05b0 2024-09-15T22:50:17.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f2000640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:17.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f3400640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f40d05b0 0x7ff4f415baa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009dc0 tx=0x7ff4ec01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb4f94145ddfa34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f1600640 1 -- 172.21.15.31:0/2207147386 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0b2070 con 0x7ff4f40d05b0 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f1600640 1 -- 172.21.15.31:0/2207147386 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec0a58e0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f1600640 1 -- 172.21.15.31:0/2207147386 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec0a5cb0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f9c00640 1 -- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f40d05b0 msgr2=0x7ff4f415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.246+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f40d05b0 0x7ff4f415baa0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009dc0 tx=0x7ff4ec01c920 comp rx=0 tx=0).stop 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- 172.21.15.31:0/2207147386 shutdown_connections 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f40d05b0 0x7ff4f415baa0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/2207147386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f40d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- 172.21.15.31:0/2207147386 >> 172.21.15.31:0/2207147386 conn(0x7ff4f406be90 msgr2=0x7ff4f406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- 172.21.15.31:0/2207147386 shutdown_connections 2024-09-15T22:50:17.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- 172.21.15.31:0/2207147386 wait complete. 2024-09-15T22:50:17.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 Processor -- start 2024-09-15T22:50:17.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- start start 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f41522d0 0x7ff4f409d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f409bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40cdfe0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f40cee90 con 0x7ff4f41522d0 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f40b3230 con 0x7ff4f415ed40 2024-09-15T22:50:17.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55804/0 (socket says 172.21.15.31:55804) 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 -- 172.21.15.31:0/3094992348 learned_addr learned my addr 172.21.15.31:0/3094992348 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f3400640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f409bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2000640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f41522d0 0x7ff4f409d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 -- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 msgr2=0x7ff4f409bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f409bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 -- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f41522d0 msgr2=0x7ff4f409d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f41522d0 0x7ff4f409d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:17.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 -- 172.21.15.31:0/3094992348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f409c760 con 0x7ff4f40d05b0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4f2a00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c490 tx=0x7ff4e400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.250+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e4018070 con 0x7ff4f40d05b0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4e4007480 con 0x7ff4f40d05b0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f409ca40 con 0x7ff4f40d05b0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e40047f0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f409d000 con 0x7ff4f40d05b0 2024-09-15T22:50:17.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f415baa0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4e401b070 con 0x7ff4f40d05b0 2024-09-15T22:50:17.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4eaa00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 0x7ff4d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:17.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7ff4e4084f00 con 0x7ff4f40d05b0 2024-09-15T22:50:17.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4f2000640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 0x7ff4d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:17.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.254+0000 7ff4f2000640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 0x7ff4d4069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41fa7c0 tx=0x7ff4e0009240 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:17.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.258+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff4f415f1a0 con 0x7ff4f40d05b0 2024-09-15T22:50:17.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:17.438+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7ff4f40cfc90 con 0x7ff4f40d05b0 2024-09-15T22:50:18.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.034+0000 7ff4eaa00640 1 -- 172.21.15.31:0/3094992348 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7ff4e4055350 con 0x7ff4f40d05b0 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 msgr2=0x7ff4d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 0x7ff4d4069d80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7ff4f41fa7c0 tx=0x7ff4e0009240 comp rx=0 tx=0).stop 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 msgr2=0x7ff4f414b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff4e400c490 tx=0x7ff4e400c950 comp rx=0 tx=0).stop 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 shutdown_connections 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4d40678c0 0x7ff4d4069d80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4f415ed40 0x7ff4f409bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4f41522d0 0x7ff4f409d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 --2- 172.21.15.31:0/3094992348 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4f40d05b0 0x7ff4f414b270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 >> 172.21.15.31:0/3094992348 conn(0x7ff4f406be90 msgr2=0x7ff4f406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 shutdown_connections 2024-09-15T22:50:18.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.038+0000 7ff4f9c00640 1 -- 172.21.15.31:0/3094992348 wait complete. 2024-09-15T22:50:18.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:50:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 Processor -- start 2024-09-15T22:50:18.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 -- start start 2024-09-15T22:50:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f627809b2b0 0x7f62780d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6278070b60 0x7f6278070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62780d0ae0 con 0x7f627809aed0 2024-09-15T22:50:18.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6278071510 con 0x7f6278070b60 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f627dc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f62780d0dc0 con 0x7f627809b2b0 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6276a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f627809aed0 0x7f6278070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51138/0 (socket says 172.21.15.31:51138) 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6276a00640 1 -- 172.21.15.31:0/1026934248 learned_addr learned my addr 172.21.15.31:0/1026934248 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6277400640 1 --2- 172.21.15.31:0/1026934248 >> v2:172.21.15.31:3300/0 conn(0x7f6278070b60 0x7f6278070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f626fe00640 1 --2- 172.21.15.31:0/1026934248 >> v2:172.21.15.102:3300/0 conn(0x7f627809b2b0 0x7f62780d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6277400640 1 -- 172.21.15.31:0/1026934248 >> v2:172.21.15.102:3300/0 conn(0x7f627809b2b0 msgr2=0x7f62780d0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6277400640 1 --2- 172.21.15.31:0/1026934248 >> v2:172.21.15.102:3300/0 conn(0x7f627809b2b0 0x7f62780d0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6277400640 1 -- 172.21.15.31:0/1026934248 >> v1:172.21.15.31:6789/0 conn(0x7f627809aed0 legacy=0x7f6278070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.214+0000 7f6277400640 1 -- 172.21.15.31:0/1026934248 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62780d10a0 con 0x7f6278070b60 2024-09-15T22:50:18.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f6277400640 1 --2- 172.21.15.31:0/1026934248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f6278070fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f627809bce0 tx=0x7f627001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b037d7a6038109ee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f6276000640 1 -- 172.21.15.31:0/1026934248 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62700b2070 con 0x7f6278070b60 2024-09-15T22:50:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f6276000640 1 -- 172.21.15.31:0/1026934248 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62700a5870 con 0x7f6278070b60 2024-09-15T22:50:18.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f6276000640 1 -- 172.21.15.31:0/1026934248 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62700a5c40 con 0x7f6278070b60 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- 172.21.15.31:0/1026934248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 msgr2=0x7f6278070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 --2- 172.21.15.31:0/1026934248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f6278070fd0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f627809bce0 tx=0x7f627001c8a0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- 172.21.15.31:0/1026934248 shutdown_connections 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 --2- 172.21.15.31:0/1026934248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f6278070fd0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 --2- 172.21.15.31:0/1026934248 >> v2:172.21.15.102:3300/0 conn(0x7f627809b2b0 0x7f62780d0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- 172.21.15.31:0/1026934248 >> 172.21.15.31:0/1026934248 conn(0x7f62780b3df0 msgr2=0x7f62780b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- 172.21.15.31:0/1026934248 shutdown_connections 2024-09-15T22:50:18.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- 172.21.15.31:0/1026934248 wait complete. 2024-09-15T22:50:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 Processor -- start 2024-09-15T22:50:18.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.218+0000 7f627dc00640 1 -- start start 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 0x7f6278155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f627809b2b0 0x7f6278155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f627815eb90 con 0x7f6278070b60 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f627815ea10 con 0x7f627809aed0 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f627806ced0 con 0x7f627809b2b0 2024-09-15T22:50:18.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55824/0 (socket says 172.21.15.31:55824) 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 -- 172.21.15.31:0/1668811564 learned_addr learned my addr 172.21.15.31:0/1668811564 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6277400640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f627809b2b0 0x7f6278155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626fe00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 0x7f6278155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 -- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f627809b2b0 msgr2=0x7f6278155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f627809b2b0 0x7f6278155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 -- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 msgr2=0x7f6278155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 0x7f6278155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 -- 172.21.15.31:0/1668811564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6278152d70 con 0x7f6278070b60 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626fe00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 0x7f6278155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:18.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f6276a00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f626800c450 tx=0x7f626800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268017070 con 0x7f6278070b60 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6268005cf0 con 0x7f6278070b60 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6268007290 con 0x7f6278070b60 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6278153050 con 0x7f6278070b60 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6278153610 con 0x7f6278070b60 2024-09-15T22:50:18.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6278070fd0 con 0x7f6278070b60 2024-09-15T22:50:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.222+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f626801a070 con 0x7f6278070b60 2024-09-15T22:50:18.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.226+0000 7f626ea00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 0x7f6254069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.226+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f6268085090 con 0x7f6278070b60 2024-09-15T22:50:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.226+0000 7f626fe00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 0x7f6254069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:18.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.226+0000 7f626fe00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 0x7f6254069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6278162110 tx=0x7f6260008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:18.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.230+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6268055440 con 0x7f6278070b60 2024-09-15T22:50:18.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:18.394+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f62780b4a50 con 0x7f6278070b60 2024-09-15T22:50:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.286+0000 7f626ea00640 1 -- 172.21.15.31:0/1668811564 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f6268059740 con 0x7f6278070b60 2024-09-15T22:50:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' created 2024-09-15T22:50:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 msgr2=0x7f6254069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 0x7f6254069d80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6278162110 tx=0x7f6260008040 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 msgr2=0x7f627814cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f626800c450 tx=0x7f626800c910 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 shutdown_connections 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62540678c0 0x7f6254069d80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f627809b2b0 0x7f6278155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f627809aed0 0x7f6278155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 --2- 172.21.15.31:0/1668811564 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6278070b60 0x7f627814cc10 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 >> 172.21.15.31:0/1668811564 conn(0x7f62780b3df0 msgr2=0x7f6278071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 shutdown_connections 2024-09-15T22:50:20.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.290+0000 7f627dc00640 1 -- 172.21.15.31:0/1668811564 wait complete. 2024-09-15T22:50:20.327 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-15T22:50:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.470+0000 7f0809000640 1 Processor -- start 2024-09-15T22:50:20.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.470+0000 7f0809000640 1 -- start start 2024-09-15T22:50:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0809000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08040cd1d0 0x7f08040cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0809000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040cd640 0x7f08040cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0809000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0804162cc0 con 0x7f08040b3f10 2024-09-15T22:50:20.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0809000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0804166cb0 con 0x7f08040cd1d0 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0809000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0804166f90 con 0x7f08040cd640 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08040cd1d0 0x7f08040cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f08040cd1d0 0x7f08040cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55830/0 (socket says 172.21.15.31:55830) 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 -- 172.21.15.31:0/800900070 learned_addr learned my addr 172.21.15.31:0/800900070 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801e00640 1 --1- 172.21.15.31:0/800900070 >> v1:172.21.15.31:6789/0 conn(0x7f08040b3f10 0x7f0804166460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51144/0 (socket says 172.21.15.31:51144) 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0802800640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040cd640 0x7f08040cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 -- 172.21.15.31:0/800900070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040cd640 msgr2=0x7f08040cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:20.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040cd640 0x7f08040cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 -- 172.21.15.31:0/800900070 >> v1:172.21.15.31:6789/0 conn(0x7f08040b3f10 legacy=0x7f0804166460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 -- 172.21.15.31:0/800900070 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804167270 con 0x7f08040cd1d0 2024-09-15T22:50:20.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0801400640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd1d0 0x7f08040cf000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb48f1b2d6c83a39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0800a00640 1 -- 172.21.15.31:0/800900070 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0a9610 con 0x7f08040cd1d0 2024-09-15T22:50:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0800a00640 1 -- 172.21.15.31:0/800900070 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07ec0a97b0 con 0x7f08040cd1d0 2024-09-15T22:50:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.474+0000 7f0800a00640 1 -- 172.21.15.31:0/800900070 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ec0a9b80 con 0x7f08040cd1d0 2024-09-15T22:50:20.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- 172.21.15.31:0/800900070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd1d0 msgr2=0x7f08040cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd1d0 0x7f08040cf000 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f07ec009870 tx=0x7f07ec01c530 comp rx=0 tx=0).stop 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- 172.21.15.31:0/800900070 shutdown_connections 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040cd640 0x7f08040cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- 172.21.15.31:0/800900070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd1d0 0x7f08040cf000 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- 172.21.15.31:0/800900070 >> 172.21.15.31:0/800900070 conn(0x7f080406be90 msgr2=0x7f080406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- 172.21.15.31:0/800900070 shutdown_connections 2024-09-15T22:50:20.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- 172.21.15.31:0/800900070 wait complete. 2024-09-15T22:50:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 Processor -- start 2024-09-15T22:50:20.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- start start 2024-09-15T22:50:20.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040b3f10 0x7f0804159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08040cd1d0 0x7f0804162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f080416f800 con 0x7f08040cd640 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f08040b4d10 con 0x7f08040cd1d0 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0809000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f080416f980 con 0x7f08040b3f10 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55834/0 (socket says 172.21.15.31:55834) 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 -- 172.21.15.31:0/2164110082 learned_addr learned my addr 172.21.15.31:0/2164110082 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0801e00640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040b3f10 0x7f0804159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0801400640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08040cd1d0 0x7f0804162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 -- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040b3f10 msgr2=0x7f0804159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040b3f10 0x7f0804159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 -- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08040cd1d0 msgr2=0x7f0804162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:20.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08040cd1d0 0x7f0804162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:20.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.478+0000 7f0802800640 1 -- 172.21.15.31:0/2164110082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0804164840 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f0802800640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e930 tx=0x7f07fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc017070 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07fc00c9a0 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07fc00cd70 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0804159a60 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0804164dc0 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0804166460 con 0x7f08040cd640 2024-09-15T22:50:20.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f07fc01a070 con 0x7f08040cd640 2024-09-15T22:50:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 0x7f07e0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:20.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f07fc085fa0 con 0x7f08040cd640 2024-09-15T22:50:20.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.482+0000 7f0801e00640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 0x7f07e0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:20.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.486+0000 7f0801e00640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 0x7f07e0069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f08040cc510 tx=0x7f07f4001640 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:20.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.490+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f07fc056190 con 0x7f08040cd640 2024-09-15T22:50:20.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:20.658+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f08040b3700 con 0x7f08040cd640 2024-09-15T22:50:21.014 INFO:tasks.ceph.mds.c.smithi031.stderr:2024-09-15T22:50:21.010+0000 7f54ac200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:50:21.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.294+0000 7f07fa000640 1 -- 172.21.15.31:0/2164110082 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f07fc05a490 con 0x7f08040cd640 2024-09-15T22:50:21.297 INFO:teuthology.orchestra.run.smithi031.stderr:set pool 4 allow_ec_overwrites to true 2024-09-15T22:50:21.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.294+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 msgr2=0x7f07e0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.294+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 0x7f07e0069db0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f08040cc510 tx=0x7f07f4001640 comp rx=0 tx=0).stop 2024-09-15T22:50:21.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.294+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 msgr2=0x7f0804158230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.294+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f07fc00e930 tx=0x7f07fc00edf0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 shutdown_connections 2024-09-15T22:50:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07e00678f0 0x7f07e0069db0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f08040cd640 0x7f0804158230 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f08040cd1d0 0x7f0804162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 --2- 172.21.15.31:0/2164110082 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f08040b3f10 0x7f0804159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 >> 172.21.15.31:0/2164110082 conn(0x7f080406be90 msgr2=0x7f08040b1080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:21.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 shutdown_connections 2024-09-15T22:50:21.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.298+0000 7f0809000640 1 -- 172.21.15.31:0/2164110082 wait complete. 2024-09-15T22:50:21.339 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-15T22:50:21.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.482+0000 7f3413a00640 1 Processor -- start 2024-09-15T22:50:21.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.482+0000 7f3413a00640 1 -- start start 2024-09-15T22:50:21.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3413a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f340c15e6f0 0x7f340c0b6c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3413a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c09b450 0x7f340c0b71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3413a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f340c0b5f10 con 0x7f340c15e310 2024-09-15T22:50:21.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3413a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f340c09b9c0 con 0x7f340c15e6f0 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3413a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f340c0b6180 con 0x7f340c09b450 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f340c15e6f0 0x7f340c0b6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f340c15e6f0 0x7f340c0b6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55848/0 (socket says 172.21.15.31:55848) 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 -- 172.21.15.31:0/1415640810 learned_addr learned my addr 172.21.15.31:0/1415640810 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3411000640 1 --1- 172.21.15.31:0/1415640810 >> v1:172.21.15.31:6789/0 conn(0x7f340c15e310 0x7f340c0af290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51154/0 (socket says 172.21.15.31:51154) 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f3411a00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c09b450 0x7f340c0b71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.490 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 -- 172.21.15.31:0/1415640810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c09b450 msgr2=0x7f340c0b71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:21.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c09b450 0x7f340c0b71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 -- 172.21.15.31:0/1415640810 >> v1:172.21.15.31:6789/0 conn(0x7f340c15e310 legacy=0x7f340c0af290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340b400640 1 -- 172.21.15.31:0/1415640810 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738062311 0 0) 0x7f340c0b5f10 con 0x7f340c15e310 2024-09-15T22:50:21.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.486+0000 7f340be00640 1 -- 172.21.15.31:0/1415640810 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c0b6460 con 0x7f340c15e6f0 2024-09-15T22:50:21.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f340be00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e6f0 0x7f340c0b6c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009870 tx=0x7f33f801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9830bee2efc7be45 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:21.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f340b400640 1 -- 172.21.15.31:0/1415640810 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80a9610 con 0x7f340c15e6f0 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f340b400640 1 -- 172.21.15.31:0/1415640810 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80a97b0 con 0x7f340c15e6f0 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f340b400640 1 -- 172.21.15.31:0/1415640810 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f80a9b80 con 0x7f340c15e6f0 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- 172.21.15.31:0/1415640810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e6f0 msgr2=0x7f340c0b6c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e6f0 0x7f340c0b6c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f33f8009870 tx=0x7f33f801c530 comp rx=0 tx=0).stop 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- 172.21.15.31:0/1415640810 shutdown_connections 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c09b450 0x7f340c0b71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 --2- 172.21.15.31:0/1415640810 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e6f0 0x7f340c0b6c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- 172.21.15.31:0/1415640810 >> 172.21.15.31:0/1415640810 conn(0x7f340c0b79f0 msgr2=0x7f340c0b3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- 172.21.15.31:0/1415640810 shutdown_connections 2024-09-15T22:50:21.494 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- 172.21.15.31:0/1415640810 wait complete. 2024-09-15T22:50:21.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 Processor -- start 2024-09-15T22:50:21.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.490+0000 7f3413a00640 1 -- start start 2024-09-15T22:50:21.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 0x7f340c15ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c15e6f0 0x7f340c152c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f340c070b20 con 0x7f340c15e310 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f340c070ca0 con 0x7f340c09b450 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f340c070e20 con 0x7f340c15e6f0 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55854/0 (socket says 172.21.15.31:55854) 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 -- 172.21.15.31:0/2283313201 learned_addr learned my addr 172.21.15.31:0/2283313201 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3411a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c15e6f0 0x7f340c152c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3411000640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 0x7f340c15ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 -- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c15e6f0 msgr2=0x7f340c152c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c15e6f0 0x7f340c152c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 -- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 msgr2=0x7f340c15ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 0x7f340c15ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 -- 172.21.15.31:0/2283313201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340c155160 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3411000640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 0x7f340c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f340be00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33f801a160 tx=0x7f340c071320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8004020 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33f80041c0 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33f8003620 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340c155440 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340c155a00 con 0x7f340c15e310 2024-09-15T22:50:21.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340c0af290 con 0x7f340c15e310 2024-09-15T22:50:21.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.494+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33f80037c0 con 0x7f340c15e310 2024-09-15T22:50:21.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.498+0000 7f3408c00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 0x7f33ec069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:21.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.498+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f33f811f9b0 con 0x7f340c15e310 2024-09-15T22:50:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.498+0000 7f3411000640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 0x7f33ec069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:21.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.498+0000 7f3411000640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 0x7f33ec069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33fc007fd0 tx=0x7f33fc007c20 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:21.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.502+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33f80bf070 con 0x7f340c15e310 2024-09-15T22:50:21.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:21.706+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f340c162b60 con 0x7f340c15e310 2024-09-15T22:50:22.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3408c00640 1 -- 172.21.15.31:0/2283313201 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f33f80ad020 con 0x7f340c15e310 2024-09-15T22:50:22.305 INFO:teuthology.orchestra.run.smithi031.stderr:added data pool 4 to fsmap 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 msgr2=0x7f33ec069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 0x7f33ec069d80 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f33fc007fd0 tx=0x7f33fc007c20 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 msgr2=0x7f340c151bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f33f801a160 tx=0x7f340c071320 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 shutdown_connections 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f33ec0678c0 0x7f33ec069d80 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f340c15e6f0 0x7f340c152c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f340c15e310 0x7f340c151bc0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 --2- 172.21.15.31:0/2283313201 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f340c09b450 0x7f340c15ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 >> 172.21.15.31:0/2283313201 conn(0x7f340c0b79f0 msgr2=0x7f340c1620b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:22.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 shutdown_connections 2024-09-15T22:50:22.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.302+0000 7f3413a00640 1 -- 172.21.15.31:0/2283313201 wait complete. 2024-09-15T22:50:22.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.466+0000 7f00fcc00640 1 Processor -- start 2024-09-15T22:50:22.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.466+0000 7f00fcc00640 1 -- start start 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00fcc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f00f8072160 0x7f00f8072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00fcc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00f806e160 0x7f00f806e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00fcc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00f8072a80 con 0x7f00f813fa40 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00fcc00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f00f813f640 con 0x7f00f806e160 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00fcc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f00f81413c0 con 0x7f00f8072160 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00f806e160 0x7f00f806e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00f806e160 0x7f00f806e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55864/0 (socket says 172.21.15.31:55864) 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 -- 172.21.15.31:0/2384343887 learned_addr learned my addr 172.21.15.31:0/2384343887 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:22.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f5e00640 1 --2- 172.21.15.31:0/2384343887 >> v2:172.21.15.102:3300/0 conn(0x7f00f8072160 0x7f00f8072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 -- 172.21.15.31:0/2384343887 >> v2:172.21.15.102:3300/0 conn(0x7f00f8072160 msgr2=0x7f00f8072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 --2- 172.21.15.31:0/2384343887 >> v2:172.21.15.102:3300/0 conn(0x7f00f8072160 0x7f00f8072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 -- 172.21.15.31:0/2384343887 >> v1:172.21.15.31:6789/0 conn(0x7f00f813fa40 legacy=0x7f00f813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f6800640 1 -- 172.21.15.31:0/2384343887 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f81407b0 con 0x7f00f806e160 2024-09-15T22:50:22.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.470+0000 7f00f4a00640 1 -- 172.21.15.31:0/2384343887 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745057335 0 0) 0x7f00f8072a80 con 0x7f00f813fa40 2024-09-15T22:50:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f6800640 1 --2- 172.21.15.31:0/2384343887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f806e5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00f80b5880 tx=0x7f00f001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22a4fb7c706356a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f4a00640 1 -- 172.21.15.31:0/2384343887 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00a5620 con 0x7f00f806e160 2024-09-15T22:50:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f4a00640 1 -- 172.21.15.31:0/2384343887 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00f00a57c0 con 0x7f00f806e160 2024-09-15T22:50:22.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f4a00640 1 -- 172.21.15.31:0/2384343887 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00f00a5b90 con 0x7f00f806e160 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- 172.21.15.31:0/2384343887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 msgr2=0x7f00f806e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2384343887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f806e5d0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f00f80b5880 tx=0x7f00f001c960 comp rx=0 tx=0).stop 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- 172.21.15.31:0/2384343887 shutdown_connections 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2384343887 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f806e5d0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2384343887 >> v2:172.21.15.102:3300/0 conn(0x7f00f8072160 0x7f00f8072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- 172.21.15.31:0/2384343887 >> 172.21.15.31:0/2384343887 conn(0x7f00f8067e00 msgr2=0x7f00f806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:22.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- 172.21.15.31:0/2384343887 shutdown_connections 2024-09-15T22:50:22.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- 172.21.15.31:0/2384343887 wait complete. 2024-09-15T22:50:22.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 Processor -- start 2024-09-15T22:50:22.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- start start 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00f8072160 0x7f00f8156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f813fa40 0x7f00f80ad8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f00f8168ee0 con 0x7f00f806e160 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f00f8168d60 con 0x7f00f813fa40 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00fcc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f00f8169060 con 0x7f00f8072160 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55868/0 (socket says 172.21.15.31:55868) 2024-09-15T22:50:22.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.474+0000 7f00f5e00640 1 -- 172.21.15.31:0/2403639086 learned_addr learned my addr 172.21.15.31:0/2403639086 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 -- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00f8072160 msgr2=0x7f00f8156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00f8072160 0x7f00f8156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 -- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f813fa40 msgr2=0x7f00f80ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f813fa40 0x7f00f80ad8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 -- 172.21.15.31:0/2403639086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00f80ae220 con 0x7f00f806e160 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00f5e00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00e800d830 tx=0x7f00e800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e800b6c0 con 0x7f00f806e160 2024-09-15T22:50:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00e8019070 con 0x7f00f806e160 2024-09-15T22:50:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e800ba60 con 0x7f00f806e160 2024-09-15T22:50:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00f80ae500 con 0x7f00f806e160 2024-09-15T22:50:22.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.478+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00f80aeac0 con 0x7f00f806e160 2024-09-15T22:50:22.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.482+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00f806e5d0 con 0x7f00f806e160 2024-09-15T22:50:22.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.482+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f00e801e460 con 0x7f00f806e160 2024-09-15T22:50:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.482+0000 7f00ee000640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 0x7f00d8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.482+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f00e8086630 con 0x7f00f806e160 2024-09-15T22:50:22.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.482+0000 7f00f5400640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 0x7f00d8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.488 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.486+0000 7f00f5400640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 0x7f00d8069dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00e4007fd0 tx=0x7f00e4007940 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.491 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.486+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f00e8056f10 con 0x7f00f806e160 2024-09-15T22:50:22.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.686+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f00f806d140 con 0x7f00f806e160 2024-09-15T22:50:22.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.686+0000 7f00ee000640 1 -- 172.21.15.31:0/2403639086 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5222 (secure 0 0 0) 0x7f00e8056810 con 0x7f00f806e160 2024-09-15T22:50:22.692 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:22.692 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"btime":"2024-09-15T22:50:22:298429+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:21.710367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:22.692 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 msgr2=0x7f00d8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 0x7f00d8069dd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f00e4007fd0 tx=0x7f00e4007940 comp rx=0 tx=0).stop 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 msgr2=0x7f00f80af2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f00e800d830 tx=0x7f00e800dcf0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 shutdown_connections 2024-09-15T22:50:22.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00d8067910 0x7f00d8069dd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00f813fa40 0x7f00f80ad8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00f8072160 0x7f00f8156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 --2- 172.21.15.31:0/2403639086 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00f806e160 0x7f00f80af2c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 >> 172.21.15.31:0/2403639086 conn(0x7f00f8067e00 msgr2=0x7f00f815d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 shutdown_connections 2024-09-15T22:50:22.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.690+0000 7f00fcc00640 1 -- 172.21.15.31:0/2403639086 wait complete. 2024-09-15T22:50:22.713 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:22.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 Processor -- start 2024-09-15T22:50:22.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 -- start start 2024-09-15T22:50:22.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 0x7f6ac4070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6ac40d0ca0 0x7f6ac406cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ac40701e0 con 0x7f6ac409bb10 2024-09-15T22:50:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6ac406ff90 con 0x7f6ac40d0ca0 2024-09-15T22:50:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac8a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac4070b10 con 0x7f6ac409aa40 2024-09-15T22:50:22.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac2800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 0x7f6ac4070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ab9e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f6ac409bb10 0x7f6ac409ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:53728/0 (socket says 172.21.15.31:53728) 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ab9e00640 1 -- 172.21.15.31:0/834527333 learned_addr learned my addr 172.21.15.31:0/834527333 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac3200640 1 --2- 172.21.15.31:0/834527333 >> v2:172.21.15.102:3300/0 conn(0x7f6ac40d0ca0 0x7f6ac406cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac1e00640 1 -- 172.21.15.31:0/834527333 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 504395663 0 0) 0x7f6ac40701e0 con 0x7f6ac409bb10 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac1e00640 1 -- 172.21.15.31:0/834527333 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6aa8003530 con 0x7f6ac409bb10 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac2800640 1 -- 172.21.15.31:0/834527333 >> v2:172.21.15.102:3300/0 conn(0x7f6ac40d0ca0 msgr2=0x7f6ac406cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac2800640 1 --2- 172.21.15.31:0/834527333 >> v2:172.21.15.102:3300/0 conn(0x7f6ac40d0ca0 0x7f6ac406cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac2800640 1 -- 172.21.15.31:0/834527333 >> v1:172.21.15.102:6789/0 conn(0x7f6ac409bb10 legacy=0x7f6ac409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.850+0000 7f6ac2800640 1 -- 172.21.15.31:0/834527333 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac40704c0 con 0x7f6ac409aa40 2024-09-15T22:50:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac2800640 1 --2- 172.21.15.31:0/834527333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 0x7f6ac4070fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40097f0 tx=0x7f6ab401c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92323550f3ce3deb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac1e00640 1 -- 172.21.15.31:0/834527333 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40aa5f0 con 0x7f6ac409aa40 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac1e00640 1 -- 172.21.15.31:0/834527333 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab40af070 con 0x7f6ac409aa40 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac1e00640 1 -- 172.21.15.31:0/834527333 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab40aa990 con 0x7f6ac409aa40 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 -- 172.21.15.31:0/834527333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 msgr2=0x7f6ac4070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/834527333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 0x7f6ac4070fa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40097f0 tx=0x7f6ab401c470 comp rx=0 tx=0).stop 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 -- 172.21.15.31:0/834527333 shutdown_connections 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/834527333 >> v2:172.21.15.102:3300/0 conn(0x7f6ac40d0ca0 0x7f6ac406cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/834527333 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409aa40 0x7f6ac4070fa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 -- 172.21.15.31:0/834527333 >> 172.21.15.31:0/834527333 conn(0x7f6ac40d2140 msgr2=0x7f6ac40d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 -- 172.21.15.31:0/834527333 shutdown_connections 2024-09-15T22:50:22.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.854+0000 7f6ac8a00640 1 -- 172.21.15.31:0/834527333 wait complete. 2024-09-15T22:50:22.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 Processor -- start 2024-09-15T22:50:22.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- start start 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409bb10 0x7f6ac4154a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ac40d0ca0 0x7f6ac41587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac416b490 con 0x7f6ac409aa40 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ac415e8a0 con 0x7f6ac40d0ca0 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ac416b610 con 0x7f6ac409bb10 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55876/0 (socket says 172.21.15.31:55876) 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 -- 172.21.15.31:0/3337189968 learned_addr learned my addr 172.21.15.31:0/3337189968 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ab9e00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409bb10 0x7f6ac4154a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac3200640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ac40d0ca0 0x7f6ac41587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 -- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409bb10 msgr2=0x7f6ac4154a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409bb10 0x7f6ac4154a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 -- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ac40d0ca0 msgr2=0x7f6ac41587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ac40d0ca0 0x7f6ac41587c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 -- 172.21.15.31:0/3337189968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ac4157a00 con 0x7f6ac409aa40 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac2800640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40ac040 tx=0x7f6ab4019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4003820 con 0x7f6ac409aa40 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ab40039c0 con 0x7f6ac409aa40 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ac4157ce0 con 0x7f6ac409aa40 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab4003d70 con 0x7f6ac409aa40 2024-09-15T22:50:22.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ac4153bc0 con 0x7f6ac409aa40 2024-09-15T22:50:22.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.858+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ac41582f0 con 0x7f6ac409aa40 2024-09-15T22:50:22.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.862+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ab40c2060 con 0x7f6ac409aa40 2024-09-15T22:50:22.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.862+0000 7f6abb400640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 0x7f6aa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:22.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.862+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6ab411f7b0 con 0x7f6ac409aa40 2024-09-15T22:50:22.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.862+0000 7f6ab9e00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 0x7f6aa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:22.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.862+0000 7f6ab9e00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 0x7f6aa0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007fd0 tx=0x7f6aac009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:22.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:22.866+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6ab4016090 con 0x7f6ac409aa40 2024-09-15T22:50:23.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.030+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ac4070fa0 con 0x7f6ac409aa40 2024-09-15T22:50:23.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6abb400640 1 -- 172.21.15.31:0/3337189968 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f6ab40ef8c0 con 0x7f6ac409aa40 2024-09-15T22:50:23.037 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:23.037 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 msgr2=0x7f6aa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 0x7f6aa0069d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6aac007fd0 tx=0x7f6aac009040 comp rx=0 tx=0).stop 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 msgr2=0x7f6ac4153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6ab40ac040 tx=0x7f6ab4019210 comp rx=0 tx=0).stop 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 shutdown_connections 2024-09-15T22:50:23.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6aa00678c0 0x7f6aa0069d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ac40d0ca0 0x7f6ac41587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ac409bb10 0x7f6ac4154a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 --2- 172.21.15.31:0/3337189968 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ac409aa40 0x7f6ac4153190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 >> 172.21.15.31:0/3337189968 conn(0x7f6ac40d2140 msgr2=0x7f6ac40cebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 shutdown_connections 2024-09-15T22:50:23.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.034+0000 7f6ac8a00640 1 -- 172.21.15.31:0/3337189968 wait complete. 2024-09-15T22:50:23.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:23.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.194+0000 7fe490400640 1 Processor -- start 2024-09-15T22:50:23.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.194+0000 7fe490400640 1 -- start start 2024-09-15T22:50:23.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe490400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe488072870 0x7fe48815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe490400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe488072d40 con 0x7fe48806f270 2024-09-15T22:50:23.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe490400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe488073020 con 0x7fe4880b47a0 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe490400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe48815ba60 con 0x7fe488072870 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48da00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe48806f270 0x7fe48806f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51178/0 (socket says 172.21.15.31:51178) 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48da00640 1 -- 172.21.15.31:0/1046214108 learned_addr learned my addr 172.21.15.31:0/1046214108 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48e400640 1 --2- 172.21.15.31:0/1046214108 >> v2:172.21.15.31:3300/0 conn(0x7fe488072870 0x7fe48815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48e400640 1 -- 172.21.15.31:0/1046214108 >> v1:172.21.15.102:6789/0 conn(0x7fe4880b47a0 legacy=0x7fe488072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48e400640 1 -- 172.21.15.31:0/1046214108 >> v1:172.21.15.31:6789/0 conn(0x7fe48806f270 legacy=0x7fe48806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48e400640 1 -- 172.21.15.31:0/1046214108 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4880b3cc0 con 0x7fe488072870 2024-09-15T22:50:23.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.198+0000 7fe48e400640 1 --2- 172.21.15.31:0/1046214108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe488072870 0x7fe48815c840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe480009d90 tx=0x7fe48001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46caf29850cf3726 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe487e00640 1 -- 172.21.15.31:0/1046214108 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800b2070 con 0x7fe488072870 2024-09-15T22:50:23.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe487e00640 1 -- 172.21.15.31:0/1046214108 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800a5830 con 0x7fe488072870 2024-09-15T22:50:23.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe487e00640 1 -- 172.21.15.31:0/1046214108 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800a5c00 con 0x7fe488072870 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- 172.21.15.31:0/1046214108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe488072870 msgr2=0x7fe48815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 --2- 172.21.15.31:0/1046214108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe488072870 0x7fe48815c840 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe480009d90 tx=0x7fe48001c970 comp rx=0 tx=0).stop 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- 172.21.15.31:0/1046214108 shutdown_connections 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 --2- 172.21.15.31:0/1046214108 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe488072870 0x7fe48815c840 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- 172.21.15.31:0/1046214108 >> 172.21.15.31:0/1046214108 conn(0x7fe488067e00 msgr2=0x7fe48806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- 172.21.15.31:0/1046214108 shutdown_connections 2024-09-15T22:50:23.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- 172.21.15.31:0/1046214108 wait complete. 2024-09-15T22:50:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 Processor -- start 2024-09-15T22:50:23.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- start start 2024-09-15T22:50:23.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 0x7fe488154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 0x7fe48814cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe48815d310 con 0x7fe4880b47a0 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe48815d190 con 0x7fe48806f270 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe490400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4881694e0 con 0x7fe488072870 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe48e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe48e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55894/0 (socket says 172.21.15.31:55894) 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe48e400640 1 -- 172.21.15.31:0/1345822326 learned_addr learned my addr 172.21.15.31:0/1345822326 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe48da00640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 0x7fe488154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.202+0000 7fe48d000640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 0x7fe48814cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 -- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 msgr2=0x7fe48814cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 0x7fe48814cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 -- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 msgr2=0x7fe488154eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 0x7fe488154eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 -- 172.21.15.31:0/1345822326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4880aaf80 con 0x7fe4880b47a0 2024-09-15T22:50:23.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48da00640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 0x7fe488154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:23.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48d000640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 0x7fe48814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe48e400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe48001a5a0 tx=0x7fe480019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800b2040 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4800bf070 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4800b8870 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4880ab260 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4880ab820 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe48815c840 con 0x7fe4880b47a0 2024-09-15T22:50:23.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4800b8a10 con 0x7fe4880b47a0 2024-09-15T22:50:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 0x7fe468069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.206+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe480120d30 con 0x7fe4880b47a0 2024-09-15T22:50:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.210+0000 7fe48da00640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 0x7fe468069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.212 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.210+0000 7fe48da00640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 0x7fe468069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005890 tx=0x7fe47c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.210+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4800c8020 con 0x7fe4880b47a0 2024-09-15T22:50:23.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.378+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe4880b5860 con 0x7fe4880b47a0 2024-09-15T22:50:23.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.378+0000 7fe485600640 1 -- 172.21.15.31:0/1345822326 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fe480016560 con 0x7fe4880b47a0 2024-09-15T22:50:23.383 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:23.383 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 msgr2=0x7fe468069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 0x7fe468069db0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe47c005890 tx=0x7fe47c009040 comp rx=0 tx=0).stop 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 msgr2=0x7fe4880acea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe48001a5a0 tx=0x7fe480019710 comp rx=0 tx=0).stop 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 shutdown_connections 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4680678f0 0x7fe468069db0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4880b47a0 0x7fe4880acea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe488072870 0x7fe48814cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 --2- 172.21.15.31:0/1345822326 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe48806f270 0x7fe488154eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 >> 172.21.15.31:0/1345822326 conn(0x7fe488067e00 msgr2=0x7fe488072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 shutdown_connections 2024-09-15T22:50:23.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.382+0000 7fe490400640 1 -- 172.21.15.31:0/1345822326 wait complete. 2024-09-15T22:50:23.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:23.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 Processor -- start 2024-09-15T22:50:23.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 -- start start 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1da009b7a0 0x7f1da015d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da00cff80 0x7f1da00d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da00ce2b0 con 0x7f1da009aa40 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1da00cde20 con 0x7f1da009b7a0 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da8000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1da00cd210 con 0x7f1da00cff80 2024-09-15T22:50:23.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da5600640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1da009aa40 0x7f1da009ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51190/0 (socket says 172.21.15.31:51190) 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da5600640 1 -- 172.21.15.31:0/423744833 learned_addr learned my addr 172.21.15.31:0/423744833 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da4c00640 1 --2- 172.21.15.31:0/423744833 >> v2:172.21.15.31:3300/0 conn(0x7f1da009b7a0 0x7f1da015d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da6000640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da00cff80 0x7f1da00d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da4c00640 1 -- 172.21.15.31:0/423744833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da00cff80 msgr2=0x7f1da00d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da4c00640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da00cff80 0x7f1da00d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da4c00640 1 -- 172.21.15.31:0/423744833 >> v1:172.21.15.31:6789/0 conn(0x7f1da009aa40 legacy=0x7f1da009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.558+0000 7f1da4c00640 1 -- 172.21.15.31:0/423744833 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da00cd4f0 con 0x7f1da009b7a0 2024-09-15T22:50:23.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da4c00640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da009b7a0 0x7f1da015d490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0097c0 tx=0x7f1d8c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abcba5045e51be36 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1d9fe00640 1 -- 172.21.15.31:0/423744833 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0b0070 con 0x7f1da009b7a0 2024-09-15T22:50:23.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1d9fe00640 1 -- 172.21.15.31:0/423744833 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d8c0ab600 con 0x7f1da009b7a0 2024-09-15T22:50:23.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1d9fe00640 1 -- 172.21.15.31:0/423744833 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8c0ab9d0 con 0x7f1da009b7a0 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- 172.21.15.31:0/423744833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da009b7a0 msgr2=0x7f1da015d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da009b7a0 0x7f1da015d490 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0097c0 tx=0x7f1d8c01c410 comp rx=0 tx=0).stop 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- 172.21.15.31:0/423744833 shutdown_connections 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da00cff80 0x7f1da00d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 --2- 172.21.15.31:0/423744833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da009b7a0 0x7f1da015d490 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- 172.21.15.31:0/423744833 >> 172.21.15.31:0/423744833 conn(0x7f1da00d23b0 msgr2=0x7f1da00d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- 172.21.15.31:0/423744833 shutdown_connections 2024-09-15T22:50:23.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- 172.21.15.31:0/423744833 wait complete. 2024-09-15T22:50:23.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 Processor -- start 2024-09-15T22:50:23.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.562+0000 7f1da8000640 1 -- start start 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da009aa40 0x7f1da00af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 0x7f1da0071610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1da01692c0 con 0x7f1da00cff80 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1da015c7b0 con 0x7f1da009b7a0 2024-09-15T22:50:23.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1da0169440 con 0x7f1da009aa40 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55902/0 (socket says 172.21.15.31:55902) 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 -- 172.21.15.31:0/3341989014 learned_addr learned my addr 172.21.15.31:0/3341989014 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da4c00640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 0x7f1da0071610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da5600640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da009aa40 0x7f1da00af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 -- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da009aa40 msgr2=0x7f1da00af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da009aa40 0x7f1da00af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 -- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 msgr2=0x7f1da0071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 0x7f1da0071610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 -- 172.21.15.31:0/3341989014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da00afa80 con 0x7f1da00cff80 2024-09-15T22:50:23.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da4c00640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 0x7f1da0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da6000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800efc0 tx=0x7f1d9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98018020 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98014480 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98014870 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da00afd60 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da00b0320 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da015d490 con 0x7f1da00cff80 2024-09-15T22:50:23.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.566+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d9801b020 con 0x7f1da00cff80 2024-09-15T22:50:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.570+0000 7f1d9d600640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 0x7f1d80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.570+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1d98086a90 con 0x7f1da00cff80 2024-09-15T22:50:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.570+0000 7f1da5600640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 0x7f1d80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.570+0000 7f1da5600640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 0x7f1d80069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d94000f70 tx=0x7f1d94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.574+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d98022070 con 0x7f1da00cff80 2024-09-15T22:50:23.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1da00d30e0 con 0x7f1da00cff80 2024-09-15T22:50:23.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1d9d600640 1 -- 172.21.15.31:0/3341989014 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5222 (secure 0 0 0) 0x7f1d98010040 con 0x7f1da00cff80 2024-09-15T22:50:23.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:23.777 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":6,"btime":"2024-09-15T22:50:22:298429+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:21.710367+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:23.778 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 6 2024-09-15T22:50:23.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 msgr2=0x7f1d80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 0x7f1d80069d80 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f1d94000f70 tx=0x7f1d94009040 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 msgr2=0x7f1da01541b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d9800efc0 tx=0x7f1d9800c490 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 shutdown_connections 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1d800678c0 0x7f1d80069d80 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1da00cff80 0x7f1da01541b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1da009b7a0 0x7f1da0071610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 --2- 172.21.15.31:0/3341989014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1da009aa40 0x7f1da00af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 >> 172.21.15.31:0/3341989014 conn(0x7f1da00d23b0 msgr2=0x7f1da015f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 shutdown_connections 2024-09-15T22:50:23.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.774+0000 7f1da8000640 1 -- 172.21.15.31:0/3341989014 wait complete. 2024-09-15T22:50:23.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:23.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 Processor -- start 2024-09-15T22:50:23.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 -- start start 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 0x7f9ee4161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee40d0c70 con 0x7f9ee415e6d0 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ee40d0f50 con 0x7f9ee415f770 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9eeba00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee4160040 con 0x7f9ee409b150 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9ee415e6d0 0x7f9ee40d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:51200/0 (socket says 172.21.15.31:51200) 2024-09-15T22:50:23.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9000640 1 -- 172.21.15.31:0/1981253258 learned_addr learned my addr 172.21.15.31:0/1981253258 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9a00640 1 --2- 172.21.15.31:0/1981253258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 0x7f9ee4161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165352174 0 0) 0x7f9ee40d0c70 con 0x7f9ee415e6d0 2024-09-15T22:50:23.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec8003530 con 0x7f9ee415e6d0 2024-09-15T22:50:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1048845823 0 0) 0x7f9ee40d0f50 con 0x7f9ee415f770 2024-09-15T22:50:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ee40d0c70 con 0x7f9ee415f770 2024-09-15T22:50:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9a00640 1 -- 172.21.15.31:0/1981253258 >> v1:172.21.15.102:6789/0 conn(0x7f9ee415f770 legacy=0x7f9ee409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9a00640 1 -- 172.21.15.31:0/1981253258 >> v1:172.21.15.31:6789/0 conn(0x7f9ee415e6d0 legacy=0x7f9ee40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.938+0000 7f9ee9a00640 1 -- 172.21.15.31:0/1981253258 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee40d1230 con 0x7f9ee409b150 2024-09-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9ee9a00640 1 --2- 172.21.15.31:0/1981253258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 0x7f9ee4161410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009dc0 tx=0x7f9edc01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32bbdcc74c489f82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0b2070 con 0x7f9ee409b150 2024-09-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9edc0a59c0 con 0x7f9ee409b150 2024-09-15T22:50:23.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9ee3e00640 1 -- 172.21.15.31:0/1981253258 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0a5d90 con 0x7f9ee409b150 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 -- 172.21.15.31:0/1981253258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 msgr2=0x7f9ee4161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 --2- 172.21.15.31:0/1981253258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 0x7f9ee4161410 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009dc0 tx=0x7f9edc01c960 comp rx=0 tx=0).stop 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 -- 172.21.15.31:0/1981253258 shutdown_connections 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 --2- 172.21.15.31:0/1981253258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee409b150 0x7f9ee4161410 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 -- 172.21.15.31:0/1981253258 >> 172.21.15.31:0/1981253258 conn(0x7f9ee40d23b0 msgr2=0x7f9ee40d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:23.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 -- 172.21.15.31:0/1981253258 shutdown_connections 2024-09-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.942+0000 7f9eeba00640 1 -- 172.21.15.31:0/1981253258 wait complete. 2024-09-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 Processor -- start 2024-09-15T22:50:23.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 -- start start 2024-09-15T22:50:23.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 0x7f9ee40713a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee415f770 0x7f9ee40b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee406e0c0 con 0x7f9ee409b150 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9ee415fb50 con 0x7f9ee415e6d0 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9ee406e240 con 0x7f9ee415f770 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55916/0 (socket says 172.21.15.31:55916) 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 -- 172.21.15.31:0/57916480 learned_addr learned my addr 172.21.15.31:0/57916480 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9a00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee415f770 0x7f9ee40b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9edbe00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 0x7f9ee40713a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 -- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee415f770 msgr2=0x7f9ee40b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee415f770 0x7f9ee40b1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 -- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 msgr2=0x7f9ee40713a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 0x7f9ee40713a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:23.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 -- 172.21.15.31:0/57916480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ee40b7600 con 0x7f9ee409b150 2024-09-15T22:50:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9edbe00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 0x7f9ee40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee9000640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c4d0 tx=0x7f9ed400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4017070 con 0x7f9ee409b150 2024-09-15T22:50:23.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed4005cf0 con 0x7f9ee409b150 2024-09-15T22:50:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ee40b78e0 con 0x7f9ee409b150 2024-09-15T22:50:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.946+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ed40072b0 con 0x7f9ee409b150 2024-09-15T22:50:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ee40b7ea0 con 0x7f9ee409b150 2024-09-15T22:50:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ee4161410 con 0x7f9ee409b150 2024-09-15T22:50:23.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9ed401a070 con 0x7f9ee409b150 2024-09-15T22:50:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9ee1600640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 0x7f9ec0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9ed4085300 con 0x7f9ee409b150 2024-09-15T22:50:23.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.950+0000 7f9edbe00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 0x7f9ec0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:23.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.954+0000 7f9edbe00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 0x7f9ec0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee415bea0 tx=0x7f9ecc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:23.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:23.954+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9ed4055540 con 0x7f9ee409b150 2024-09-15T22:50:24.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.126+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9ee409ad20 con 0x7f9ee409b150 2024-09-15T22:50:24.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.126+0000 7f9ee1600640 1 -- 172.21.15.31:0/57916480 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f9ed4059840 con 0x7f9ee409b150 2024-09-15T22:50:24.132 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:24.132 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 msgr2=0x7f9ec0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 0x7f9ec0069d80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ee415bea0 tx=0x7f9ecc009040 comp rx=0 tx=0).stop 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 msgr2=0x7f9ee41565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400c4d0 tx=0x7f9ed400c990 comp rx=0 tx=0).stop 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 shutdown_connections 2024-09-15T22:50:24.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9ec00678c0 0x7f9ec0069d80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9ee415f770 0x7f9ee40b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9ee415e6d0 0x7f9ee40713a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 --2- 172.21.15.31:0/57916480 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9ee409b150 0x7f9ee41565e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 >> 172.21.15.31:0/57916480 conn(0x7f9ee40d23b0 msgr2=0x7f9ee40d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 shutdown_connections 2024-09-15T22:50:24.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.130+0000 7f9eeba00640 1 -- 172.21.15.31:0/57916480 wait complete. 2024-09-15T22:50:24.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:50:16.436200+0000', 'modified': '2024-09-15T22:50:21.710367+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6834/2632823405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 2632823405}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 2632823405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-09-15T22:50:24.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:50:24.556 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:50:24.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 Processor -- start 2024-09-15T22:50:24.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 -- start start 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87b00b47a0 0x7f87b0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b0072ad0 con 0x7f87b006f270 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f87b015ba60 con 0x7f87b00b47a0 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.694+0000 7f87b5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87b00affa0 con 0x7f87b00726a0 2024-09-15T22:50:24.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87b00b47a0 0x7f87b0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f87b00b47a0 0x7f87b0072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55926/0 (socket says 172.21.15.31:55926) 2024-09-15T22:50:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 -- 172.21.15.31:0/467173646 learned_addr learned my addr 172.21.15.31:0/467173646 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87aea00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f87b006f270 0x7f87b006f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:53758/0 (socket says 172.21.15.31:53758) 2024-09-15T22:50:24.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87af400640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 -- 172.21.15.31:0/467173646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 msgr2=0x7f87b015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b015c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 -- 172.21.15.31:0/467173646 >> v1:172.21.15.102:6789/0 conn(0x7f87b006f270 legacy=0x7f87b006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 -- 172.21.15.31:0/467173646 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0072d40 con 0x7f87b00b47a0 2024-09-15T22:50:24.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ad600640 1 -- 172.21.15.31:0/467173646 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1382141684 0 0) 0x7f87b0072ad0 con 0x7f87b006f270 2024-09-15T22:50:24.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ae000640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0072160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f879c009870 tx=0x7f879c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312d5628ea329898 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ad600640 1 -- 172.21.15.31:0/467173646 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c0ab650 con 0x7f87b00b47a0 2024-09-15T22:50:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ad600640 1 -- 172.21.15.31:0/467173646 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f879c0b0070 con 0x7f87b00b47a0 2024-09-15T22:50:24.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.698+0000 7f87ad600640 1 -- 172.21.15.31:0/467173646 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c0aba10 con 0x7f87b00b47a0 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- 172.21.15.31:0/467173646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 msgr2=0x7f87b0072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0072160 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f879c009870 tx=0x7f879c01c560 comp rx=0 tx=0).stop 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- 172.21.15.31:0/467173646 shutdown_connections 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b015c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- 172.21.15.31:0/467173646 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0072160 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- 172.21.15.31:0/467173646 >> 172.21.15.31:0/467173646 conn(0x7f87b0067e00 msgr2=0x7f87b006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- 172.21.15.31:0/467173646 shutdown_connections 2024-09-15T22:50:24.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- 172.21.15.31:0/467173646 wait complete. 2024-09-15T22:50:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 Processor -- start 2024-09-15T22:50:24.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- start start 2024-09-15T22:50:24.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87b006f270 0x7f87b0143890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b01431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00b4c30 con 0x7f87b00b47a0 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0155a10 con 0x7f87b006f270 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87b5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87b0143e70 con 0x7f87b00726a0 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55938/0 (socket says 172.21.15.31:55938) 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 -- 172.21.15.31:0/2727330422 learned_addr learned my addr 172.21.15.31:0/2727330422 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87aea00640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87b006f270 0x7f87b0143890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87ae000640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b01431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 -- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 msgr2=0x7f87b01431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b01431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 -- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87b006f270 msgr2=0x7f87b0143890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87b006f270 0x7f87b0143890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.702+0000 7f87af400640 1 -- 172.21.15.31:0/2727330422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b00b3570 con 0x7f87b00b47a0 2024-09-15T22:50:24.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87af400640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009dd0 tx=0x7f87a800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 -- 172.21.15.31:0/2727330422 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8018020 con 0x7f87b00b47a0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 -- 172.21.15.31:0/2727330422 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a8014480 con 0x7f87b00b47a0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 -- 172.21.15.31:0/2727330422 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a8014870 con 0x7f87b00b47a0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b0153930 con 0x7f87b00b47a0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b0151290 con 0x7f87b00b47a0 2024-09-15T22:50:24.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 -- 172.21.15.31:0/2727330422 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f87a801b020 con 0x7f87b00b47a0 2024-09-15T22:50:24.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87a6a00640 1 -- 172.21.15.31:0/2727330422 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f87a8086af0 con 0x7f87b00b47a0 2024-09-15T22:50:24.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87b8bf9000 1 Processor -- start 2024-09-15T22:50:24.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.706+0000 7f87aea00640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- start start 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 0x7f8790069db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87a0000f70 tx=0x7f87a0007c30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae01fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 0x55aaae020670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55aaadf07b60 con 0x55aaae069b20 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aaade6ec70 con 0x55aaae06a440 2024-09-15T22:50:24.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55aaade14ed0 con 0x55aaae020290 2024-09-15T22:50:24.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55950/0 (socket says 172.21.15.31:55950) 2024-09-15T22:50:24.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 -- 172.21.15.31:0/3451866908 learned_addr learned my addr 172.21.15.31:0/3451866908 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87ae000640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae01fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87af400640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 0x55aaae020670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 -- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 msgr2=0x55aaae020670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 0x55aaae020670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 -- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 msgr2=0x55aaae01fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae01fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 -- 172.21.15.31:0/3451866908 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaade26e50 con 0x55aaae069b20 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87af400640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 0x55aaae020670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87aea00640 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005d70 tx=0x7f87a0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9ad948cdf648c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f879b400640 1 -- 172.21.15.31:0/3451866908 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0005e60 con 0x55aaae069b20 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f879b400640 1 -- 172.21.15.31:0/3451866908 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0015110 con 0x55aaae069b20 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f879b400640 1 -- 172.21.15.31:0/3451866908 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0015bc0 con 0x55aaae069b20 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- 172.21.15.31:0/3451866908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 msgr2=0x55aaae069f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f87a0005d70 tx=0x7f87a0012000 comp rx=0 tx=0).stop 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- 172.21.15.31:0/3451866908 shutdown_connections 2024-09-15T22:50:24.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae020290 0x55aaae020670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae01fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/3451866908 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae069f00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- 172.21.15.31:0/3451866908 >> 172.21.15.31:0/3451866908 conn(0x55aaae026600 msgr2=0x55aaae01e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- 172.21.15.31:0/3451866908 shutdown_connections 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- 172.21.15.31:0/3451866908 wait complete. 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 -- start start 2024-09-15T22:50:24.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.710+0000 7f87b8bf9000 1 Processor -- start 2024-09-15T22:50:24.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae024e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 0x55aaae02b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55aaaded0b00 con 0x55aaae06a440 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aaade49360 con 0x55aaae025390 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55aaade462d0 con 0x55aaae069b20 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 10 client.0 _ll_register_callbacks cb 0x55aaae00b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55956/0 (socket says 172.21.15.31:55956) 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 -- 172.21.15.31:0/1846048435 learned_addr learned my addr 172.21.15.31:0/1846048435 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87aea00640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae024e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87af400640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 0x55aaae02b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 -- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 msgr2=0x55aaae024e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae024e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 -- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 msgr2=0x55aaae02b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 0x55aaae02b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 -- 172.21.15.31:0/1846048435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaade15120 con 0x55aaae06a440 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87af400640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 0x55aaae02b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87ae000640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f879c009870 tx=0x7f879c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d8619c8e7f7181a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c0c3060 con 0x55aaae06a440 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a0015110 con 0x55aaae06a440 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f879c003620 con 0x55aaae06a440 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f879c003820 con 0x55aaae06a440 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 10 client.4407 fetch_fsmap learned FSMap version 6 2024-09-15T22:50:24.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55aaade0e450 con 0x55aaae06a440 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0015110 con 0x55aaae06a440 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f879c0bd070 con 0x55aaae06a440 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 10 client.4407 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 10 client.4407 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 20 client.4407 populate_metadata read hostname 'smithi031' 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae078280 0x55aaae07a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 4 client.4407 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 --> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aaade08c00 con 0x55aaae078280 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87aea00640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae078280 0x55aaae07a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f878fe00640 10 client.4407 ms_handle_connect on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:24.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.714+0000 7f87aea00640 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae078280 0x55aaae07a670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6bfa2a083a08040 server_cookie=195ea277c27eba5d in_seq=0 out_seq=0 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f878fe00640 1 -- 172.21.15.31:0/1846048435 <== mds.0 v2:172.21.15.31:6832/2632823405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55aaade08c00 con 0x55aaae078280 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f878fe00640 10 client.4407 handle_command_reply: tid=0 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 client.4407 shutdown 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 msgr2=0x55aaae02acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f879c009870 tx=0x7f879c01ada0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 shutdown_connections 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae078280 0x55aaae07a670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae025390 0x55aaae02b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae06a440 0x55aaae02acf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f878fe00640 0 client.4407 ms_handle_reset on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1846048435 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae024e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 >> 172.21.15.31:0/1846048435 conn(0x55aaae020290 msgr2=0x55aaae01ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 shutdown_connections 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1846048435 wait complete. 2024-09-15T22:50:24.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.718+0000 7f87b8bf9000 20 client.4407 trim_cache size 0 max 16384 2024-09-15T22:50:24.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.734+0000 7f87b8bf9000 1 Processor -- start 2024-09-15T22:50:24.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.734+0000 7f87b8bf9000 1 -- start start 2024-09-15T22:50:24.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae069200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae07a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f87b0203e30 con 0x55aaae025390 2024-09-15T22:50:24.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f87b00b0a30 con 0x55aaae06a440 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87b02038e0 con 0x55aaae069b20 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55960/0 (socket says 172.21.15.31:55960) 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 -- 172.21.15.31:0/438415899 learned_addr learned my addr 172.21.15.31:0/438415899 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 -- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 msgr2=0x55aaae069200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae069200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 -- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 msgr2=0x55aaae07a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae07a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 -- 172.21.15.31:0/438415899 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aaaddf5fd0 con 0x55aaae025390 2024-09-15T22:50:24.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87aea00640 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55aaadf26ac0 tx=0x7f87a000a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb9d908a7c8608e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f879aa00640 1 -- 172.21.15.31:0/438415899 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a00159c0 con 0x55aaae025390 2024-09-15T22:50:24.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f879aa00640 1 -- 172.21.15.31:0/438415899 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0015b60 con 0x55aaae025390 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f879aa00640 1 -- 172.21.15.31:0/438415899 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a0021450 con 0x55aaae025390 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- 172.21.15.31:0/438415899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 msgr2=0x55aaae068cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55aaadf26ac0 tx=0x7f87a000a000 comp rx=0 tx=0).stop 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- 172.21.15.31:0/438415899 shutdown_connections 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae07a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae069b20 0x55aaae069200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/438415899 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae025390 0x55aaae068cc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- 172.21.15.31:0/438415899 >> 172.21.15.31:0/438415899 conn(0x55aaae020290 msgr2=0x55aaae024650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- 172.21.15.31:0/438415899 shutdown_connections 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- 172.21.15.31:0/438415899 wait complete. 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 -- start start 2024-09-15T22:50:24.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.738+0000 7f87b8bf9000 1 Processor -- start 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 0x55aaae07d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55aaade6df80 con 0x55aaae069b20 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55aaade26ca0 con 0x55aaae06a440 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55aaade732a0 con 0x55aaae025390 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 10 client.0 _ll_register_callbacks cb 0x7f879c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55966/0 (socket says 172.21.15.31:55966) 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 -- 172.21.15.31:0/1806664122 learned_addr learned my addr 172.21.15.31:0/1806664122 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 -- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 msgr2=0x55aaae07d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87aea00640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 0x55aaae07d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 0x55aaae07d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87af400640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 -- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 msgr2=0x55aaae098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 -- 172.21.15.31:0/1806664122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aaadef1750 con 0x55aaae069b20 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87af400640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87aea00640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 0x55aaae07d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87ae000640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f879c0039e0 tx=0x7f879c019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bafc8070c2b9c0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f879c003620 con 0x55aaae069b20 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a0015b60 con 0x55aaae069b20 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f879c004490 con 0x55aaae069b20 2024-09-15T22:50:24.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f879c003a60 con 0x55aaae069b20 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 10 client.4413 fetch_fsmap learned FSMap version 6 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55aaaddfca30 con 0x55aaae069b20 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a0015b60 con 0x55aaae069b20 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 6) ==== 3510+0+0 (secure 0 0 0) 0x7f879c0cb020 con 0x55aaae069b20 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 10 client.4413 fetch_fsmap finished waiting for FSMap version 6 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 10 client.4413 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 20 client.4413 populate_metadata read hostname 'smithi031' 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae0993e0 0x55aaae0dcd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 4 client.4413 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 --> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] -- command(tid 0: {"prefix": "status"}) -- 0x55aaade7c3a0 con 0x55aaae0993e0 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87aea00640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae0993e0 0x55aaae0dcd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 10 client.4413 ms_handle_connect on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:24.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87aea00640 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae0993e0 0x55aaae0dcd50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=761ece4668777549 server_cookie=fdaf8f85ab34e517 in_seq=0 out_seq=0 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 1 -- 172.21.15.31:0/1806664122 <== mds.0 v2:172.21.15.31:6832/2632823405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x55aaade7c3a0 con 0x55aaae0993e0 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 10 client.4413 handle_command_reply: tid=0 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 client.4413 shutdown 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 msgr2=0x55aaae098960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f879c0039e0 tx=0x7f879c019300 comp rx=0 tx=0).stop 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 shutdown_connections 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x55aaae0993e0 0x55aaae0dcd50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55aaae06a440 0x55aaae098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f878fe00640 0 client.4413 ms_handle_reset on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55aaae069b20 0x55aaae098960 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 --2- 172.21.15.31:0/1806664122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55aaae025390 0x55aaae07d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 >> 172.21.15.31:0/1806664122 conn(0x55aaae020290 msgr2=0x55aaae067cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 shutdown_connections 2024-09-15T22:50:24.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 1 -- 172.21.15.31:0/1806664122 wait complete. 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b8bf9000 20 client.4413 trim_cache size 0 max 16384 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4281, 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 7.7106397729999996, 2024-09-15T22:50:24.752 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 6, 2024-09-15T22:50:24.753 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 25, 2024-09-15T22:50:24.753 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 25, 2024-09-15T22:50:24.753 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 13.745386057999999 2024-09-15T22:50:24.753 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:50:24.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 msgr2=0x7f8790069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 0x7f8790069db0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f87a0000f70 tx=0x7f87a0007c30 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 msgr2=0x7f87b0151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.742+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009dd0 tx=0x7f87a800c490 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 shutdown_connections 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87900678f0 0x7f8790069db0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f87b00b47a0 0x7f87b0151d70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87b00726a0 0x7f87b01431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 --2- 172.21.15.31:0/2727330422 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87b006f270 0x7f87b0143890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 >> 172.21.15.31:0/2727330422 conn(0x7f87b0067e00 msgr2=0x7f87b015a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 shutdown_connections 2024-09-15T22:50:24.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.746+0000 7f87b5800640 1 -- 172.21.15.31:0/2727330422 wait complete. 2024-09-15T22:50:24.767 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:50:24.767 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:24.767 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:50:24.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.902+0000 7fb804c00640 1 Processor -- start 2024-09-15T22:50:24.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.902+0000 7fb804c00640 1 -- start start 2024-09-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.902+0000 7fb804c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb804c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb8000b47a0 0x7fb800072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb804c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb800072ad0 con 0x7fb8000726a0 2024-09-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb804c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb80015ba60 con 0x7fb8000b47a0 2024-09-15T22:50:24.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb804c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb8000affa0 con 0x7fb80006f270 2024-09-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:56564/0 (socket says 172.21.15.31:56564) 2024-09-15T22:50:24.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 -- 172.21.15.31:0/4186240825 learned_addr learned my addr 172.21.15.31:0/4186240825 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7f5400640 1 --2- 172.21.15.31:0/4186240825 >> v2:172.21.15.102:3300/0 conn(0x7fb8000b47a0 0x7fb800072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 -- 172.21.15.31:0/4186240825 >> v2:172.21.15.102:3300/0 conn(0x7fb8000b47a0 msgr2=0x7fb800072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 --2- 172.21.15.31:0/4186240825 >> v2:172.21.15.102:3300/0 conn(0x7fb8000b47a0 0x7fb800072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 -- 172.21.15.31:0/4186240825 >> v1:172.21.15.102:6789/0 conn(0x7fb8000726a0 legacy=0x7fb80015c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 -- 172.21.15.31:0/4186240825 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80006fb90 con 0x7fb80006f270 2024-09-15T22:50:24.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fd400640 1 -- 172.21.15.31:0/4186240825 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223269142 0 0) 0x7fb800072ad0 con 0x7fb8000726a0 2024-09-15T22:50:24.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.906+0000 7fb7fde00640 1 --2- 172.21.15.31:0/4186240825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009870 tx=0x7fb7f001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1aeb308421d03111 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fd400640 1 -- 172.21.15.31:0/4186240825 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00a7070 con 0x7fb80006f270 2024-09-15T22:50:24.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fd400640 1 -- 172.21.15.31:0/4186240825 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00b0070 con 0x7fb80006f270 2024-09-15T22:50:24.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fd400640 1 -- 172.21.15.31:0/4186240825 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00ab890 con 0x7fb80006f270 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- 172.21.15.31:0/4186240825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 msgr2=0x7fb80006f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- 172.21.15.31:0/4186240825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb7f0009870 tx=0x7fb7f001c560 comp rx=0 tx=0).stop 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- 172.21.15.31:0/4186240825 shutdown_connections 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- 172.21.15.31:0/4186240825 >> v2:172.21.15.102:3300/0 conn(0x7fb8000b47a0 0x7fb800072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- 172.21.15.31:0/4186240825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb80006f270 0x7fb80006f650 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- 172.21.15.31:0/4186240825 >> 172.21.15.31:0/4186240825 conn(0x7fb800067e00 msgr2=0x7fb80006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:24.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- 172.21.15.31:0/4186240825 shutdown_connections 2024-09-15T22:50:24.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- 172.21.15.31:0/4186240825 wait complete. 2024-09-15T22:50:24.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 Processor -- start 2024-09-15T22:50:24.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- start start 2024-09-15T22:50:24.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8000726a0 0x7fb800139a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8000b47a0 0x7fb800139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000b3fa0 con 0x7fb80006f270 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb8000b3cc0 con 0x7fb8000726a0 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb804c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb800155a10 con 0x7fb8000b47a0 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41290/0 (socket says 172.21.15.31:41290) 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fde00640 1 -- 172.21.15.31:0/1606144865 learned_addr learned my addr 172.21.15.31:0/1606144865 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7f5400640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8000726a0 0x7fb800139a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.910+0000 7fb7fe800640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8000b47a0 0x7fb800139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 -- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8000b47a0 msgr2=0x7fb800139fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8000b47a0 0x7fb800139fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 -- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8000726a0 msgr2=0x7fb800139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8000726a0 0x7fb800139a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:24.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 -- 172.21.15.31:0/1606144865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb800153ba0 con 0x7fb80006f270 2024-09-15T22:50:24.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7fde00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ad040 tx=0x7fb7f001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00be5f0 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7f00be790 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7f00beb80 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb800153e80 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb800154440 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8000b4b80 con 0x7fb80006f270 2024-09-15T22:50:24.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb7f00b43f0 con 0x7fb80006f270 2024-09-15T22:50:24.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 0x7fb7dc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:24.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.914+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb7f0120a30 con 0x7fb80006f270 2024-09-15T22:50:24.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.918+0000 7fb7f5400640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 0x7fb7dc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:24.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.918+0000 7fb7f5400640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 0x7fb7dc069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb80013c570 tx=0x7fb7e8009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:24.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:24.918+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb7f0016150 con 0x7fb80006f270 2024-09-15T22:50:25.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb80015d610 con 0x7fb80006f270 2024-09-15T22:50:25.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb7f6a00640 1 -- 172.21.15.31:0/1606144865 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7fb7f00f0bd0 con 0x7fb80006f270 2024-09-15T22:50:25.129 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:50:25.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 msgr2=0x7fb7dc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 0x7fb7dc069db0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb80013c570 tx=0x7fb7e8009190 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 msgr2=0x7fb800139550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb7f00ad040 tx=0x7fb7f001ada0 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 shutdown_connections 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb7dc0678f0 0x7fb7dc069db0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb8000b47a0 0x7fb800139fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb8000726a0 0x7fb800139a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 --2- 172.21.15.31:0/1606144865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb80006f270 0x7fb800139550 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 >> 172.21.15.31:0/1606144865 conn(0x7fb800067e00 msgr2=0x7fb80006e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 shutdown_connections 2024-09-15T22:50:25.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25.126+0000 7fb804c00640 1 -- 172.21.15.31:0/1606144865 wait complete. 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:50:25.149 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:50:25.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:25.150 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-15T22:50:25.158 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:50:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42447sec preferred_lft 42447sec 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:d8:cd:ab:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:50:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:25.161 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:50:25.161 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:50:25.162 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:25.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:25.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:25.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:25.317 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:50:25.335 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-15T22:50:25.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:25.337 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-15T22:50:25.409 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-15T22:50:25.409 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:50:25.409 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:50:25.409 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:50:25.410 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:50:25.410 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:50:25.410 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:25.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:25.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:25.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:25.548 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:50:25.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:25.558 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-15T22:50:25.613 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:25.613 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:25.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:25.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-15T22:50:25.613 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:25.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:25.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:25.742 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-15T22:50:25.742 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:25.742 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:25.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-15T22:50:25.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:50:25.742 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-15T22:50:25.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-15T22:50:25.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-15T22:50:25.743 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:25.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:25.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:25.913 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:25.913 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:25.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-15T22:50:25.913 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:50:25.913 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:26.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:26.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:26.041 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-15T22:50:26.041 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:26.041 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:26.050 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-15T22:50:26.050 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:26.051 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:26.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-09-15T22:50:26.168 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:50:26.225 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2024-09-15T22:50:26.226 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-09-15T22:50:26.227 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-09-15T22:50:26.228 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:26.229 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:26.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:26.230 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-09-15T22:50:26.284 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-15T22:50:26.285 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-15T22:50:26.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-09-15T22:50:26.355 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:50:26.405 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-09-15T22:50:26.405 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-09-15T22:50:26.405 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-09-15T22:50:26.405 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-09-15T22:50:26.406 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:26.407 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:26.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:26.408 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-09-15T22:50:26.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:2024-09-15T22:50:26.425+0000 7fecf5c55580 -1 init, newargv = 0x564dc007ccc0 newargc=15 2024-09-15T22:50:26.431 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[35141]: starting ceph client 2024-09-15T22:50:26.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[35141]: starting fuse 2024-09-15T22:50:27.541 DEBUG:teuthology.orchestra.run.smithi031:> sudo modprobe fuse 2024-09-15T22:50:27.566 DEBUG:teuthology.orchestra.run.smithi031:> cat /proc/self/mounts | awk '{print $2}' 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/sys 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/proc 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/dev 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/pts 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/run 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/ 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/security 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/shm 2024-09-15T22:50:27.618 INFO:teuthology.orchestra.run.smithi031.stdout:/run/lock 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/cgroup 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/pstore 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/bpf 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/sys/fs/binfmt_misc 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/hugepages 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/dev/mqueue 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/debug 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/tracing 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/proc/fs/nfsd 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/fs/fuse/connections 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/sys/kernel/config 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/run/credentials/systemd-sysusers.service 2024-09-15T22:50:27.619 INFO:teuthology.orchestra.run.smithi031.stdout:/run/rpc_pipefs 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/run/user/1000 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-0 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-1 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-2 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/var/lib/ceph/osd/ceph-3 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:27.620 INFO:teuthology.orchestra.run.smithi031.stdout:/home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:27.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:27.621 DEBUG:teuthology.orchestra.run.smithi031:> ls /sys/fs/fuse/connections 2024-09-15T22:50:27.672 INFO:teuthology.orchestra.run.smithi031.stdout:44 2024-09-15T22:50:27.672 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [44] 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> sudo stdin-killer -- python3 -c ' 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> import glob 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> import re 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> import subprocess 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> def _find_admin_socket(client_name): 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> files = glob.glob(asok_path) 2024-09-15T22:50:27.673 DEBUG:teuthology.orchestra.run.smithi031:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> # Given a non-glob path, it better be there 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> if "*" not in asok_path: 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> assert(len(files) == 1) 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> return files[0] 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> for f in files: 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> contents = proc_f.read() 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> if mountpoint in contents: 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> return f 2024-09-15T22:50:27.674 DEBUG:teuthology.orchestra.run.smithi031:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-15T22:50:27.675 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:50:27.675 DEBUG:teuthology.orchestra.run.smithi031:> print(_find_admin_socket("client.admin")) 2024-09-15T22:50:27.675 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:50:27.806 INFO:teuthology.orchestra.run.smithi031.stdout:/var/run/ceph/ceph-client.admin.35141.asok 2024-09-15T22:50:27.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:27.818 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.35141.asok 2024-09-15T22:50:27.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:27.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.35141.asok status 2024-09-15T22:50:27.992 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "metadata": { 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_sha1": "8921c8ef947807b717db041d85f0761b7914d5fc", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "ceph_version": "ceph version 19.1.1-326-g8921c8ef (8921c8ef947807b717db041d85f0761b7914d5fc) squid (stable)", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "entity_id": "admin", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "hostname": "smithi031", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "pid": "35141", 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "root": "/" 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_count": 0, 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "dentry_pinned_count": 0, 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4425, 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "inst": { 2024-09-15T22:50:27.993 INFO:teuthology.orchestra.run.smithi031.stdout: "name": { 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "client", 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "num": 4425 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3029056188 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": { 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "type": "v1", 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "addr": "172.21.15.31:0", 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: "nonce": 3029056188 2024-09-15T22:50:27.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "inst_str": "client.4425 172.21.15.31:0/3029056188", 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "addr_str": "172.21.15.31:0/3029056188", 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "inode_count": 1, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "mds_epoch": 6, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch": 25, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "osd_epoch_barrier": 0, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "blocklisted": false, 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs" 2024-09-15T22:50:27.995 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:50:28.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:28.008 DEBUG:teuthology.orchestra.run.smithi031:> stat --file-system '--printf=%T 2024-09-15T22:50:28.008 DEBUG:teuthology.orchestra.run.smithi031:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:28.017 INFO:teuthology.orchestra.run.smithi031.stdout:fuseblk 2024-09-15T22:50:28.017 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:28.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:28.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:28.080 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-15T22:50:28.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:28.195 INFO:teuthology.orchestra.run.smithi031.stdout:# file: . 2024-09-15T22:50:28.195 INFO:teuthology.orchestra.run.smithi031.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-15T22:50:28.195 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:28.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:28.202 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:50:28.202 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:28.211 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:50:28.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 Processor -- start 2024-09-15T22:50:28.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 -- start start 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda015f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 0x7fbda009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda00b1c70 con 0x7fbda00b1890 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbda009af80 con 0x7fbda015ffb0 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda7a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbda009b1e0 con 0x7fbda006d990 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda5000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbda00b1890 0x7fbda006d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:40114/0 (socket says 172.21.15.31:40114) 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda5000640 1 -- 172.21.15.31:0/2599799272 learned_addr learned my addr 172.21.15.31:0/2599799272 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/2599799272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda5a00640 1 --2- 172.21.15.31:0/2599799272 >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 0x7fbda009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9f400640 1 -- 172.21.15.31:0/2599799272 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565438918 0 0) 0x7fbd94001120 con 0x7fbda00b1890 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9f400640 1 -- 172.21.15.31:0/2599799272 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd88003530 con 0x7fbda00b1890 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9fe00640 1 -- 172.21.15.31:0/2599799272 >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 msgr2=0x7fbda009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/2599799272 >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 0x7fbda009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9fe00640 1 -- 172.21.15.31:0/2599799272 >> v1:172.21.15.31:6789/0 conn(0x7fbda00b1890 legacy=0x7fbda006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbd9fe00640 1 -- 172.21.15.31:0/2599799272 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda009b4c0 con 0x7fbda006d990 2024-09-15T22:50:28.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.389+0000 7fbda5a00640 1 --2- 172.21.15.31:0/2599799272 >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 0x7fbda009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/2599799272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda015f810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0097c0 tx=0x7fbd8c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd395dcdcd98faf5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbd9f400640 1 -- 172.21.15.31:0/2599799272 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0b2070 con 0x7fbda006d990 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbd9f400640 1 -- 172.21.15.31:0/2599799272 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0ad640 con 0x7fbda006d990 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbd9f400640 1 -- 172.21.15.31:0/2599799272 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0ada10 con 0x7fbda006d990 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 -- 172.21.15.31:0/2599799272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 msgr2=0x7fbda015f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 --2- 172.21.15.31:0/2599799272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda015f810 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c0097c0 tx=0x7fbd8c01c4a0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 -- 172.21.15.31:0/2599799272 shutdown_connections 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 --2- 172.21.15.31:0/2599799272 >> v2:172.21.15.102:3300/0 conn(0x7fbda015ffb0 0x7fbda009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 --2- 172.21.15.31:0/2599799272 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda015f810 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 -- 172.21.15.31:0/2599799272 >> 172.21.15.31:0/2599799272 conn(0x7fbda00d23b0 msgr2=0x7fbda00d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 -- 172.21.15.31:0/2599799272 shutdown_connections 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.393+0000 7fbda7a00640 1 -- 172.21.15.31:0/2599799272 wait complete. 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 Processor -- start 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- start start 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda00c5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 0x7fbda0146580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbda015e9b0 con 0x7fbda00b1890 2024-09-15T22:50:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbda015e830 con 0x7fbda015ffb0 2024-09-15T22:50:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbda015eb30 con 0x7fbda006d990 2024-09-15T22:50:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41300/0 (socket says 172.21.15.31:41300) 2024-09-15T22:50:28.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 -- 172.21.15.31:0/3526031428 learned_addr learned my addr 172.21.15.31:0/3526031428 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda5000640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda00c5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 -- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 msgr2=0x7fbda00c5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda5a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 0x7fbda0146580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda00c5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 -- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 msgr2=0x7fbda0146580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 0x7fbda0146580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 -- 172.21.15.31:0/3526031428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda015cdb0 con 0x7fbda00b1890 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda5a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 0x7fbda0146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda5000640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda00c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9fe00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c01a0d0 tx=0x7fbd8c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c0b2040 con 0x7fbda00b1890 2024-09-15T22:50:28.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c0bc070 con 0x7fbda00b1890 2024-09-15T22:50:28.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbda015d090 con 0x7fbda00b1890 2024-09-15T22:50:28.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c006e20 con 0x7fbda00b1890 2024-09-15T22:50:28.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbda00c63e0 con 0x7fbda00b1890 2024-09-15T22:50:28.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.397+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbda015f810 con 0x7fbda00b1890 2024-09-15T22:50:28.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.401+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd8c0b6630 con 0x7fbda00b1890 2024-09-15T22:50:28.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.401+0000 7fbd9cc00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 0x7fbd80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.401+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd8c120130 con 0x7fbda00b1890 2024-09-15T22:50:28.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.401+0000 7fbda5000640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 0x7fbd80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.401+0000 7fbda5000640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 0x7fbd80069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd940012c0 tx=0x7fbd94009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.405+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd8c016090 con 0x7fbda00b1890 2024-09-15T22:50:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.581+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbda00d2120 con 0x7fbda00b1890 2024-09-15T22:50:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.581+0000 7fbd9cc00640 1 -- 172.21.15.31:0/3526031428 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fbd8c0f09b0 con 0x7fbda00b1890 2024-09-15T22:50:28.587 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 msgr2=0x7fbd80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 0x7fbd80069d80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd940012c0 tx=0x7fbd94009040 comp rx=0 tx=0).stop 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 msgr2=0x7fbda015a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c01a0d0 tx=0x7fbd8c019240 comp rx=0 tx=0).stop 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 shutdown_connections 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd800678c0 0x7fbd80069d80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbda015ffb0 0x7fbda0146580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbda00b1890 0x7fbda015a560 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 --2- 172.21.15.31:0/3526031428 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbda006d990 0x7fbda00c5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 >> 172.21.15.31:0/3526031428 conn(0x7fbda00d23b0 msgr2=0x7fbda00b2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 shutdown_connections 2024-09-15T22:50:28.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.585+0000 7fbda7a00640 1 -- 172.21.15.31:0/3526031428 wait complete. 2024-09-15T22:50:28.609 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:50:28.609 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:28.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:50:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 Processor -- start 2024-09-15T22:50:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 -- start start 2024-09-15T22:50:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f734015e6d0 0x7f734015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73400d04b0 0x7f734009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73400d0c70 con 0x7f734009af80 2024-09-15T22:50:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f734015fcb0 con 0x7f734015e6d0 2024-09-15T22:50:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f7346000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7340160040 con 0x7f73400d04b0 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733f400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f734015e6d0 0x7f734015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733ea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73400d04b0 0x7f734009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733fe00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f734009af80 0x7f7340161410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:42134/0 (socket says 172.21.15.31:42134) 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733fe00640 1 -- 172.21.15.31:0/316338379 learned_addr learned my addr 172.21.15.31:0/316338379 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733f400640 1 -- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73400d04b0 msgr2=0x7f734009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733f400640 1 --2- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73400d04b0 0x7f734009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733f400640 1 -- 172.21.15.31:0/316338379 >> v1:172.21.15.102:6789/0 conn(0x7f734009af80 legacy=0x7f7340161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.797+0000 7f733f400640 1 -- 172.21.15.31:0/316338379 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73400d0f50 con 0x7f734015e6d0 2024-09-15T22:50:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f733f400640 1 --2- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734015e6d0 0x7f734015f770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7330009dc0 tx=0x7f733001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bf59b2dc368ca39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f733e000640 1 -- 172.21.15.31:0/316338379 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300b2070 con 0x7f734015e6d0 2024-09-15T22:50:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f733e000640 1 -- 172.21.15.31:0/316338379 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73300a5900 con 0x7f734015e6d0 2024-09-15T22:50:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f733e000640 1 -- 172.21.15.31:0/316338379 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300a5cd0 con 0x7f734015e6d0 2024-09-15T22:50:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734015e6d0 msgr2=0x7f734015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 --2- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734015e6d0 0x7f734015f770 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7330009dc0 tx=0x7f733001c950 comp rx=0 tx=0).stop 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- 172.21.15.31:0/316338379 shutdown_connections 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 --2- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f73400d04b0 0x7f734009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 --2- 172.21.15.31:0/316338379 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f734015e6d0 0x7f734015f770 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- 172.21.15.31:0/316338379 >> 172.21.15.31:0/316338379 conn(0x7f73400d23b0 msgr2=0x7f73400d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- 172.21.15.31:0/316338379 shutdown_connections 2024-09-15T22:50:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- 172.21.15.31:0/316338379 wait complete. 2024-09-15T22:50:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 Processor -- start 2024-09-15T22:50:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.801+0000 7f7346000640 1 -- start start 2024-09-15T22:50:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73400d04b0 0x7f7340156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f734015e6d0 0x7f73400af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7340161f30 con 0x7f734009af80 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73400d17f0 con 0x7f73400d04b0 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f73400d0890 con 0x7f734015e6d0 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:41314/0 (socket says 172.21.15.31:41314) 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 -- 172.21.15.31:0/2017778635 learned_addr learned my addr 172.21.15.31:0/2017778635 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733fe00640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f734015e6d0 0x7f73400af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733ea00640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73400d04b0 0x7f7340156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 -- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f734015e6d0 msgr2=0x7f73400af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f734015e6d0 0x7f73400af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 -- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73400d04b0 msgr2=0x7f7340156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73400d04b0 0x7f7340156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 -- 172.21.15.31:0/2017778635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7340159380 con 0x7f734009af80 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f733f400640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73300b0040 tx=0x7f73300196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300b2040 con 0x7f734009af80 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7340159660 con 0x7f734009af80 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73300bf070 con 0x7f734009af80 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73300b8470 con 0x7f734009af80 2024-09-15T22:50:28.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7340158fc0 con 0x7f734009af80 2024-09-15T22:50:28.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.805+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f734009aa40 con 0x7f734009af80 2024-09-15T22:50:28.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.809+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f73300b8610 con 0x7f734009af80 2024-09-15T22:50:28.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.809+0000 7f7337400640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 0x7f7320069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.809+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f73301207d0 con 0x7f734009af80 2024-09-15T22:50:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.809+0000 7f733ea00640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 0x7f7320069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:28.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.809+0000 7f733ea00640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 0x7f7320069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73400c91b0 tx=0x7f732c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:28.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.813+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f73300c8020 con 0x7f734009af80 2024-09-15T22:50:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f73400b8330 con 0x7f734009af80 2024-09-15T22:50:28.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7337400640 1 -- 172.21.15.31:0/2017778635 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f7330016540 con 0x7f734009af80 2024-09-15T22:50:28.998 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 msgr2=0x7f7320069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 0x7f7320069db0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f73400c91b0 tx=0x7f732c009190 comp rx=0 tx=0).stop 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 msgr2=0x7f7340158a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f73300b0040 tx=0x7f73300196f0 comp rx=0 tx=0).stop 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 shutdown_connections 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73200678f0 0x7f7320069db0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f734015e6d0 0x7f73400af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:29.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73400d04b0 0x7f7340156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 --2- 172.21.15.31:0/2017778635 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f734009af80 0x7f7340158a80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 >> 172.21.15.31:0/2017778635 conn(0x7f73400d23b0 msgr2=0x7f73400ce250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 shutdown_connections 2024-09-15T22:50:29.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:28.993+0000 7f7346000640 1 -- 172.21.15.31:0/2017778635 wait complete. 2024-09-15T22:50:29.019 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi031.front.sepia.ceph.com... 2024-09-15T22:50:29.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:29.019 DEBUG:teuthology.orchestra.run.smithi031:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-15T22:50:29.046 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi031.stderr:ceph-fuse[35141]: fuse finished with error 0 and tester_r 0 2024-09-15T22:50:29.049 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:50:35.151 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:50:35.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:35.152 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-15T22:50:35.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.449+0000 7fd18b200640 1 Processor -- start 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.449+0000 7fd18b200640 1 -- start start 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd18b200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1840b1890 0x7fd18415f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd18b200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 0x7fd18409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd18b200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1840b1c70 con 0x7fd18415ffb0 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd18b200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd184160420 con 0x7fd1840b1890 2024-09-15T22:50:35.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd18b200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd18409af80 con 0x7fd18406d990 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd1840b1890 0x7fd18415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd18415ffb0 0x7fd18406d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58412/0 (socket says 172.21.15.31:58412) 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183400640 1 -- 172.21.15.31:0/1240246061 learned_addr learned my addr 172.21.15.31:0/1240246061 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 --2- 172.21.15.31:0/1240246061 >> v2:172.21.15.31:3300/0 conn(0x7fd1840b1890 0x7fd18415f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38932/0 (socket says 172.21.15.31:38932) 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd189200640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 0x7fd18409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 -- 172.21.15.31:0/1240246061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 msgr2=0x7fd18409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 0x7fd18409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 -- 172.21.15.31:0/1240246061 >> v1:172.21.15.31:6789/0 conn(0x7fd18415ffb0 legacy=0x7fd18406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd183e00640 1 -- 172.21.15.31:0/1240246061 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18409b1e0 con 0x7fd1840b1890 2024-09-15T22:50:35.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.453+0000 7fd189200640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 0x7fd18409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd183e00640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd18415f810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1740097f0 tx=0x7fd17401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466394ff4e08dd82 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd182a00640 1 -- 172.21.15.31:0/1240246061 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740a7070 con 0x7fd1840b1890 2024-09-15T22:50:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd182a00640 1 -- 172.21.15.31:0/1240246061 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1740b0070 con 0x7fd1840b1890 2024-09-15T22:50:35.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd182a00640 1 -- 172.21.15.31:0/1240246061 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1740ab890 con 0x7fd1840b1890 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- 172.21.15.31:0/1240246061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 msgr2=0x7fd18415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd18415f810 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fd1740097f0 tx=0x7fd17401c470 comp rx=0 tx=0).stop 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- 172.21.15.31:0/1240246061 shutdown_connections 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18406d990 0x7fd18409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 --2- 172.21.15.31:0/1240246061 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd18415f810 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- 172.21.15.31:0/1240246061 >> 172.21.15.31:0/1240246061 conn(0x7fd1840d23b0 msgr2=0x7fd1840d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- 172.21.15.31:0/1240246061 shutdown_connections 2024-09-15T22:50:35.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- 172.21.15.31:0/1240246061 wait complete. 2024-09-15T22:50:35.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 Processor -- start 2024-09-15T22:50:35.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.457+0000 7fd18b200640 1 -- start start 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd18406d990 0x7fd18415ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18415ffb0 0x7fd184070b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd18415e830 con 0x7fd1840b1890 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1840d0670 con 0x7fd18406d990 2024-09-15T22:50:35.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd18415e9b0 con 0x7fd18415ffb0 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38942/0 (socket says 172.21.15.31:38942) 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 -- 172.21.15.31:0/3747357298 learned_addr learned my addr 172.21.15.31:0/3747357298 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183e00640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd18406d990 0x7fd18415ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd189200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18415ffb0 0x7fd184070b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 -- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18415ffb0 msgr2=0x7fd184070b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18415ffb0 0x7fd184070b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 -- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd18406d990 msgr2=0x7fd18415ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd18406d990 0x7fd18415ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 -- 172.21.15.31:0/3747357298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd18415d890 con 0x7fd1840b1890 2024-09-15T22:50:35.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd183400640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c420 tx=0x7fd17000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170017070 con 0x7fd1840b1890 2024-09-15T22:50:35.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd170005cf0 con 0x7fd1840b1890 2024-09-15T22:50:35.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1700072f0 con 0x7fd1840b1890 2024-09-15T22:50:35.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd18415d5b0 con 0x7fd1840b1890 2024-09-15T22:50:35.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd184141b70 con 0x7fd1840b1890 2024-09-15T22:50:35.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd18409aa40 con 0x7fd1840b1890 2024-09-15T22:50:35.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.461+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd17001a070 con 0x7fd1840b1890 2024-09-15T22:50:35.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.465+0000 7fd17be00640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.465+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd170085420 con 0x7fd1840b1890 2024-09-15T22:50:35.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.465+0000 7fd183e00640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.465+0000 7fd183e00640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 0x7fd164069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1740af000 tx=0x7fd1740a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.469+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1840b1c70 con 0x7fd1840b1890 2024-09-15T22:50:35.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.637+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd1840d2120 con 0x7fd1840b1890 2024-09-15T22:50:35.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.637+0000 7fd17be00640 1 -- 172.21.15.31:0/3747357298 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fd1700554a0 con 0x7fd1840b1890 2024-09-15T22:50:35.643 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:35.643 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:35.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 msgr2=0x7fd164069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 0x7fd164069d80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd1740af000 tx=0x7fd1740a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 msgr2=0x7fd1841442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd17000c420 tx=0x7fd17000c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 shutdown_connections 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1640678c0 0x7fd164069d80 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd18415ffb0 0x7fd184070b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1840b1890 0x7fd1841442e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 --2- 172.21.15.31:0/3747357298 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd18406d990 0x7fd18415ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 >> 172.21.15.31:0/3747357298 conn(0x7fd1840d23b0 msgr2=0x7fd184074780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 shutdown_connections 2024-09-15T22:50:35.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.641+0000 7fd18b200640 1 -- 172.21.15.31:0/3747357298 wait complete. 2024-09-15T22:50:35.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.801+0000 7f148a600640 1 Processor -- start 2024-09-15T22:50:35.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.801+0000 7f148a600640 1 -- start start 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.801+0000 7f148a600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f14840b47a0 0x7f1484072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.801+0000 7f148a600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1484072ad0 con 0x7f148406f270 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f148a600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1484072d40 con 0x7f14840726a0 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f148a600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f148415ba60 con 0x7f14840b47a0 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f148406f270 0x7f148406f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58416/0 (socket says 172.21.15.31:58416) 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 -- 172.21.15.31:0/391998111 learned_addr learned my addr 172.21.15.31:0/391998111 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f147aa00640 1 --2- 172.21.15.31:0/391998111 >> v2:172.21.15.102:3300/0 conn(0x7f14840b47a0 0x7f1484072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770260007 0 0) 0x7f1484072ad0 con 0x7f148406f270 2024-09-15T22:50:35.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1468003530 con 0x7f148406f270 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3987172537 0 0) 0x7f1484072d40 con 0x7f14840726a0 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484072ad0 con 0x7f14840726a0 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1192373539 0 0) 0x7f1468003530 con 0x7f148406f270 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 >> v2:172.21.15.102:3300/0 conn(0x7f14840b47a0 msgr2=0x7f1484072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 --2- 172.21.15.31:0/391998111 >> v2:172.21.15.102:3300/0 conn(0x7f14840b47a0 0x7f1484072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 >> v1:172.21.15.102:6789/0 conn(0x7f14840726a0 legacy=0x7f148415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1484073020 con 0x7f148406f270 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f1474001680 con 0x7f148406f270 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 >> v1:172.21.15.31:6789/0 conn(0x7f148406f270 legacy=0x7f148406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 0x7f1468003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1468004810 0x7f1468004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14680051d0 0x7f146800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f148415ba60 con 0x7f1468003ba0 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f146800c0a0 con 0x7f14680051d0 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f146800c2a0 con 0x7f1468004810 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 0x7f1468003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483e00640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14680051d0 0x7f146800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f147aa00640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1468004810 0x7f1468004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 -- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1468004810 msgr2=0x7f1468004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:35.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1468004810 0x7f1468004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 -- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14680051d0 msgr2=0x7f146800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:35.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14680051d0 0x7f146800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483400640 1 -- 172.21.15.31:0/391998111 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1468003530 con 0x7f1468003ba0 2024-09-15T22:50:35.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.805+0000 7f1483e00640 1 -- 172.21.15.31:0/391998111 reap_dead start 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f1483400640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 0x7f1468003fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1474007fd0 tx=0x7f147401cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d90765ff857c4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474007bf0 con 0x7f1468003ba0 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14740a9070 con 0x7f1468003ba0 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f1482a00640 1 -- 172.21.15.31:0/391998111 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1474005d80 con 0x7f1468003ba0 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 msgr2=0x7f1468003fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 0x7f1468003fa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1474007fd0 tx=0x7f147401cb60 comp rx=0 tx=0).stop 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- 172.21.15.31:0/391998111 shutdown_connections 2024-09-15T22:50:35.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 --2- 172.21.15.31:0/391998111 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1468003ba0 0x7f1468003fa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- 172.21.15.31:0/391998111 >> 172.21.15.31:0/391998111 conn(0x7f1484067e00 msgr2=0x7f148406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:35.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- 172.21.15.31:0/391998111 shutdown_connections 2024-09-15T22:50:35.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- 172.21.15.31:0/391998111 wait complete. 2024-09-15T22:50:35.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 Processor -- start 2024-09-15T22:50:35.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.809+0000 7f148a600640 1 -- start start 2024-09-15T22:50:35.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 0x7f14841e95c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f148414e510 0x7f14841fa9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f148406fa60 con 0x7f14841faee0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f14840b4310 con 0x7f1468003ba0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f148406fbe0 con 0x7f148414e510 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38966/0 (socket says 172.21.15.31:38966) 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 -- 172.21.15.31:0/1444745704 learned_addr learned my addr 172.21.15.31:0/1444745704 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f147aa00640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f148414e510 0x7f14841fa9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483400640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 0x7f14841e95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 -- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f148414e510 msgr2=0x7f14841fa9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f148414e510 0x7f14841fa9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 -- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 msgr2=0x7f14841e95c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 0x7f14841e95c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 -- 172.21.15.31:0/1444745704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1484152da0 con 0x7f14841faee0 2024-09-15T22:50:35.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483400640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 0x7f14841e95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f1483e00640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f148415ebd0 tx=0x7f147c00ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c019070 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147c006e30 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c003b80 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1484150840 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1484150e00 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14840b4bb0 con 0x7f14841faee0 2024-09-15T22:50:35.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.813+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f147c01c070 con 0x7f14841faee0 2024-09-15T22:50:35.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.817+0000 7f147be00640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 0x7f1460069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:35.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.817+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f147c085650 con 0x7f14841faee0 2024-09-15T22:50:35.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.817+0000 7f1483400640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 0x7f1460069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:35.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.817+0000 7f1483400640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 0x7f1460069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14740ab000 tx=0x7f14740a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:35.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.821+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f147c055e40 con 0x7f14841faee0 2024-09-15T22:50:35.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f148406ebd0 con 0x7f14841faee0 2024-09-15T22:50:35.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f147be00640 1 -- 172.21.15.31:0/1444745704 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f147c055740 con 0x7f14841faee0 2024-09-15T22:50:35.994 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:35.994 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:35.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 msgr2=0x7f1460069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 0x7f1460069d80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f14740ab000 tx=0x7f14740a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 msgr2=0x7f14841fb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.989+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f148415ebd0 tx=0x7f147c00ff70 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 shutdown_connections 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14600678c0 0x7f1460069d80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f14841faee0 0x7f14841fb360 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f148414e510 0x7f14841fa9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 --2- 172.21.15.31:0/1444745704 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1468003ba0 0x7f14841e95c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 >> 172.21.15.31:0/1444745704 conn(0x7f1484067e00 msgr2=0x7f148415d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 shutdown_connections 2024-09-15T22:50:35.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:35.993+0000 7f148a600640 1 -- 172.21.15.31:0/1444745704 wait complete. 2024-09-15T22:50:36.017 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:50:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.153+0000 7fcff9e00640 1 Processor -- start 2024-09-15T22:50:36.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.153+0000 7fcff9e00640 1 -- start start 2024-09-15T22:50:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff9e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff9e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcff40d05b0 0x7fcff415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff9e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcff415f1a0 con 0x7fcff41522d0 2024-09-15T22:50:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff9e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcff40d0a20 con 0x7fcff40d05b0 2024-09-15T22:50:36.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff9e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcff41526b0 con 0x7fcff415ed40 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53582/0 (socket says 172.21.15.31:53582) 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff2a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcff41522d0 0x7fcff40b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52480/0 (socket says 172.21.15.31:52480) 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 -- 172.21.15.31:0/2952402769 learned_addr learned my addr 172.21.15.31:0/2952402769 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcff3400640 1 --2- 172.21.15.31:0/2952402769 >> v2:172.21.15.102:3300/0 conn(0x7fcff40d05b0 0x7fcff415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 -- 172.21.15.31:0/2952402769 >> v2:172.21.15.102:3300/0 conn(0x7fcff40d05b0 msgr2=0x7fcff415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:36.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 --2- 172.21.15.31:0/2952402769 >> v2:172.21.15.102:3300/0 conn(0x7fcff40d05b0 0x7fcff415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 -- 172.21.15.31:0/2952402769 >> v1:172.21.15.102:6789/0 conn(0x7fcff41522d0 legacy=0x7fcff40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.157+0000 7fcfebe00640 1 -- 172.21.15.31:0/2952402769 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff40ce310 con 0x7fcff415ed40 2024-09-15T22:50:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcfebe00640 1 --2- 172.21.15.31:0/2952402769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bb10 tx=0x7fcfdc01ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1ea2f71c3fbd0a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff2000640 1 -- 172.21.15.31:0/2952402769 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0b4070 con 0x7fcff415ed40 2024-09-15T22:50:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff2000640 1 -- 172.21.15.31:0/2952402769 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfdc0a7bd0 con 0x7fcff415ed40 2024-09-15T22:50:36.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff2000640 1 -- 172.21.15.31:0/2952402769 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfdc0af440 con 0x7fcff415ed40 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- 172.21.15.31:0/2952402769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 msgr2=0x7fcff40d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2952402769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bb10 tx=0x7fcfdc01ec00 comp rx=0 tx=0).stop 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- 172.21.15.31:0/2952402769 shutdown_connections 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2952402769 >> v2:172.21.15.102:3300/0 conn(0x7fcff40d05b0 0x7fcff415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2952402769 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff415ed40 0x7fcff40d0070 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- 172.21.15.31:0/2952402769 >> 172.21.15.31:0/2952402769 conn(0x7fcff406be90 msgr2=0x7fcff406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- 172.21.15.31:0/2952402769 shutdown_connections 2024-09-15T22:50:36.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- 172.21.15.31:0/2952402769 wait complete. 2024-09-15T22:50:36.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 Processor -- start 2024-09-15T22:50:36.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.161+0000 7fcff9e00640 1 -- start start 2024-09-15T22:50:36.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff41522d0 0x7fcff414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff415ed40 0x7fcff41501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40cdfe0 con 0x7fcff40d05b0 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcff40cee90 con 0x7fcff415ed40 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcff40b3230 con 0x7fcff41522d0 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38972/0 (socket says 172.21.15.31:38972) 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 -- 172.21.15.31:0/2165828781 learned_addr learned my addr 172.21.15.31:0/2165828781 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff3400640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff415ed40 0x7fcff41501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcfebe00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff41522d0 0x7fcff414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 -- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff41522d0 msgr2=0x7fcff414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff41522d0 0x7fcff414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 -- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff415ed40 msgr2=0x7fcff41501c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:36.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff415ed40 0x7fcff41501c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:36.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 -- 172.21.15.31:0/2165828781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff41485e0 con 0x7fcff40d05b0 2024-09-15T22:50:36.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff2a00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c420 tx=0x7fcfe400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe40074e0 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe4007680 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfe4004a30 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff414d890 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff414de50 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff415b190 con 0x7fcff40d05b0 2024-09-15T22:50:36.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.165+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcfe401a020 con 0x7fcff40d05b0 2024-09-15T22:50:36.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.169+0000 7fcfeb400640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 0x7fcfd0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:36.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.169+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfe4085690 con 0x7fcff40d05b0 2024-09-15T22:50:36.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.169+0000 7fcfebe00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 0x7fcfd0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:36.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.169+0000 7fcfebe00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 0x7fcfd0069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bb10 tx=0x7fcfdc0a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:36.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.173+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcff415f1a0 con 0x7fcff40d05b0 2024-09-15T22:50:36.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:36.373+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fcff40cfc90 con 0x7fcff40d05b0 2024-09-15T22:50:37.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcfeb400640 1 -- 172.21.15.31:0/2165828781 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fcfe4055830 con 0x7fcff40d05b0 2024-09-15T22:50:37.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 msgr2=0x7fcfd0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 0x7fcfd0069db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fcfdc00bb10 tx=0x7fcfdc0a9070 comp rx=0 tx=0).stop 2024-09-15T22:50:37.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 msgr2=0x7fcff41480a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcfe400c420 tx=0x7fcfe400c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 shutdown_connections 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcfd00678f0 0x7fcfd0069db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcff415ed40 0x7fcff41501c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcff41522d0 0x7fcff414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.345+0000 7fcff9e00640 1 --2- 172.21.15.31:0/2165828781 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcff40d05b0 0x7fcff41480a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.349+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 >> 172.21.15.31:0/2165828781 conn(0x7fcff406be90 msgr2=0x7fcff40b2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.349+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 shutdown_connections 2024-09-15T22:50:37.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.349+0000 7fcff9e00640 1 -- 172.21.15.31:0/2165828781 wait complete. 2024-09-15T22:50:37.377 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-09-15T22:50:37.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:50:37.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 Processor -- start 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 -- start start 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd9c09b2b0 0x7efd9c0d0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd9c0d0ae0 con 0x7efd9c09aed0 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7efd9c0d0dc0 con 0x7efd9c09b2b0 2024-09-15T22:50:37.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda4400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c0d10a0 con 0x7efd9c070b60 2024-09-15T22:50:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd9c09b2b0 0x7efd9c0d0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efd9c09b2b0 0x7efd9c0d0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38976/0 (socket says 172.21.15.31:38976) 2024-09-15T22:50:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 -- 172.21.15.31:0/1276344959 learned_addr learned my addr 172.21.15.31:0/1276344959 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1a00640 1 --1- 172.21.15.31:0/1276344959 >> v1:172.21.15.102:6789/0 conn(0x7efd9c09aed0 0x7efd9c070330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52492/0 (socket says 172.21.15.31:52492) 2024-09-15T22:50:37.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda2400640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 -- 172.21.15.31:0/1276344959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 msgr2=0x7efd9c071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c071010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 -- 172.21.15.31:0/1276344959 >> v1:172.21.15.102:6789/0 conn(0x7efd9c09aed0 legacy=0x7efd9c070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.525+0000 7efda1000640 1 -- 172.21.15.31:0/1276344959 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0d1380 con 0x7efd9c09b2b0 2024-09-15T22:50:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda1000640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09b2b0 0x7efd9c0d0490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd8801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=604edabf30bca33e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efd9be00640 1 -- 172.21.15.31:0/1276344959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880b0070 con 0x7efd9c09b2b0 2024-09-15T22:50:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efd9be00640 1 -- 172.21.15.31:0/1276344959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd880ab600 con 0x7efd9c09b2b0 2024-09-15T22:50:37.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efd9be00640 1 -- 172.21.15.31:0/1276344959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880ab9d0 con 0x7efd9c09b2b0 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 -- 172.21.15.31:0/1276344959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09b2b0 msgr2=0x7efd9c0d0490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09b2b0 0x7efd9c0d0490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7efd88009870 tx=0x7efd8801c4d0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 -- 172.21.15.31:0/1276344959 shutdown_connections 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 --2- 172.21.15.31:0/1276344959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09b2b0 0x7efd9c0d0490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 -- 172.21.15.31:0/1276344959 >> 172.21.15.31:0/1276344959 conn(0x7efd9c0b3df0 msgr2=0x7efd9c0b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 -- 172.21.15.31:0/1276344959 shutdown_connections 2024-09-15T22:50:37.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.529+0000 7efda4400640 1 -- 172.21.15.31:0/1276344959 wait complete. 2024-09-15T22:50:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 Processor -- start 2024-09-15T22:50:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- start start 2024-09-15T22:50:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c0b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 0x7efd9c1550a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c15eb50 con 0x7efd9c09aed0 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efd9c15e9d0 con 0x7efd9c09b2b0 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efd9c06ced0 con 0x7efd9c070b60 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38984/0 (socket says 172.21.15.31:38984) 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 -- 172.21.15.31:0/2654200143 learned_addr learned my addr 172.21.15.31:0/2654200143 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1a00640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c0b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda2400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 0x7efd9c1550a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 -- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 msgr2=0x7efd9c0b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c0b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 -- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 msgr2=0x7efd9c1550a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 0x7efd9c1550a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 -- 172.21.15.31:0/2654200143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd9c0c8a50 con 0x7efd9c09aed0 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda2400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 0x7efd9c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda1000640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efd8801ab80 tx=0x7efd88019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880b0040 con 0x7efd9c09aed0 2024-09-15T22:50:37.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd880bc070 con 0x7efd9c09aed0 2024-09-15T22:50:37.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd880aa970 con 0x7efd9c09aed0 2024-09-15T22:50:37.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd9c0b7290 con 0x7efd9c09aed0 2024-09-15T22:50:37.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd9c0ce960 con 0x7efd9c09aed0 2024-09-15T22:50:37.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.533+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c0d0490 con 0x7efd9c09aed0 2024-09-15T22:50:37.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.537+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efd880aab10 con 0x7efd9c09aed0 2024-09-15T22:50:37.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.537+0000 7efd99600640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:37.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.537+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efd88120660 con 0x7efd9c09aed0 2024-09-15T22:50:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.537+0000 7efda1a00640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:37.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.537+0000 7efda1a00640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 0x7efd7c069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd90000f70 tx=0x7efd90007e50 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:37.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.541+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efd88016150 con 0x7efd9c09aed0 2024-09-15T22:50:37.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:37.745+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7efd9c0b4a50 con 0x7efd9c09aed0 2024-09-15T22:50:38.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efd99600640 1 -- 172.21.15.31:0/2654200143 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7efd880f0dc0 con 0x7efd9c09aed0 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 msgr2=0x7efd7c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 0x7efd7c069db0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7efd90000f70 tx=0x7efd90007e50 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 msgr2=0x7efd9c154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efd8801ab80 tx=0x7efd88019270 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 shutdown_connections 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efd7c0678f0 0x7efd7c069db0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efd9c09b2b0 0x7efd9c1550a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efd9c09aed0 0x7efd9c154b60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 --2- 172.21.15.31:0/2654200143 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efd9c070b60 0x7efd9c0b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 >> 172.21.15.31:0/2654200143 conn(0x7efd9c0b3df0 msgr2=0x7efd9c071750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 shutdown_connections 2024-09-15T22:50:38.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.353+0000 7efda4400640 1 -- 172.21.15.31:0/2654200143 wait complete. 2024-09-15T22:50:38.382 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:50:38.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.521+0000 7fc2f6a00640 1 Processor -- start 2024-09-15T22:50:38.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.521+0000 7fc2f6a00640 1 -- start start 2024-09-15T22:50:38.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f6a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc2f00b47a0 0x7fc2f0072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f6a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2f0072ad0 con 0x7fc2f006f270 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f6a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc2f015ba60 con 0x7fc2f00b47a0 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f6a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f00affa0 con 0x7fc2f00726a0 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2ef400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc2f00b47a0 0x7fc2f0072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53610/0 (socket says 172.21.15.31:53610) 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 -- 172.21.15.31:0/1049933003 learned_addr learned my addr 172.21.15.31:0/1049933003 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:38.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 -- 172.21.15.31:0/1049933003 >> v2:172.21.15.102:3300/0 conn(0x7fc2f00b47a0 msgr2=0x7fc2f0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 --2- 172.21.15.31:0/1049933003 >> v2:172.21.15.102:3300/0 conn(0x7fc2f00b47a0 0x7fc2f0072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 -- 172.21.15.31:0/1049933003 >> v1:172.21.15.102:6789/0 conn(0x7fc2f006f270 legacy=0x7fc2f006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.525+0000 7fc2f4a00640 1 -- 172.21.15.31:0/1049933003 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f0072d40 con 0x7fc2f00726a0 2024-09-15T22:50:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f4a00640 1 --2- 172.21.15.31:0/1049933003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009e50 tx=0x7fc2e801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=592aa6029948a648 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2eea00640 1 -- 172.21.15.31:0/1049933003 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80a57f0 con 0x7fc2f00726a0 2024-09-15T22:50:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2eea00640 1 -- 172.21.15.31:0/1049933003 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2e80a5990 con 0x7fc2f00726a0 2024-09-15T22:50:38.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2eea00640 1 -- 172.21.15.31:0/1049933003 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80a5d60 con 0x7fc2f00726a0 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1049933003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 msgr2=0x7fc2f015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1049933003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009e50 tx=0x7fc2e801ca30 comp rx=0 tx=0).stop 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1049933003 shutdown_connections 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1049933003 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00726a0 0x7fc2f015c840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1049933003 >> v2:172.21.15.102:3300/0 conn(0x7fc2f00b47a0 0x7fc2f0072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1049933003 >> 172.21.15.31:0/1049933003 conn(0x7fc2f0067e00 msgr2=0x7fc2f006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1049933003 shutdown_connections 2024-09-15T22:50:38.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1049933003 wait complete. 2024-09-15T22:50:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 Processor -- start 2024-09-15T22:50:38.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.529+0000 7fc2f6a00640 1 -- start start 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2f006f270 0x7fc2f0149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00b47a0 0x7fc2f0152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0155b90 con 0x7fc2f00726a0 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0155a10 con 0x7fc2f006f270 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc2f00b4bb0 con 0x7fc2f00b47a0 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38994/0 (socket says 172.21.15.31:38994) 2024-09-15T22:50:38.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 -- 172.21.15.31:0/1033759662 learned_addr learned my addr 172.21.15.31:0/1033759662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f4a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00b47a0 0x7fc2f0152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2efe00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2f006f270 0x7fc2f0149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 -- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00b47a0 msgr2=0x7fc2f0152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00b47a0 0x7fc2f0152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 -- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2f006f270 msgr2=0x7fc2f0149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2f006f270 0x7fc2f0149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 -- 172.21.15.31:0/1033759662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f00ada50 con 0x7fc2f00726a0 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2ef400640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e930 tx=0x7fc2dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc017070 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00ca00 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00cdb0 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f00b02e0 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f00ae2b0 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2f015d190 con 0x7fc2f00726a0 2024-09-15T22:50:38.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.533+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc2dc01a070 con 0x7fc2f00726a0 2024-09-15T22:50:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.537+0000 7fc2e7e00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 0x7fc2d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.537+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc2dc0860f0 con 0x7fc2f00726a0 2024-09-15T22:50:38.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.537+0000 7fc2efe00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 0x7fc2d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.537+0000 7fc2efe00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 0x7fc2d0069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f70 tx=0x7fc2e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.541+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc2dc056920 con 0x7fc2f00726a0 2024-09-15T22:50:38.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.741+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2f00afa80 con 0x7fc2f00726a0 2024-09-15T22:50:38.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2e7e00640 1 -- 172.21.15.31:0/1033759662 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7fc2dc056220 con 0x7fc2f00726a0 2024-09-15T22:50:38.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:38.749 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:38.749 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 msgr2=0x7fc2d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 0x7fc2d0069d80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0000f70 tx=0x7fc2e0009040 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 msgr2=0x7fc2f00aeab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00e930 tx=0x7fc2dc00edf0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 shutdown_connections 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc2d00678c0 0x7fc2d0069d80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc2f00b47a0 0x7fc2f0152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc2f00726a0 0x7fc2f00aeab0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 --2- 172.21.15.31:0/1033759662 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc2f006f270 0x7fc2f0149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 >> 172.21.15.31:0/1033759662 conn(0x7fc2f0067e00 msgr2=0x7fc2f015e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:38.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 shutdown_connections 2024-09-15T22:50:38.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.745+0000 7fc2f6a00640 1 -- 172.21.15.31:0/1033759662 wait complete. 2024-09-15T22:50:38.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 Processor -- start 2024-09-15T22:50:38.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 -- start start 2024-09-15T22:50:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 0x7fd05015f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05015ffb0 0x7fd05009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0500b1c70 con 0x7fd0500b1890 2024-09-15T22:50:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd05009af80 con 0x7fd05015ffb0 2024-09-15T22:50:38.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd055200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd05009b1e0 con 0x7fd05006d990 2024-09-15T22:50:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05015ffb0 0x7fd05009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd05015ffb0 0x7fd05009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39008/0 (socket says 172.21.15.31:39008) 2024-09-15T22:50:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 -- 172.21.15.31:0/776365024 learned_addr learned my addr 172.21.15.31:0/776365024 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 -- 172.21.15.31:0/776365024 >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 msgr2=0x7fd05015f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:38.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd045400640 1 --2- 172.21.15.31:0/776365024 >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 0x7fd05015f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 --2- 172.21.15.31:0/776365024 >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 0x7fd05015f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 -- 172.21.15.31:0/776365024 >> v1:172.21.15.102:6789/0 conn(0x7fd0500b1890 legacy=0x7fd05006d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd04e800640 1 -- 172.21.15.31:0/776365024 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd05009b4c0 con 0x7fd05015ffb0 2024-09-15T22:50:38.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.905+0000 7fd045400640 1 --2- 172.21.15.31:0/776365024 >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 0x7fd05015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:38.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd04e800640 1 --2- 172.21.15.31:0/776365024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd05009aa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd0500cee00 tx=0x7fd04801c7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=505f972425fa7572 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd04d400640 1 -- 172.21.15.31:0/776365024 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480a5580 con 0x7fd05015ffb0 2024-09-15T22:50:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd04d400640 1 -- 172.21.15.31:0/776365024 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0480a5720 con 0x7fd05015ffb0 2024-09-15T22:50:38.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd04d400640 1 -- 172.21.15.31:0/776365024 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480a5af0 con 0x7fd05015ffb0 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 -- 172.21.15.31:0/776365024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 msgr2=0x7fd05009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 --2- 172.21.15.31:0/776365024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd05009aa40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd0500cee00 tx=0x7fd04801c7d0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 -- 172.21.15.31:0/776365024 shutdown_connections 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 --2- 172.21.15.31:0/776365024 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd05009aa40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 --2- 172.21.15.31:0/776365024 >> v2:172.21.15.102:3300/0 conn(0x7fd05006d990 0x7fd05015f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 -- 172.21.15.31:0/776365024 >> 172.21.15.31:0/776365024 conn(0x7fd0500d23b0 msgr2=0x7fd0500d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 -- 172.21.15.31:0/776365024 shutdown_connections 2024-09-15T22:50:38.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.909+0000 7fd055200640 1 -- 172.21.15.31:0/776365024 wait complete. 2024-09-15T22:50:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 Processor -- start 2024-09-15T22:50:38.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- start start 2024-09-15T22:50:38.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 0x7fd0500c7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0500b1890 0x7fd05015a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015e9b0 con 0x7fd05015ffb0 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd05015e830 con 0x7fd0500b1890 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd05015eb30 con 0x7fd05006d990 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39022/0 (socket says 172.21.15.31:39022) 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 -- 172.21.15.31:0/3316619881 learned_addr learned my addr 172.21.15.31:0/3316619881 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04de00640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 0x7fd0500c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd045400640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0500b1890 0x7fd05015a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 -- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 msgr2=0x7fd0500c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 0x7fd0500c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 -- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0500b1890 msgr2=0x7fd05015a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0500b1890 0x7fd05015a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 -- 172.21.15.31:0/3316619881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0500c7830 con 0x7fd05015ffb0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04de00640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 0x7fd0500c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd04e800640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd04801a400 tx=0x7fd048019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048009510 con 0x7fd05015ffb0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0480be070 con 0x7fd05015ffb0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0480b88b0 con 0x7fd05015ffb0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0500c7b10 con 0x7fd05015ffb0 2024-09-15T22:50:38.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.913+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0500c80d0 con 0x7fd05015ffb0 2024-09-15T22:50:38.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd05009aa40 con 0x7fd05015ffb0 2024-09-15T22:50:38.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd0480b8a50 con 0x7fd05015ffb0 2024-09-15T22:50:38.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd046a00640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 0x7fd02c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:38.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd048121bd0 con 0x7fd05015ffb0 2024-09-15T22:50:38.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd04de00640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 0x7fd02c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:38.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.917+0000 7fd04de00640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 0x7fd02c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0400098b0 tx=0x7fd040008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:38.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:38.921+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd0500b1c70 con 0x7fd05015ffb0 2024-09-15T22:50:39.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.085+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd0500d2120 con 0x7fd05015ffb0 2024-09-15T22:50:39.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd046a00640 1 -- 172.21.15.31:0/3316619881 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fd0480f24d0 con 0x7fd05015ffb0 2024-09-15T22:50:39.093 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:39.093 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 msgr2=0x7fd02c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 0x7fd02c069d80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0400098b0 tx=0x7fd040008040 comp rx=0 tx=0).stop 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 msgr2=0x7fd0500c6840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd04801a400 tx=0x7fd048019570 comp rx=0 tx=0).stop 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 shutdown_connections 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd02c0678c0 0x7fd02c069d80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd05015ffb0 0x7fd0500c6840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd0500b1890 0x7fd05015a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 --2- 172.21.15.31:0/3316619881 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd05006d990 0x7fd0500c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 >> 172.21.15.31:0/3316619881 conn(0x7fd0500d23b0 msgr2=0x7fd0500d1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:39.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 shutdown_connections 2024-09-15T22:50:39.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.089+0000 7fd055200640 1 -- 172.21.15.31:0/3316619881 wait complete. 2024-09-15T22:50:39.115 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:50:39.115 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:50:39.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.249+0000 7fa79f000640 1 Processor -- start 2024-09-15T22:50:39.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.249+0000 7fa79f000640 1 -- start start 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79f000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa798072160 0x7fa798072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79f000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa79806e160 0x7fa79806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79f000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa798072a80 con 0x7fa79813fa40 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79f000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa79813f640 con 0x7fa79806e160 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79f000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa7981413c0 con 0x7fa798072160 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa79806e160 0x7fa79806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa79806e160 0x7fa79806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39028/0 (socket says 172.21.15.31:39028) 2024-09-15T22:50:39.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 -- 172.21.15.31:0/2510494215 learned_addr learned my addr 172.21.15.31:0/2510494215 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa797e00640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa798072160 0x7fa798072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 -- 172.21.15.31:0/2510494215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa798072160 msgr2=0x7fa798072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa798072160 0x7fa798072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 -- 172.21.15.31:0/2510494215 >> v1:172.21.15.31:6789/0 conn(0x7fa79813fa40 legacy=0x7fa79813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.253+0000 7fa79d000640 1 -- 172.21.15.31:0/2510494215 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7981407b0 con 0x7fa79806e160 2024-09-15T22:50:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79d000640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa79806e610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa790009e50 tx=0x7fa79001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4266024364d3e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa797400640 1 -- 172.21.15.31:0/2510494215 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900a5660 con 0x7fa79806e160 2024-09-15T22:50:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa797400640 1 -- 172.21.15.31:0/2510494215 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7900a5800 con 0x7fa79806e160 2024-09-15T22:50:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa797400640 1 -- 172.21.15.31:0/2510494215 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7900a5bd0 con 0x7fa79806e160 2024-09-15T22:50:39.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- 172.21.15.31:0/2510494215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 msgr2=0x7fa79806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa79806e610 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa790009e50 tx=0x7fa79001c9a0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- 172.21.15.31:0/2510494215 shutdown_connections 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa79806e610 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 --2- 172.21.15.31:0/2510494215 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa798072160 0x7fa798072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- 172.21.15.31:0/2510494215 >> 172.21.15.31:0/2510494215 conn(0x7fa798067e00 msgr2=0x7fa79806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- 172.21.15.31:0/2510494215 shutdown_connections 2024-09-15T22:50:39.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- 172.21.15.31:0/2510494215 wait complete. 2024-09-15T22:50:39.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 Processor -- start 2024-09-15T22:50:39.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 -- start start 2024-09-15T22:50:39.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.257+0000 7fa79f000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa798072160 0x7fa7981579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa79813fa40 0x7fa798155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa798168ee0 con 0x7fa79806e160 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa798168d60 con 0x7fa798072160 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa798169060 con 0x7fa79813fa40 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39044/0 (socket says 172.21.15.31:39044) 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 -- 172.21.15.31:0/4041958236 learned_addr learned my addr 172.21.15.31:0/4041958236 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa78f400640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa798072160 0x7fa7981579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79d000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa79813fa40 0x7fa798155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 -- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa79813fa40 msgr2=0x7fa798155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa79813fa40 0x7fa798155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 -- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa798072160 msgr2=0x7fa7981579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa798072160 0x7fa7981579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 -- 172.21.15.31:0/4041958236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79815b5b0 con 0x7fa79806e160 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa797e00640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e930 tx=0x7fa78800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788017070 con 0x7fa79806e160 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa78800ca00 con 0x7fa79806e160 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79815b890 con 0x7fa79806e160 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa78800cdb0 con 0x7fa79806e160 2024-09-15T22:50:39.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79815be50 con 0x7fa79806e160 2024-09-15T22:50:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79806e610 con 0x7fa79806e160 2024-09-15T22:50:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa78801a070 con 0x7fa79806e160 2024-09-15T22:50:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.261+0000 7fa794c00640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.265+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa788086060 con 0x7fa79806e160 2024-09-15T22:50:39.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.265+0000 7fa78f400640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.265+0000 7fa78f400640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa798137a30 tx=0x7fa780009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.265+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa788056920 con 0x7fa79806e160 2024-09-15T22:50:39.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.433+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa79806bf60 con 0x7fa7740678c0 2024-09-15T22:50:39.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.441+0000 7fa794c00640 1 -- 172.21.15.31:0/4041958236 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7fa79806bf60 con 0x7fa7740678c0 2024-09-15T22:50:39.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:39.452 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:50:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 msgr2=0x7fa774069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa798137a30 tx=0x7fa780009040 comp rx=0 tx=0).stop 2024-09-15T22:50:39.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 msgr2=0x7fa798159730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa78800e930 tx=0x7fa78800edf0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 shutdown_connections 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa79813fa40 0x7fa798155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa798072160 0x7fa7981579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 --2- 172.21.15.31:0/4041958236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79806e160 0x7fa798159730 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 >> 172.21.15.31:0/4041958236 conn(0x7fa798067e00 msgr2=0x7fa79815e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 shutdown_connections 2024-09-15T22:50:39.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.445+0000 7fa79f000640 1 -- 172.21.15.31:0/4041958236 wait complete. 2024-09-15T22:50:39.472 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":34,"stamp":"2024-09-15T22:50:37.558779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3350528,"data_stored":2018492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003237"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486560+0000","last_change":"2024-09-15T22:50:16.071034+0000","last_active":"2024-09-15T22:50:22.486560+0000","last_peered":"2024-09-15T22:50:22.486560+0000","last_clean":"2024-09-15T22:50:22.486560+0000","last_became_active":"2024-09-15T22:50:16.070808+0000","last_became_peered":"2024-09-15T22:50:16.070808+0000","last_unstale":"2024-09-15T22:50:22.486560+0000","last_undegraded":"2024-09-15T22:50:22.486560+0000","last_fullsized":"2024-09-15T22:50:22.486560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:07.036126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485037+0000","last_change":"2024-09-15T22:50:17.064575+0000","last_active":"2024-09-15T22:50:22.485037+0000","last_peered":"2024-09-15T22:50:22.485037+0000","last_clean":"2024-09-15T22:50:22.485037+0000","last_became_active":"2024-09-15T22:50:17.064271+0000","last_became_peered":"2024-09-15T22:50:17.064271+0000","last_unstale":"2024-09-15T22:50:22.485037+0000","last_undegraded":"2024-09-15T22:50:22.485037+0000","last_fullsized":"2024-09-15T22:50:22.485037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484032+0000","last_change":"2024-09-15T22:50:21.391770+0000","last_active":"2024-09-15T22:50:22.484032+0000","last_peered":"2024-09-15T22:50:22.484032+0000","last_clean":"2024-09-15T22:50:22.484032+0000","last_became_active":"2024-09-15T22:50:21.387296+0000","last_became_peered":"2024-09-15T22:50:21.387296+0000","last_unstale":"2024-09-15T22:50:22.484032+0000","last_undegraded":"2024-09-15T22:50:22.484032+0000","last_fullsized":"2024-09-15T22:50:22.484032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.401656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485239+0000","last_change":"2024-09-15T22:50:16.059723+0000","last_active":"2024-09-15T22:50:22.485239+0000","last_peered":"2024-09-15T22:50:22.485239+0000","last_clean":"2024-09-15T22:50:22.485239+0000","last_became_active":"2024-09-15T22:50:16.059365+0000","last_became_peered":"2024-09-15T22:50:16.059365+0000","last_unstale":"2024-09-15T22:50:22.485239+0000","last_undegraded":"2024-09-15T22:50:22.485239+0000","last_fullsized":"2024-09-15T22:50:22.485239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486397+0000","last_change":"2024-09-15T22:50:17.049966+0000","last_active":"2024-09-15T22:50:22.486397+0000","last_peered":"2024-09-15T22:50:22.486397+0000","last_clean":"2024-09-15T22:50:22.486397+0000","last_became_active":"2024-09-15T22:50:17.049585+0000","last_became_peered":"2024-09-15T22:50:17.049585+0000","last_unstale":"2024-09-15T22:50:22.486397+0000","last_undegraded":"2024-09-15T22:50:22.486397+0000","last_fullsized":"2024-09-15T22:50:22.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304395+0000","last_change":"2024-09-15T22:50:21.332999+0000","last_active":"2024-09-15T22:50:22.304395+0000","last_peered":"2024-09-15T22:50:22.304395+0000","last_clean":"2024-09-15T22:50:22.304395+0000","last_became_active":"2024-09-15T22:50:21.332489+0000","last_became_peered":"2024-09-15T22:50:21.332489+0000","last_unstale":"2024-09-15T22:50:22.304395+0000","last_undegraded":"2024-09-15T22:50:22.304395+0000","last_fullsized":"2024-09-15T22:50:22.304395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:14.476887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486836+0000","last_change":"2024-09-15T22:50:16.074061+0000","last_active":"2024-09-15T22:50:22.486836+0000","last_peered":"2024-09-15T22:50:22.486836+0000","last_clean":"2024-09-15T22:50:22.486836+0000","last_became_active":"2024-09-15T22:50:16.073371+0000","last_became_peered":"2024-09-15T22:50:16.073371+0000","last_unstale":"2024-09-15T22:50:22.486836+0000","last_undegraded":"2024-09-15T22:50:22.486836+0000","last_fullsized":"2024-09-15T22:50:22.486836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304993+0000","last_change":"2024-09-15T22:50:17.049531+0000","last_active":"2024-09-15T22:50:22.304993+0000","last_peered":"2024-09-15T22:50:22.304993+0000","last_clean":"2024-09-15T22:50:22.304993+0000","last_became_active":"2024-09-15T22:50:17.048655+0000","last_became_peered":"2024-09-15T22:50:17.048655+0000","last_unstale":"2024-09-15T22:50:22.304993+0000","last_undegraded":"2024-09-15T22:50:22.304993+0000","last_fullsized":"2024-09-15T22:50:22.304993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:35.848734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305466+0000","last_change":"2024-09-15T22:50:21.331612+0000","last_active":"2024-09-15T22:50:22.305466+0000","last_peered":"2024-09-15T22:50:22.305466+0000","last_clean":"2024-09-15T22:50:22.305466+0000","last_became_active":"2024-09-15T22:50:21.331183+0000","last_became_peered":"2024-09-15T22:50:21.331183+0000","last_unstale":"2024-09-15T22:50:22.305466+0000","last_undegraded":"2024-09-15T22:50:22.305466+0000","last_fullsized":"2024-09-15T22:50:22.305466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487042+0000","last_change":"2024-09-15T22:50:16.074167+0000","last_active":"2024-09-15T22:50:22.487042+0000","last_peered":"2024-09-15T22:50:22.487042+0000","last_clean":"2024-09-15T22:50:22.487042+0000","last_became_active":"2024-09-15T22:50:16.073667+0000","last_became_peered":"2024-09-15T22:50:16.073667+0000","last_unstale":"2024-09-15T22:50:22.487042+0000","last_undegraded":"2024-09-15T22:50:22.487042+0000","last_fullsized":"2024-09-15T22:50:22.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305928+0000","last_change":"2024-09-15T22:50:17.049937+0000","last_active":"2024-09-15T22:50:22.305928+0000","last_peered":"2024-09-15T22:50:22.305928+0000","last_clean":"2024-09-15T22:50:22.305928+0000","last_became_active":"2024-09-15T22:50:17.049500+0000","last_became_peered":"2024-09-15T22:50:17.049500+0000","last_unstale":"2024-09-15T22:50:22.305928+0000","last_undegraded":"2024-09-15T22:50:22.305928+0000","last_fullsized":"2024-09-15T22:50:22.305928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:59.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305411+0000","last_change":"2024-09-15T22:50:21.322140+0000","last_active":"2024-09-15T22:50:22.305411+0000","last_peered":"2024-09-15T22:50:22.305411+0000","last_clean":"2024-09-15T22:50:22.305411+0000","last_became_active":"2024-09-15T22:50:21.321613+0000","last_became_peered":"2024-09-15T22:50:21.321613+0000","last_unstale":"2024-09-15T22:50:22.305411+0000","last_undegraded":"2024-09-15T22:50:22.305411+0000","last_fullsized":"2024-09-15T22:50:22.305411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:25.347025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486025+0000","last_change":"2024-09-15T22:50:17.066161+0000","last_active":"2024-09-15T22:50:22.486025+0000","last_peered":"2024-09-15T22:50:22.486025+0000","last_clean":"2024-09-15T22:50:22.486025+0000","last_became_active":"2024-09-15T22:50:17.064352+0000","last_became_peered":"2024-09-15T22:50:17.064352+0000","last_unstale":"2024-09-15T22:50:22.486025+0000","last_undegraded":"2024-09-15T22:50:22.486025+0000","last_fullsized":"2024-09-15T22:50:22.486025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486824+0000","last_change":"2024-09-15T22:50:16.073863+0000","last_active":"2024-09-15T22:50:22.486824+0000","last_peered":"2024-09-15T22:50:22.486824+0000","last_clean":"2024-09-15T22:50:22.486824+0000","last_became_active":"2024-09-15T22:50:16.073568+0000","last_became_peered":"2024-09-15T22:50:16.073568+0000","last_unstale":"2024-09-15T22:50:22.486824+0000","last_undegraded":"2024-09-15T22:50:22.486824+0000","last_fullsized":"2024-09-15T22:50:22.486824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:50.833315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305147+0000","last_change":"2024-09-15T22:50:21.329220+0000","last_active":"2024-09-15T22:50:22.305147+0000","last_peered":"2024-09-15T22:50:22.305147+0000","last_clean":"2024-09-15T22:50:22.305147+0000","last_became_active":"2024-09-15T22:50:21.328859+0000","last_became_peered":"2024-09-15T22:50:21.328859+0000","last_unstale":"2024-09-15T22:50:22.305147+0000","last_undegraded":"2024-09-15T22:50:22.305147+0000","last_fullsized":"2024-09-15T22:50:22.305147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:53.380745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484221+0000","last_change":"2024-09-15T22:50:17.081686+0000","last_active":"2024-09-15T22:50:22.484221+0000","last_peered":"2024-09-15T22:50:22.484221+0000","last_clean":"2024-09-15T22:50:22.484221+0000","last_became_active":"2024-09-15T22:50:17.081267+0000","last_became_peered":"2024-09-15T22:50:17.081267+0000","last_unstale":"2024-09-15T22:50:22.484221+0000","last_undegraded":"2024-09-15T22:50:22.484221+0000","last_fullsized":"2024-09-15T22:50:22.484221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485397+0000","last_change":"2024-09-15T22:50:16.065960+0000","last_active":"2024-09-15T22:50:22.485397+0000","last_peered":"2024-09-15T22:50:22.485397+0000","last_clean":"2024-09-15T22:50:22.485397+0000","last_became_active":"2024-09-15T22:50:16.065603+0000","last_became_peered":"2024-09-15T22:50:16.065603+0000","last_unstale":"2024-09-15T22:50:22.485397+0000","last_undegraded":"2024-09-15T22:50:22.485397+0000","last_fullsized":"2024-09-15T22:50:22.485397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305841+0000","last_change":"2024-09-15T22:50:21.331723+0000","last_active":"2024-09-15T22:50:22.305841+0000","last_peered":"2024-09-15T22:50:22.305841+0000","last_clean":"2024-09-15T22:50:22.305841+0000","last_became_active":"2024-09-15T22:50:21.331153+0000","last_became_peered":"2024-09-15T22:50:21.331153+0000","last_unstale":"2024-09-15T22:50:22.305841+0000","last_undegraded":"2024-09-15T22:50:22.305841+0000","last_fullsized":"2024-09-15T22:50:22.305841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484852+0000","last_change":"2024-09-15T22:50:17.063766+0000","last_active":"2024-09-15T22:50:22.484852+0000","last_peered":"2024-09-15T22:50:22.484852+0000","last_clean":"2024-09-15T22:50:22.484852+0000","last_became_active":"2024-09-15T22:50:17.063505+0000","last_became_peered":"2024-09-15T22:50:17.063505+0000","last_unstale":"2024-09-15T22:50:22.484852+0000","last_undegraded":"2024-09-15T22:50:22.484852+0000","last_fullsized":"2024-09-15T22:50:22.484852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486133+0000","last_change":"2024-09-15T22:50:16.058862+0000","last_active":"2024-09-15T22:50:22.486133+0000","last_peered":"2024-09-15T22:50:22.486133+0000","last_clean":"2024-09-15T22:50:22.486133+0000","last_became_active":"2024-09-15T22:50:16.058559+0000","last_became_peered":"2024-09-15T22:50:16.058559+0000","last_unstale":"2024-09-15T22:50:22.486133+0000","last_undegraded":"2024-09-15T22:50:22.486133+0000","last_fullsized":"2024-09-15T22:50:22.486133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488018+0000","last_change":"2024-09-15T22:50:21.388463+0000","last_active":"2024-09-15T22:50:22.488018+0000","last_peered":"2024-09-15T22:50:22.488018+0000","last_clean":"2024-09-15T22:50:22.488018+0000","last_became_active":"2024-09-15T22:50:21.387965+0000","last_became_peered":"2024-09-15T22:50:21.387965+0000","last_unstale":"2024-09-15T22:50:22.488018+0000","last_undegraded":"2024-09-15T22:50:22.488018+0000","last_fullsized":"2024-09-15T22:50:22.488018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304813+0000","last_change":"2024-09-15T22:50:17.056742+0000","last_active":"2024-09-15T22:50:22.304813+0000","last_peered":"2024-09-15T22:50:22.304813+0000","last_clean":"2024-09-15T22:50:22.304813+0000","last_became_active":"2024-09-15T22:50:17.056447+0000","last_became_peered":"2024-09-15T22:50:17.056447+0000","last_unstale":"2024-09-15T22:50:22.304813+0000","last_undegraded":"2024-09-15T22:50:22.304813+0000","last_fullsized":"2024-09-15T22:50:22.304813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486107+0000","last_change":"2024-09-15T22:50:16.072521+0000","last_active":"2024-09-15T22:50:22.486107+0000","last_peered":"2024-09-15T22:50:22.486107+0000","last_clean":"2024-09-15T22:50:22.486107+0000","last_became_active":"2024-09-15T22:50:16.071920+0000","last_became_peered":"2024-09-15T22:50:16.071920+0000","last_unstale":"2024-09-15T22:50:22.486107+0000","last_undegraded":"2024-09-15T22:50:22.486107+0000","last_fullsized":"2024-09-15T22:50:22.486107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305040+0000","last_change":"2024-09-15T22:50:21.333094+0000","last_active":"2024-09-15T22:50:22.305040+0000","last_peered":"2024-09-15T22:50:22.305040+0000","last_clean":"2024-09-15T22:50:22.305040+0000","last_became_active":"2024-09-15T22:50:21.332195+0000","last_became_peered":"2024-09-15T22:50:21.332195+0000","last_unstale":"2024-09-15T22:50:22.305040+0000","last_undegraded":"2024-09-15T22:50:22.305040+0000","last_fullsized":"2024-09-15T22:50:22.305040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:51.604505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486855+0000","last_change":"2024-09-15T22:50:17.068190+0000","last_active":"2024-09-15T22:50:22.486855+0000","last_peered":"2024-09-15T22:50:22.486855+0000","last_clean":"2024-09-15T22:50:22.486855+0000","last_became_active":"2024-09-15T22:50:17.067975+0000","last_became_peered":"2024-09-15T22:50:17.067975+0000","last_unstale":"2024-09-15T22:50:22.486855+0000","last_undegraded":"2024-09-15T22:50:22.486855+0000","last_fullsized":"2024-09-15T22:50:22.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487083+0000","last_change":"2024-09-15T22:50:16.076299+0000","last_active":"2024-09-15T22:50:22.487083+0000","last_peered":"2024-09-15T22:50:22.487083+0000","last_clean":"2024-09-15T22:50:22.487083+0000","last_became_active":"2024-09-15T22:50:16.075995+0000","last_became_peered":"2024-09-15T22:50:16.075995+0000","last_unstale":"2024-09-15T22:50:22.487083+0000","last_undegraded":"2024-09-15T22:50:22.487083+0000","last_fullsized":"2024-09-15T22:50:22.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304527+0000","last_change":"2024-09-15T22:50:21.387662+0000","last_active":"2024-09-15T22:50:22.304527+0000","last_peered":"2024-09-15T22:50:22.304527+0000","last_clean":"2024-09-15T22:50:22.304527+0000","last_became_active":"2024-09-15T22:50:21.387238+0000","last_became_peered":"2024-09-15T22:50:21.387238+0000","last_unstale":"2024-09-15T22:50:22.304527+0000","last_undegraded":"2024-09-15T22:50:22.304527+0000","last_fullsized":"2024-09-15T22:50:22.304527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:29.299907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484756+0000","last_change":"2024-09-15T22:50:17.065264+0000","last_active":"2024-09-15T22:50:22.484756+0000","last_peered":"2024-09-15T22:50:22.484756+0000","last_clean":"2024-09-15T22:50:22.484756+0000","last_became_active":"2024-09-15T22:50:17.064957+0000","last_became_peered":"2024-09-15T22:50:17.064957+0000","last_unstale":"2024-09-15T22:50:22.484756+0000","last_undegraded":"2024-09-15T22:50:22.484756+0000","last_fullsized":"2024-09-15T22:50:22.484756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488183+0000","last_change":"2024-09-15T22:50:16.065838+0000","last_active":"2024-09-15T22:50:22.488183+0000","last_peered":"2024-09-15T22:50:22.488183+0000","last_clean":"2024-09-15T22:50:22.488183+0000","last_became_active":"2024-09-15T22:50:16.065431+0000","last_became_peered":"2024-09-15T22:50:16.065431+0000","last_unstale":"2024-09-15T22:50:22.488183+0000","last_undegraded":"2024-09-15T22:50:22.488183+0000","last_fullsized":"2024-09-15T22:50:22.488183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484368+0000","last_change":"2024-09-15T22:50:21.386971+0000","last_active":"2024-09-15T22:50:22.484368+0000","last_peered":"2024-09-15T22:50:22.484368+0000","last_clean":"2024-09-15T22:50:22.484368+0000","last_became_active":"2024-09-15T22:50:21.386649+0000","last_became_peered":"2024-09-15T22:50:21.386649+0000","last_unstale":"2024-09-15T22:50:22.484368+0000","last_undegraded":"2024-09-15T22:50:22.484368+0000","last_fullsized":"2024-09-15T22:50:22.484368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.952001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487665+0000","last_change":"2024-09-15T22:50:17.061858+0000","last_active":"2024-09-15T22:50:22.487665+0000","last_peered":"2024-09-15T22:50:22.487665+0000","last_clean":"2024-09-15T22:50:22.487665+0000","last_became_active":"2024-09-15T22:50:17.061576+0000","last_became_peered":"2024-09-15T22:50:17.061576+0000","last_unstale":"2024-09-15T22:50:22.487665+0000","last_undegraded":"2024-09-15T22:50:22.487665+0000","last_fullsized":"2024-09-15T22:50:22.487665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487045+0000","last_change":"2024-09-15T22:50:16.074301+0000","last_active":"2024-09-15T22:50:22.487045+0000","last_peered":"2024-09-15T22:50:22.487045+0000","last_clean":"2024-09-15T22:50:22.487045+0000","last_became_active":"2024-09-15T22:50:16.073757+0000","last_became_peered":"2024-09-15T22:50:16.073757+0000","last_unstale":"2024-09-15T22:50:22.487045+0000","last_undegraded":"2024-09-15T22:50:22.487045+0000","last_fullsized":"2024-09-15T22:50:22.487045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485694+0000","last_change":"2024-09-15T22:50:21.387039+0000","last_active":"2024-09-15T22:50:22.485694+0000","last_peered":"2024-09-15T22:50:22.485694+0000","last_clean":"2024-09-15T22:50:22.485694+0000","last_became_active":"2024-09-15T22:50:21.386588+0000","last_became_peered":"2024-09-15T22:50:21.386588+0000","last_unstale":"2024-09-15T22:50:22.485694+0000","last_undegraded":"2024-09-15T22:50:22.485694+0000","last_fullsized":"2024-09-15T22:50:22.485694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306041+0000","last_change":"2024-09-15T22:50:17.073775+0000","last_active":"2024-09-15T22:50:22.306041+0000","last_peered":"2024-09-15T22:50:22.306041+0000","last_clean":"2024-09-15T22:50:22.306041+0000","last_became_active":"2024-09-15T22:50:17.073501+0000","last_became_peered":"2024-09-15T22:50:17.073501+0000","last_unstale":"2024-09-15T22:50:22.306041+0000","last_undegraded":"2024-09-15T22:50:22.306041+0000","last_fullsized":"2024-09-15T22:50:22.306041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.114390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487762+0000","last_change":"2024-09-15T22:50:16.062735+0000","last_active":"2024-09-15T22:50:22.487762+0000","last_peered":"2024-09-15T22:50:22.487762+0000","last_clean":"2024-09-15T22:50:22.487762+0000","last_became_active":"2024-09-15T22:50:16.062407+0000","last_became_peered":"2024-09-15T22:50:16.062407+0000","last_unstale":"2024-09-15T22:50:22.487762+0000","last_undegraded":"2024-09-15T22:50:22.487762+0000","last_fullsized":"2024-09-15T22:50:22.487762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485248+0000","last_change":"2024-09-15T22:50:21.334715+0000","last_active":"2024-09-15T22:50:22.485248+0000","last_peered":"2024-09-15T22:50:22.485248+0000","last_clean":"2024-09-15T22:50:22.485248+0000","last_became_active":"2024-09-15T22:50:21.334378+0000","last_became_peered":"2024-09-15T22:50:21.334378+0000","last_unstale":"2024-09-15T22:50:22.485248+0000","last_undegraded":"2024-09-15T22:50:22.485248+0000","last_fullsized":"2024-09-15T22:50:22.485248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305984+0000","last_change":"2024-09-15T22:50:17.059567+0000","last_active":"2024-09-15T22:50:22.305984+0000","last_peered":"2024-09-15T22:50:22.305984+0000","last_clean":"2024-09-15T22:50:22.305984+0000","last_became_active":"2024-09-15T22:50:17.059236+0000","last_became_peered":"2024-09-15T22:50:17.059236+0000","last_unstale":"2024-09-15T22:50:22.305984+0000","last_undegraded":"2024-09-15T22:50:22.305984+0000","last_fullsized":"2024-09-15T22:50:22.305984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305510+0000","last_change":"2024-09-15T22:50:16.064966+0000","last_active":"2024-09-15T22:50:22.305510+0000","last_peered":"2024-09-15T22:50:22.305510+0000","last_clean":"2024-09-15T22:50:22.305510+0000","last_became_active":"2024-09-15T22:50:16.063647+0000","last_became_peered":"2024-09-15T22:50:16.063647+0000","last_unstale":"2024-09-15T22:50:22.305510+0000","last_undegraded":"2024-09-15T22:50:22.305510+0000","last_fullsized":"2024-09-15T22:50:22.305510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:05.094689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487711+0000","last_change":"2024-09-15T22:50:21.324683+0000","last_active":"2024-09-15T22:50:22.487711+0000","last_peered":"2024-09-15T22:50:22.487711+0000","last_clean":"2024-09-15T22:50:22.487711+0000","last_became_active":"2024-09-15T22:50:21.324107+0000","last_became_peered":"2024-09-15T22:50:21.324107+0000","last_unstale":"2024-09-15T22:50:22.487711+0000","last_undegraded":"2024-09-15T22:50:22.487711+0000","last_fullsized":"2024-09-15T22:50:22.487711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484084+0000","last_change":"2024-09-15T22:50:17.076106+0000","last_active":"2024-09-15T22:50:22.484084+0000","last_peered":"2024-09-15T22:50:22.484084+0000","last_clean":"2024-09-15T22:50:22.484084+0000","last_became_active":"2024-09-15T22:50:17.075941+0000","last_became_peered":"2024-09-15T22:50:17.075941+0000","last_unstale":"2024-09-15T22:50:22.484084+0000","last_undegraded":"2024-09-15T22:50:22.484084+0000","last_fullsized":"2024-09-15T22:50:22.484084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301938+0000","last_change":"2024-09-15T22:50:16.058921+0000","last_active":"2024-09-15T22:50:22.301938+0000","last_peered":"2024-09-15T22:50:22.301938+0000","last_clean":"2024-09-15T22:50:22.301938+0000","last_became_active":"2024-09-15T22:50:16.056403+0000","last_became_peered":"2024-09-15T22:50:16.056403+0000","last_unstale":"2024-09-15T22:50:22.301938+0000","last_undegraded":"2024-09-15T22:50:22.301938+0000","last_fullsized":"2024-09-15T22:50:22.301938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488128+0000","last_change":"2024-09-15T22:50:21.328492+0000","last_active":"2024-09-15T22:50:22.488128+0000","last_peered":"2024-09-15T22:50:22.488128+0000","last_clean":"2024-09-15T22:50:22.488128+0000","last_became_active":"2024-09-15T22:50:21.327821+0000","last_became_peered":"2024-09-15T22:50:21.327821+0000","last_unstale":"2024-09-15T22:50:22.488128+0000","last_undegraded":"2024-09-15T22:50:22.488128+0000","last_fullsized":"2024-09-15T22:50:22.488128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485106+0000","last_change":"2024-09-15T22:50:17.048995+0000","last_active":"2024-09-15T22:50:22.485106+0000","last_peered":"2024-09-15T22:50:22.485106+0000","last_clean":"2024-09-15T22:50:22.485106+0000","last_became_active":"2024-09-15T22:50:17.048715+0000","last_became_peered":"2024-09-15T22:50:17.048715+0000","last_unstale":"2024-09-15T22:50:22.485106+0000","last_undegraded":"2024-09-15T22:50:22.485106+0000","last_fullsized":"2024-09-15T22:50:22.485106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:53.664696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486222+0000","last_change":"2024-09-15T22:50:16.072709+0000","last_active":"2024-09-15T22:50:22.486222+0000","last_peered":"2024-09-15T22:50:22.486222+0000","last_clean":"2024-09-15T22:50:22.486222+0000","last_became_active":"2024-09-15T22:50:16.072241+0000","last_became_peered":"2024-09-15T22:50:16.072241+0000","last_unstale":"2024-09-15T22:50:22.486222+0000","last_undegraded":"2024-09-15T22:50:22.486222+0000","last_fullsized":"2024-09-15T22:50:22.486222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486771+0000","last_change":"2024-09-15T22:50:21.386663+0000","last_active":"2024-09-15T22:50:22.486771+0000","last_peered":"2024-09-15T22:50:22.486771+0000","last_clean":"2024-09-15T22:50:22.486771+0000","last_became_active":"2024-09-15T22:50:21.386297+0000","last_became_peered":"2024-09-15T22:50:21.386297+0000","last_unstale":"2024-09-15T22:50:22.486771+0000","last_undegraded":"2024-09-15T22:50:22.486771+0000","last_fullsized":"2024-09-15T22:50:22.486771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:39.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485330+0000","last_change":"2024-09-15T22:50:17.059375+0000","last_active":"2024-09-15T22:50:22.485330+0000","last_peered":"2024-09-15T22:50:22.485330+0000","last_clean":"2024-09-15T22:50:22.485330+0000","last_became_active":"2024-09-15T22:50:17.059132+0000","last_became_peered":"2024-09-15T22:50:17.059132+0000","last_unstale":"2024-09-15T22:50:22.485330+0000","last_undegraded":"2024-09-15T22:50:22.485330+0000","last_fullsized":"2024-09-15T22:50:22.485330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:16.056464+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:16.055773+0000","last_became_peered":"2024-09-15T22:50:16.055773+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:58.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486332+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:50:22.486332+0000","last_peered":"2024-09-15T22:50:22.486332+0000","last_clean":"2024-09-15T22:50:22.486332+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:50:22.486332+0000","last_undegraded":"2024-09-15T22:50:22.486332+0000","last_fullsized":"2024-09-15T22:50:22.486332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486472+0000","last_change":"2024-09-15T22:50:21.392217+0000","last_active":"2024-09-15T22:50:22.486472+0000","last_peered":"2024-09-15T22:50:22.486472+0000","last_clean":"2024-09-15T22:50:22.486472+0000","last_became_active":"2024-09-15T22:50:21.387886+0000","last_became_peered":"2024-09-15T22:50:21.387886+0000","last_unstale":"2024-09-15T22:50:22.486472+0000","last_undegraded":"2024-09-15T22:50:22.486472+0000","last_fullsized":"2024-09-15T22:50:22.486472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486289+0000","last_change":"2024-09-15T22:50:17.072970+0000","last_active":"2024-09-15T22:50:22.486289+0000","last_peered":"2024-09-15T22:50:22.486289+0000","last_clean":"2024-09-15T22:50:22.486289+0000","last_became_active":"2024-09-15T22:50:17.072660+0000","last_became_peered":"2024-09-15T22:50:17.072660+0000","last_unstale":"2024-09-15T22:50:22.486289+0000","last_undegraded":"2024-09-15T22:50:22.486289+0000","last_fullsized":"2024-09-15T22:50:22.486289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302167+0000","last_change":"2024-09-15T22:50:16.069049+0000","last_active":"2024-09-15T22:50:22.302167+0000","last_peered":"2024-09-15T22:50:22.302167+0000","last_clean":"2024-09-15T22:50:22.302167+0000","last_became_active":"2024-09-15T22:50:16.068684+0000","last_became_peered":"2024-09-15T22:50:16.068684+0000","last_unstale":"2024-09-15T22:50:22.302167+0000","last_undegraded":"2024-09-15T22:50:22.302167+0000","last_fullsized":"2024-09-15T22:50:22.302167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486339+0000","last_change":"2024-09-15T22:50:21.385944+0000","last_active":"2024-09-15T22:50:22.486339+0000","last_peered":"2024-09-15T22:50:22.486339+0000","last_clean":"2024-09-15T22:50:22.486339+0000","last_became_active":"2024-09-15T22:50:21.385537+0000","last_became_peered":"2024-09-15T22:50:21.385537+0000","last_unstale":"2024-09-15T22:50:22.486339+0000","last_undegraded":"2024-09-15T22:50:22.486339+0000","last_fullsized":"2024-09-15T22:50:22.486339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305085+0000","last_change":"2024-09-15T22:50:17.067273+0000","last_active":"2024-09-15T22:50:22.305085+0000","last_peered":"2024-09-15T22:50:22.305085+0000","last_clean":"2024-09-15T22:50:22.305085+0000","last_became_active":"2024-09-15T22:50:17.066944+0000","last_became_peered":"2024-09-15T22:50:17.066944+0000","last_unstale":"2024-09-15T22:50:22.305085+0000","last_undegraded":"2024-09-15T22:50:22.305085+0000","last_fullsized":"2024-09-15T22:50:22.305085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:59.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487904+0000","last_change":"2024-09-15T22:50:16.059543+0000","last_active":"2024-09-15T22:50:22.487904+0000","last_peered":"2024-09-15T22:50:22.487904+0000","last_clean":"2024-09-15T22:50:22.487904+0000","last_became_active":"2024-09-15T22:50:16.056601+0000","last_became_peered":"2024-09-15T22:50:16.056601+0000","last_unstale":"2024-09-15T22:50:22.487904+0000","last_undegraded":"2024-09-15T22:50:22.487904+0000","last_fullsized":"2024-09-15T22:50:22.487904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485917+0000","last_change":"2024-09-15T22:50:21.330038+0000","last_active":"2024-09-15T22:50:22.485917+0000","last_peered":"2024-09-15T22:50:22.485917+0000","last_clean":"2024-09-15T22:50:22.485917+0000","last_became_active":"2024-09-15T22:50:21.329579+0000","last_became_peered":"2024-09-15T22:50:21.329579+0000","last_unstale":"2024-09-15T22:50:22.485917+0000","last_undegraded":"2024-09-15T22:50:22.485917+0000","last_fullsized":"2024-09-15T22:50:22.485917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487400+0000","last_change":"2024-09-15T22:50:17.066201+0000","last_active":"2024-09-15T22:50:22.487400+0000","last_peered":"2024-09-15T22:50:22.487400+0000","last_clean":"2024-09-15T22:50:22.487400+0000","last_became_active":"2024-09-15T22:50:17.065922+0000","last_became_peered":"2024-09-15T22:50:17.065922+0000","last_unstale":"2024-09-15T22:50:22.487400+0000","last_undegraded":"2024-09-15T22:50:22.487400+0000","last_fullsized":"2024-09-15T22:50:22.487400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:13.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302362+0000","last_change":"2024-09-15T22:50:16.059590+0000","last_active":"2024-09-15T22:50:22.302362+0000","last_peered":"2024-09-15T22:50:22.302362+0000","last_clean":"2024-09-15T22:50:22.302362+0000","last_became_active":"2024-09-15T22:50:16.059168+0000","last_became_peered":"2024-09-15T22:50:16.059168+0000","last_unstale":"2024-09-15T22:50:22.302362+0000","last_undegraded":"2024-09-15T22:50:22.302362+0000","last_fullsized":"2024-09-15T22:50:22.302362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304215+0000","last_change":"2024-09-15T22:50:21.387467+0000","last_active":"2024-09-15T22:50:22.304215+0000","last_peered":"2024-09-15T22:50:22.304215+0000","last_clean":"2024-09-15T22:50:22.304215+0000","last_became_active":"2024-09-15T22:50:21.387053+0000","last_became_peered":"2024-09-15T22:50:21.387053+0000","last_unstale":"2024-09-15T22:50:22.304215+0000","last_undegraded":"2024-09-15T22:50:22.304215+0000","last_fullsized":"2024-09-15T22:50:22.304215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:55.525858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487044+0000","last_change":"2024-09-15T22:50:17.073751+0000","last_active":"2024-09-15T22:50:22.487044+0000","last_peered":"2024-09-15T22:50:22.487044+0000","last_clean":"2024-09-15T22:50:22.487044+0000","last_became_active":"2024-09-15T22:50:17.065140+0000","last_became_peered":"2024-09-15T22:50:17.065140+0000","last_unstale":"2024-09-15T22:50:22.487044+0000","last_undegraded":"2024-09-15T22:50:22.487044+0000","last_fullsized":"2024-09-15T22:50:22.487044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:19.682526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305439+0000","last_change":"2024-09-15T22:50:16.065101+0000","last_active":"2024-09-15T22:50:22.305439+0000","last_peered":"2024-09-15T22:50:22.305439+0000","last_clean":"2024-09-15T22:50:22.305439+0000","last_became_active":"2024-09-15T22:50:16.064796+0000","last_became_peered":"2024-09-15T22:50:16.064796+0000","last_unstale":"2024-09-15T22:50:22.305439+0000","last_undegraded":"2024-09-15T22:50:22.305439+0000","last_fullsized":"2024-09-15T22:50:22.305439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:16.223077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304254+0000","last_change":"2024-09-15T22:50:21.331825+0000","last_active":"2024-09-15T22:50:22.304254+0000","last_peered":"2024-09-15T22:50:22.304254+0000","last_clean":"2024-09-15T22:50:22.304254+0000","last_became_active":"2024-09-15T22:50:21.331115+0000","last_became_peered":"2024-09-15T22:50:21.331115+0000","last_unstale":"2024-09-15T22:50:22.304254+0000","last_undegraded":"2024-09-15T22:50:22.304254+0000","last_fullsized":"2024-09-15T22:50:22.304254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:22.486441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486479+0000","last_change":"2024-09-15T22:50:17.069472+0000","last_active":"2024-09-15T22:50:22.486479+0000","last_peered":"2024-09-15T22:50:22.486479+0000","last_clean":"2024-09-15T22:50:22.486479+0000","last_became_active":"2024-09-15T22:50:17.066357+0000","last_became_peered":"2024-09-15T22:50:17.066357+0000","last_unstale":"2024-09-15T22:50:22.486479+0000","last_undegraded":"2024-09-15T22:50:22.486479+0000","last_fullsized":"2024-09-15T22:50:22.486479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301701+0000","last_change":"2024-09-15T22:50:16.054885+0000","last_active":"2024-09-15T22:50:22.301701+0000","last_peered":"2024-09-15T22:50:22.301701+0000","last_clean":"2024-09-15T22:50:22.301701+0000","last_became_active":"2024-09-15T22:50:16.054595+0000","last_became_peered":"2024-09-15T22:50:16.054595+0000","last_unstale":"2024-09-15T22:50:22.301701+0000","last_undegraded":"2024-09-15T22:50:22.301701+0000","last_fullsized":"2024-09-15T22:50:22.301701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486700+0000","last_change":"2024-09-15T22:50:21.326386+0000","last_active":"2024-09-15T22:50:22.486700+0000","last_peered":"2024-09-15T22:50:22.486700+0000","last_clean":"2024-09-15T22:50:22.486700+0000","last_became_active":"2024-09-15T22:50:21.323287+0000","last_became_peered":"2024-09-15T22:50:21.323287+0000","last_unstale":"2024-09-15T22:50:22.486700+0000","last_undegraded":"2024-09-15T22:50:22.486700+0000","last_fullsized":"2024-09-15T22:50:22.486700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485918+0000","last_change":"2024-09-15T22:50:17.075345+0000","last_active":"2024-09-15T22:50:22.485918+0000","last_peered":"2024-09-15T22:50:22.485918+0000","last_clean":"2024-09-15T22:50:22.485918+0000","last_became_active":"2024-09-15T22:50:17.071860+0000","last_became_peered":"2024-09-15T22:50:17.071860+0000","last_unstale":"2024-09-15T22:50:22.485918+0000","last_undegraded":"2024-09-15T22:50:22.485918+0000","last_fullsized":"2024-09-15T22:50:22.485918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486616+0000","last_change":"2024-09-15T22:50:16.066823+0000","last_active":"2024-09-15T22:50:22.486616+0000","last_peered":"2024-09-15T22:50:22.486616+0000","last_clean":"2024-09-15T22:50:22.486616+0000","last_became_active":"2024-09-15T22:50:16.066066+0000","last_became_peered":"2024-09-15T22:50:16.066066+0000","last_unstale":"2024-09-15T22:50:22.486616+0000","last_undegraded":"2024-09-15T22:50:22.486616+0000","last_fullsized":"2024-09-15T22:50:22.486616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484534+0000","last_change":"2024-09-15T22:50:21.387848+0000","last_active":"2024-09-15T22:50:22.484534+0000","last_peered":"2024-09-15T22:50:22.484534+0000","last_clean":"2024-09-15T22:50:22.484534+0000","last_became_active":"2024-09-15T22:50:21.387224+0000","last_became_peered":"2024-09-15T22:50:21.387224+0000","last_unstale":"2024-09-15T22:50:22.484534+0000","last_undegraded":"2024-09-15T22:50:22.484534+0000","last_fullsized":"2024-09-15T22:50:22.484534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.174091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486681+0000","last_change":"2024-09-15T22:50:17.071304+0000","last_active":"2024-09-15T22:50:22.486681+0000","last_peered":"2024-09-15T22:50:22.486681+0000","last_clean":"2024-09-15T22:50:22.486681+0000","last_became_active":"2024-09-15T22:50:17.070613+0000","last_became_peered":"2024-09-15T22:50:17.070613+0000","last_unstale":"2024-09-15T22:50:22.486681+0000","last_undegraded":"2024-09-15T22:50:22.486681+0000","last_fullsized":"2024-09-15T22:50:22.486681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:02.870943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305454+0000","last_change":"2024-09-15T22:50:16.069513+0000","last_active":"2024-09-15T22:50:22.305454+0000","last_peered":"2024-09-15T22:50:22.305454+0000","last_clean":"2024-09-15T22:50:22.305454+0000","last_became_active":"2024-09-15T22:50:16.069194+0000","last_became_peered":"2024-09-15T22:50:16.069194+0000","last_unstale":"2024-09-15T22:50:22.305454+0000","last_undegraded":"2024-09-15T22:50:22.305454+0000","last_fullsized":"2024-09-15T22:50:22.305454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:32.487332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484440+0000","last_change":"2024-09-15T22:50:21.385231+0000","last_active":"2024-09-15T22:50:22.484440+0000","last_peered":"2024-09-15T22:50:22.484440+0000","last_clean":"2024-09-15T22:50:22.484440+0000","last_became_active":"2024-09-15T22:50:21.384687+0000","last_became_peered":"2024-09-15T22:50:21.384687+0000","last_unstale":"2024-09-15T22:50:22.484440+0000","last_undegraded":"2024-09-15T22:50:22.484440+0000","last_fullsized":"2024-09-15T22:50:22.484440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:58.714208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485419+0000","last_change":"2024-09-15T22:50:17.062760+0000","last_active":"2024-09-15T22:50:22.485419+0000","last_peered":"2024-09-15T22:50:22.485419+0000","last_clean":"2024-09-15T22:50:22.485419+0000","last_became_active":"2024-09-15T22:50:17.062472+0000","last_became_peered":"2024-09-15T22:50:17.062472+0000","last_unstale":"2024-09-15T22:50:22.485419+0000","last_undegraded":"2024-09-15T22:50:22.485419+0000","last_fullsized":"2024-09-15T22:50:22.485419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:55.399729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486167+0000","last_change":"2024-09-15T22:50:16.060509+0000","last_active":"2024-09-15T22:50:22.486167+0000","last_peered":"2024-09-15T22:50:22.486167+0000","last_clean":"2024-09-15T22:50:22.486167+0000","last_became_active":"2024-09-15T22:50:16.060218+0000","last_became_peered":"2024-09-15T22:50:16.060218+0000","last_unstale":"2024-09-15T22:50:22.486167+0000","last_undegraded":"2024-09-15T22:50:22.486167+0000","last_fullsized":"2024-09-15T22:50:22.486167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305780+0000","last_change":"2024-09-15T22:50:21.389097+0000","last_active":"2024-09-15T22:50:22.305780+0000","last_peered":"2024-09-15T22:50:22.305780+0000","last_clean":"2024-09-15T22:50:22.305780+0000","last_became_active":"2024-09-15T22:50:21.388634+0000","last_became_peered":"2024-09-15T22:50:21.388634+0000","last_unstale":"2024-09-15T22:50:22.305780+0000","last_undegraded":"2024-09-15T22:50:22.305780+0000","last_fullsized":"2024-09-15T22:50:22.305780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.326409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486187+0000","last_change":"2024-09-15T22:50:17.077973+0000","last_active":"2024-09-15T22:50:22.486187+0000","last_peered":"2024-09-15T22:50:22.486187+0000","last_clean":"2024-09-15T22:50:22.486187+0000","last_became_active":"2024-09-15T22:50:17.077686+0000","last_became_peered":"2024-09-15T22:50:17.077686+0000","last_unstale":"2024-09-15T22:50:22.486187+0000","last_undegraded":"2024-09-15T22:50:22.486187+0000","last_fullsized":"2024-09-15T22:50:22.486187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:28.191364+0000","last_change":"2024-09-15T22:50:16.062195+0000","last_active":"2024-09-15T22:50:28.191364+0000","last_peered":"2024-09-15T22:50:28.191364+0000","last_clean":"2024-09-15T22:50:28.191364+0000","last_became_active":"2024-09-15T22:50:16.061907+0000","last_became_peered":"2024-09-15T22:50:16.061907+0000","last_unstale":"2024-09-15T22:50:28.191364+0000","last_undegraded":"2024-09-15T22:50:28.191364+0000","last_fullsized":"2024-09-15T22:50:28.191364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485394+0000","last_change":"2024-09-15T22:50:21.332064+0000","last_active":"2024-09-15T22:50:22.485394+0000","last_peered":"2024-09-15T22:50:22.485394+0000","last_clean":"2024-09-15T22:50:22.485394+0000","last_became_active":"2024-09-15T22:50:21.331679+0000","last_became_peered":"2024-09-15T22:50:21.331679+0000","last_unstale":"2024-09-15T22:50:22.485394+0000","last_undegraded":"2024-09-15T22:50:22.485394+0000","last_fullsized":"2024-09-15T22:50:22.485394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306155+0000","last_change":"2024-09-15T22:50:17.066523+0000","last_active":"2024-09-15T22:50:22.306155+0000","last_peered":"2024-09-15T22:50:22.306155+0000","last_clean":"2024-09-15T22:50:22.306155+0000","last_became_active":"2024-09-15T22:50:17.066271+0000","last_became_peered":"2024-09-15T22:50:17.066271+0000","last_unstale":"2024-09-15T22:50:22.306155+0000","last_undegraded":"2024-09-15T22:50:22.306155+0000","last_fullsized":"2024-09-15T22:50:22.306155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487798+0000","last_change":"2024-09-15T22:50:16.072533+0000","last_active":"2024-09-15T22:50:22.487798+0000","last_peered":"2024-09-15T22:50:22.487798+0000","last_clean":"2024-09-15T22:50:22.487798+0000","last_became_active":"2024-09-15T22:50:16.072230+0000","last_became_peered":"2024-09-15T22:50:16.072230+0000","last_unstale":"2024-09-15T22:50:22.487798+0000","last_undegraded":"2024-09-15T22:50:22.487798+0000","last_fullsized":"2024-09-15T22:50:22.487798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305802+0000","last_change":"2024-09-15T22:50:21.333434+0000","last_active":"2024-09-15T22:50:22.305802+0000","last_peered":"2024-09-15T22:50:22.305802+0000","last_clean":"2024-09-15T22:50:22.305802+0000","last_became_active":"2024-09-15T22:50:21.332505+0000","last_became_peered":"2024-09-15T22:50:21.332505+0000","last_unstale":"2024-09-15T22:50:22.305802+0000","last_undegraded":"2024-09-15T22:50:22.305802+0000","last_fullsized":"2024-09-15T22:50:22.305802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486491+0000","last_change":"2024-09-15T22:50:17.052446+0000","last_active":"2024-09-15T22:50:22.486491+0000","last_peered":"2024-09-15T22:50:22.486491+0000","last_clean":"2024-09-15T22:50:22.486491+0000","last_became_active":"2024-09-15T22:50:17.052187+0000","last_became_peered":"2024-09-15T22:50:17.052187+0000","last_unstale":"2024-09-15T22:50:22.486491+0000","last_undegraded":"2024-09-15T22:50:22.486491+0000","last_fullsized":"2024-09-15T22:50:22.486491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306067+0000","last_change":"2024-09-15T22:50:16.067884+0000","last_active":"2024-09-15T22:50:22.306067+0000","last_peered":"2024-09-15T22:50:22.306067+0000","last_clean":"2024-09-15T22:50:22.306067+0000","last_became_active":"2024-09-15T22:50:16.067613+0000","last_became_peered":"2024-09-15T22:50:16.067613+0000","last_unstale":"2024-09-15T22:50:22.306067+0000","last_undegraded":"2024-09-15T22:50:22.306067+0000","last_fullsized":"2024-09-15T22:50:22.306067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:02.473555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484670+0000","last_change":"2024-09-15T22:50:21.329190+0000","last_active":"2024-09-15T22:50:22.484670+0000","last_peered":"2024-09-15T22:50:22.484670+0000","last_clean":"2024-09-15T22:50:22.484670+0000","last_became_active":"2024-09-15T22:50:21.328672+0000","last_became_peered":"2024-09-15T22:50:21.328672+0000","last_unstale":"2024-09-15T22:50:22.484670+0000","last_undegraded":"2024-09-15T22:50:22.484670+0000","last_fullsized":"2024-09-15T22:50:22.484670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:10.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306101+0000","last_change":"2024-09-15T22:50:17.065691+0000","last_active":"2024-09-15T22:50:22.306101+0000","last_peered":"2024-09-15T22:50:22.306101+0000","last_clean":"2024-09-15T22:50:22.306101+0000","last_became_active":"2024-09-15T22:50:17.065428+0000","last_became_peered":"2024-09-15T22:50:17.065428+0000","last_unstale":"2024-09-15T22:50:22.306101+0000","last_undegraded":"2024-09-15T22:50:22.306101+0000","last_fullsized":"2024-09-15T22:50:22.306101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:42.029371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486901+0000","last_change":"2024-09-15T22:50:16.071238+0000","last_active":"2024-09-15T22:50:22.486901+0000","last_peered":"2024-09-15T22:50:22.486901+0000","last_clean":"2024-09-15T22:50:22.486901+0000","last_became_active":"2024-09-15T22:50:16.070890+0000","last_became_peered":"2024-09-15T22:50:16.070890+0000","last_unstale":"2024-09-15T22:50:22.486901+0000","last_undegraded":"2024-09-15T22:50:22.486901+0000","last_fullsized":"2024-09-15T22:50:22.486901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484106+0000","last_change":"2024-09-15T22:50:21.387626+0000","last_active":"2024-09-15T22:50:22.484106+0000","last_peered":"2024-09-15T22:50:22.484106+0000","last_clean":"2024-09-15T22:50:22.484106+0000","last_became_active":"2024-09-15T22:50:21.386716+0000","last_became_peered":"2024-09-15T22:50:21.386716+0000","last_unstale":"2024-09-15T22:50:22.484106+0000","last_undegraded":"2024-09-15T22:50:22.484106+0000","last_fullsized":"2024-09-15T22:50:22.484106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:12.968147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486614+0000","last_change":"2024-09-15T22:50:21.386695+0000","last_active":"2024-09-15T22:50:22.486614+0000","last_peered":"2024-09-15T22:50:22.486614+0000","last_clean":"2024-09-15T22:50:22.486614+0000","last_became_active":"2024-09-15T22:50:21.386288+0000","last_became_peered":"2024-09-15T22:50:21.386288+0000","last_unstale":"2024-09-15T22:50:22.486614+0000","last_undegraded":"2024-09-15T22:50:22.486614+0000","last_fullsized":"2024-09-15T22:50:22.486614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486042+0000","last_change":"2024-09-15T22:50:17.071310+0000","last_active":"2024-09-15T22:50:22.486042+0000","last_peered":"2024-09-15T22:50:22.486042+0000","last_clean":"2024-09-15T22:50:22.486042+0000","last_became_active":"2024-09-15T22:50:17.070951+0000","last_became_peered":"2024-09-15T22:50:17.070951+0000","last_unstale":"2024-09-15T22:50:22.486042+0000","last_undegraded":"2024-09-15T22:50:22.486042+0000","last_fullsized":"2024-09-15T22:50:22.486042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304617+0000","last_change":"2024-09-15T22:50:16.062316+0000","last_active":"2024-09-15T22:50:22.304617+0000","last_peered":"2024-09-15T22:50:22.304617+0000","last_clean":"2024-09-15T22:50:22.304617+0000","last_became_active":"2024-09-15T22:50:16.062018+0000","last_became_peered":"2024-09-15T22:50:16.062018+0000","last_unstale":"2024-09-15T22:50:22.304617+0000","last_undegraded":"2024-09-15T22:50:22.304617+0000","last_fullsized":"2024-09-15T22:50:22.304617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:18.421004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486740+0000","last_change":"2024-09-15T22:50:21.334779+0000","last_active":"2024-09-15T22:50:22.486740+0000","last_peered":"2024-09-15T22:50:22.486740+0000","last_clean":"2024-09-15T22:50:22.486740+0000","last_became_active":"2024-09-15T22:50:21.334375+0000","last_became_peered":"2024-09-15T22:50:21.334375+0000","last_unstale":"2024-09-15T22:50:22.486740+0000","last_undegraded":"2024-09-15T22:50:22.486740+0000","last_fullsized":"2024-09-15T22:50:22.486740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484755+0000","last_change":"2024-09-15T22:50:17.068912+0000","last_active":"2024-09-15T22:50:22.484755+0000","last_peered":"2024-09-15T22:50:22.484755+0000","last_clean":"2024-09-15T22:50:22.484755+0000","last_became_active":"2024-09-15T22:50:17.068633+0000","last_became_peered":"2024-09-15T22:50:17.068633+0000","last_unstale":"2024-09-15T22:50:22.484755+0000","last_undegraded":"2024-09-15T22:50:22.484755+0000","last_fullsized":"2024-09-15T22:50:22.484755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484365+0000","last_change":"2024-09-15T22:50:16.063180+0000","last_active":"2024-09-15T22:50:22.484365+0000","last_peered":"2024-09-15T22:50:22.484365+0000","last_clean":"2024-09-15T22:50:22.484365+0000","last_became_active":"2024-09-15T22:50:16.062573+0000","last_became_peered":"2024-09-15T22:50:16.062573+0000","last_unstale":"2024-09-15T22:50:22.484365+0000","last_undegraded":"2024-09-15T22:50:22.484365+0000","last_fullsized":"2024-09-15T22:50:22.484365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486218+0000","last_change":"2024-09-15T22:50:16.061455+0000","last_active":"2024-09-15T22:50:22.486218+0000","last_peered":"2024-09-15T22:50:22.486218+0000","last_clean":"2024-09-15T22:50:22.486218+0000","last_became_active":"2024-09-15T22:50:16.061101+0000","last_became_peered":"2024-09-15T22:50:16.061101+0000","last_unstale":"2024-09-15T22:50:22.486218+0000","last_undegraded":"2024-09-15T22:50:22.486218+0000","last_fullsized":"2024-09-15T22:50:22.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486076+0000","last_change":"2024-09-15T22:50:17.051703+0000","last_active":"2024-09-15T22:50:22.486076+0000","last_peered":"2024-09-15T22:50:22.486076+0000","last_clean":"2024-09-15T22:50:22.486076+0000","last_became_active":"2024-09-15T22:50:17.051442+0000","last_became_peered":"2024-09-15T22:50:17.051442+0000","last_unstale":"2024-09-15T22:50:22.486076+0000","last_undegraded":"2024-09-15T22:50:22.486076+0000","last_fullsized":"2024-09-15T22:50:22.486076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302396+0000","last_change":"2024-09-15T22:50:21.330393+0000","last_active":"2024-09-15T22:50:22.302396+0000","last_peered":"2024-09-15T22:50:22.302396+0000","last_clean":"2024-09-15T22:50:22.302396+0000","last_became_active":"2024-09-15T22:50:21.329923+0000","last_became_peered":"2024-09-15T22:50:21.329923+0000","last_unstale":"2024-09-15T22:50:22.302396+0000","last_undegraded":"2024-09-15T22:50:22.302396+0000","last_fullsized":"2024-09-15T22:50:22.302396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.927144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484326+0000","last_change":"2024-09-15T22:50:16.062501+0000","last_active":"2024-09-15T22:50:22.484326+0000","last_peered":"2024-09-15T22:50:22.484326+0000","last_clean":"2024-09-15T22:50:22.484326+0000","last_became_active":"2024-09-15T22:50:16.061957+0000","last_became_peered":"2024-09-15T22:50:16.061957+0000","last_unstale":"2024-09-15T22:50:22.484326+0000","last_undegraded":"2024-09-15T22:50:22.484326+0000","last_fullsized":"2024-09-15T22:50:22.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305592+0000","last_change":"2024-09-15T22:50:17.057565+0000","last_active":"2024-09-15T22:50:22.305592+0000","last_peered":"2024-09-15T22:50:22.305592+0000","last_clean":"2024-09-15T22:50:22.305592+0000","last_became_active":"2024-09-15T22:50:17.057276+0000","last_became_peered":"2024-09-15T22:50:17.057276+0000","last_unstale":"2024-09-15T22:50:22.305592+0000","last_undegraded":"2024-09-15T22:50:22.305592+0000","last_fullsized":"2024-09-15T22:50:22.305592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:03.054052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484704+0000","last_change":"2024-09-15T22:50:21.330952+0000","last_active":"2024-09-15T22:50:22.484704+0000","last_peered":"2024-09-15T22:50:22.484704+0000","last_clean":"2024-09-15T22:50:22.484704+0000","last_became_active":"2024-09-15T22:50:21.330543+0000","last_became_peered":"2024-09-15T22:50:21.330543+0000","last_unstale":"2024-09-15T22:50:22.484704+0000","last_undegraded":"2024-09-15T22:50:22.484704+0000","last_fullsized":"2024-09-15T22:50:22.484704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:57.065313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485812+0000","last_change":"2024-09-15T22:50:17.075360+0000","last_active":"2024-09-15T22:50:22.485812+0000","last_peered":"2024-09-15T22:50:22.485812+0000","last_clean":"2024-09-15T22:50:22.485812+0000","last_became_active":"2024-09-15T22:50:17.072943+0000","last_became_peered":"2024-09-15T22:50:17.072943+0000","last_unstale":"2024-09-15T22:50:22.485812+0000","last_undegraded":"2024-09-15T22:50:22.485812+0000","last_fullsized":"2024-09-15T22:50:22.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301837+0000","last_change":"2024-09-15T22:50:17.062719+0000","last_active":"2024-09-15T22:50:22.301837+0000","last_peered":"2024-09-15T22:50:22.301837+0000","last_clean":"2024-09-15T22:50:22.301837+0000","last_became_active":"2024-09-15T22:50:17.060683+0000","last_became_peered":"2024-09-15T22:50:17.060683+0000","last_unstale":"2024-09-15T22:50:22.301837+0000","last_undegraded":"2024-09-15T22:50:22.301837+0000","last_fullsized":"2024-09-15T22:50:22.301837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305406+0000","last_change":"2024-09-15T22:50:17.067025+0000","last_active":"2024-09-15T22:50:22.305406+0000","last_peered":"2024-09-15T22:50:22.305406+0000","last_clean":"2024-09-15T22:50:22.305406+0000","last_became_active":"2024-09-15T22:50:17.066744+0000","last_became_peered":"2024-09-15T22:50:17.066744+0000","last_unstale":"2024-09-15T22:50:22.305406+0000","last_undegraded":"2024-09-15T22:50:22.305406+0000","last_fullsized":"2024-09-15T22:50:22.305406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:50.397722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485996+0000","last_change":"2024-09-15T22:50:17.080748+0000","last_active":"2024-09-15T22:50:22.485996+0000","last_peered":"2024-09-15T22:50:22.485996+0000","last_clean":"2024-09-15T22:50:22.485996+0000","last_became_active":"2024-09-15T22:50:17.080432+0000","last_became_peered":"2024-09-15T22:50:17.080432+0000","last_unstale":"2024-09-15T22:50:22.485996+0000","last_undegraded":"2024-09-15T22:50:22.485996+0000","last_fullsized":"2024-09-15T22:50:22.485996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484735+0000","last_change":"2024-09-15T22:50:17.057480+0000","last_active":"2024-09-15T22:50:22.484735+0000","last_peered":"2024-09-15T22:50:22.484735+0000","last_clean":"2024-09-15T22:50:22.484735+0000","last_became_active":"2024-09-15T22:50:17.056801+0000","last_became_peered":"2024-09-15T22:50:17.056801+0000","last_unstale":"2024-09-15T22:50:22.484735+0000","last_undegraded":"2024-09-15T22:50:22.484735+0000","last_fullsized":"2024-09-15T22:50:22.484735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487677+0000","last_change":"2024-09-15T22:50:17.070941+0000","last_active":"2024-09-15T22:50:22.487677+0000","last_peered":"2024-09-15T22:50:22.487677+0000","last_clean":"2024-09-15T22:50:22.487677+0000","last_became_active":"2024-09-15T22:50:17.070675+0000","last_became_peered":"2024-09-15T22:50:17.070675+0000","last_unstale":"2024-09-15T22:50:22.487677+0000","last_undegraded":"2024-09-15T22:50:22.487677+0000","last_fullsized":"2024-09-15T22:50:22.487677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487164+0000","last_change":"2024-09-15T22:50:17.069743+0000","last_active":"2024-09-15T22:50:22.487164+0000","last_peered":"2024-09-15T22:50:22.487164+0000","last_clean":"2024-09-15T22:50:22.487164+0000","last_became_active":"2024-09-15T22:50:17.069457+0000","last_became_peered":"2024-09-15T22:50:17.069457+0000","last_unstale":"2024-09-15T22:50:22.487164+0000","last_undegraded":"2024-09-15T22:50:22.487164+0000","last_fullsized":"2024-09-15T22:50:22.487164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484640+0000","last_change":"2024-09-15T22:50:17.061920+0000","last_active":"2024-09-15T22:50:22.484640+0000","last_peered":"2024-09-15T22:50:22.484640+0000","last_clean":"2024-09-15T22:50:22.484640+0000","last_became_active":"2024-09-15T22:50:17.061519+0000","last_became_peered":"2024-09-15T22:50:17.061519+0000","last_unstale":"2024-09-15T22:50:22.484640+0000","last_undegraded":"2024-09-15T22:50:22.484640+0000","last_fullsized":"2024-09-15T22:50:22.484640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304510+0000","last_change":"2024-09-15T22:50:17.073525+0000","last_active":"2024-09-15T22:50:22.304510+0000","last_peered":"2024-09-15T22:50:22.304510+0000","last_clean":"2024-09-15T22:50:22.304510+0000","last_became_active":"2024-09-15T22:50:17.073252+0000","last_became_peered":"2024-09-15T22:50:17.073252+0000","last_unstale":"2024-09-15T22:50:22.304510+0000","last_undegraded":"2024-09-15T22:50:22.304510+0000","last_fullsized":"2024-09-15T22:50:22.304510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:26.300782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484201+0000","last_change":"2024-09-15T22:50:17.062213+0000","last_active":"2024-09-15T22:50:22.484201+0000","last_peered":"2024-09-15T22:50:22.484201+0000","last_clean":"2024-09-15T22:50:22.484201+0000","last_became_active":"2024-09-15T22:50:17.061935+0000","last_became_peered":"2024-09-15T22:50:17.061935+0000","last_unstale":"2024-09-15T22:50:22.484201+0000","last_undegraded":"2024-09-15T22:50:22.484201+0000","last_fullsized":"2024-09-15T22:50:22.484201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305356+0000","last_change":"2024-09-15T22:50:17.065311+0000","last_active":"2024-09-15T22:50:22.305356+0000","last_peered":"2024-09-15T22:50:22.305356+0000","last_clean":"2024-09-15T22:50:22.305356+0000","last_became_active":"2024-09-15T22:50:17.064941+0000","last_became_peered":"2024-09-15T22:50:17.064941+0000","last_unstale":"2024-09-15T22:50:22.305356+0000","last_undegraded":"2024-09-15T22:50:22.305356+0000","last_fullsized":"2024-09-15T22:50:22.305356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:10.798798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485778+0000","last_change":"2024-09-15T22:50:17.066892+0000","last_active":"2024-09-15T22:50:22.485778+0000","last_peered":"2024-09-15T22:50:22.485778+0000","last_clean":"2024-09-15T22:50:22.485778+0000","last_became_active":"2024-09-15T22:50:17.066604+0000","last_became_peered":"2024-09-15T22:50:17.066604+0000","last_unstale":"2024-09-15T22:50:22.485778+0000","last_undegraded":"2024-09-15T22:50:22.485778+0000","last_fullsized":"2024-09-15T22:50:22.485778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486617+0000","last_change":"2024-09-15T22:50:17.063913+0000","last_active":"2024-09-15T22:50:22.486617+0000","last_peered":"2024-09-15T22:50:22.486617+0000","last_clean":"2024-09-15T22:50:22.486617+0000","last_became_active":"2024-09-15T22:50:17.063640+0000","last_became_peered":"2024-09-15T22:50:17.063640+0000","last_unstale":"2024-09-15T22:50:22.486617+0000","last_undegraded":"2024-09-15T22:50:22.486617+0000","last_fullsized":"2024-09-15T22:50:22.486617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486943+0000","last_change":"2024-09-15T22:50:17.065821+0000","last_active":"2024-09-15T22:50:22.486943+0000","last_peered":"2024-09-15T22:50:22.486943+0000","last_clean":"2024-09-15T22:50:22.486943+0000","last_became_active":"2024-09-15T22:50:17.065504+0000","last_became_peered":"2024-09-15T22:50:17.065504+0000","last_unstale":"2024-09-15T22:50:22.486943+0000","last_undegraded":"2024-09-15T22:50:22.486943+0000","last_fullsized":"2024-09-15T22:50:22.486943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:48.700096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302260+0000","last_change":"2024-09-15T22:50:17.059784+0000","last_active":"2024-09-15T22:50:22.302260+0000","last_peered":"2024-09-15T22:50:22.302260+0000","last_clean":"2024-09-15T22:50:22.302260+0000","last_became_active":"2024-09-15T22:50:17.059381+0000","last_became_peered":"2024-09-15T22:50:17.059381+0000","last_unstale":"2024-09-15T22:50:22.302260+0000","last_undegraded":"2024-09-15T22:50:22.302260+0000","last_fullsized":"2024-09-15T22:50:22.302260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306503+0000","last_change":"2024-09-15T22:50:17.069837+0000","last_active":"2024-09-15T22:50:22.306503+0000","last_peered":"2024-09-15T22:50:22.306503+0000","last_clean":"2024-09-15T22:50:22.306503+0000","last_became_active":"2024-09-15T22:50:17.068275+0000","last_became_peered":"2024-09-15T22:50:17.068275+0000","last_unstale":"2024-09-15T22:50:22.306503+0000","last_undegraded":"2024-09-15T22:50:22.306503+0000","last_fullsized":"2024-09-15T22:50:22.306503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.202716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304393+0000","last_change":"2024-09-15T22:50:17.047980+0000","last_active":"2024-09-15T22:50:22.304393+0000","last_peered":"2024-09-15T22:50:22.304393+0000","last_clean":"2024-09-15T22:50:22.304393+0000","last_became_active":"2024-09-15T22:50:17.047534+0000","last_became_peered":"2024-09-15T22:50:17.047534+0000","last_unstale":"2024-09-15T22:50:22.304393+0000","last_undegraded":"2024-09-15T22:50:22.304393+0000","last_fullsized":"2024-09-15T22:50:22.304393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:25.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486065+0000","last_change":"2024-09-15T22:50:17.064022+0000","last_active":"2024-09-15T22:50:22.486065+0000","last_peered":"2024-09-15T22:50:22.486065+0000","last_clean":"2024-09-15T22:50:22.486065+0000","last_became_active":"2024-09-15T22:50:17.063674+0000","last_became_peered":"2024-09-15T22:50:17.063674+0000","last_unstale":"2024-09-15T22:50:22.486065+0000","last_undegraded":"2024-09-15T22:50:22.486065+0000","last_fullsized":"2024-09-15T22:50:22.486065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485117+0000","last_change":"2024-09-15T22:50:17.068410+0000","last_active":"2024-09-15T22:50:22.485117+0000","last_peered":"2024-09-15T22:50:22.485117+0000","last_clean":"2024-09-15T22:50:22.485117+0000","last_became_active":"2024-09-15T22:50:17.068107+0000","last_became_peered":"2024-09-15T22:50:17.068107+0000","last_unstale":"2024-09-15T22:50:22.485117+0000","last_undegraded":"2024-09-15T22:50:22.485117+0000","last_fullsized":"2024-09-15T22:50:22.485117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:30.669334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484956+0000","last_change":"2024-09-15T22:50:17.065023+0000","last_active":"2024-09-15T22:50:22.484956+0000","last_peered":"2024-09-15T22:50:22.484956+0000","last_clean":"2024-09-15T22:50:22.484956+0000","last_became_active":"2024-09-15T22:50:17.062070+0000","last_became_peered":"2024-09-15T22:50:17.062070+0000","last_unstale":"2024-09-15T22:50:22.484956+0000","last_undegraded":"2024-09-15T22:50:22.484956+0000","last_fullsized":"2024-09-15T22:50:22.484956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306061+0000","last_change":"2024-09-15T22:50:17.057591+0000","last_active":"2024-09-15T22:50:22.306061+0000","last_peered":"2024-09-15T22:50:22.306061+0000","last_clean":"2024-09-15T22:50:22.306061+0000","last_became_active":"2024-09-15T22:50:17.057197+0000","last_became_peered":"2024-09-15T22:50:17.057197+0000","last_unstale":"2024-09-15T22:50:22.306061+0000","last_undegraded":"2024-09-15T22:50:22.306061+0000","last_fullsized":"2024-09-15T22:50:22.306061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:44.340627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486588+0000","last_change":"2024-09-15T22:50:17.068923+0000","last_active":"2024-09-15T22:50:22.486588+0000","last_peered":"2024-09-15T22:50:22.486588+0000","last_clean":"2024-09-15T22:50:22.486588+0000","last_became_active":"2024-09-15T22:50:17.068660+0000","last_became_peered":"2024-09-15T22:50:17.068660+0000","last_unstale":"2024-09-15T22:50:22.486588+0000","last_undegraded":"2024-09-15T22:50:22.486588+0000","last_fullsized":"2024-09-15T22:50:22.486588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487061+0000","last_change":"2024-09-15T22:50:17.061612+0000","last_active":"2024-09-15T22:50:22.487061+0000","last_peered":"2024-09-15T22:50:22.487061+0000","last_clean":"2024-09-15T22:50:22.487061+0000","last_became_active":"2024-09-15T22:50:17.061326+0000","last_became_peered":"2024-09-15T22:50:17.061326+0000","last_unstale":"2024-09-15T22:50:22.487061+0000","last_undegraded":"2024-09-15T22:50:22.487061+0000","last_fullsized":"2024-09-15T22:50:22.487061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487332+0000","last_change":"2024-09-15T22:50:17.069598+0000","last_active":"2024-09-15T22:50:22.487332+0000","last_peered":"2024-09-15T22:50:22.487332+0000","last_clean":"2024-09-15T22:50:22.487332+0000","last_became_active":"2024-09-15T22:50:17.069306+0000","last_became_peered":"2024-09-15T22:50:17.069306+0000","last_unstale":"2024-09-15T22:50:22.487332+0000","last_undegraded":"2024-09-15T22:50:22.487332+0000","last_fullsized":"2024-09-15T22:50:22.487332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.715006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484518+0000","last_change":"2024-09-15T22:50:17.065548+0000","last_active":"2024-09-15T22:50:22.484518+0000","last_peered":"2024-09-15T22:50:22.484518+0000","last_clean":"2024-09-15T22:50:22.484518+0000","last_became_active":"2024-09-15T22:50:17.065190+0000","last_became_peered":"2024-09-15T22:50:17.065190+0000","last_unstale":"2024-09-15T22:50:22.484518+0000","last_undegraded":"2024-09-15T22:50:22.484518+0000","last_fullsized":"2024-09-15T22:50:22.484518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486349+0000","last_change":"2024-09-15T22:50:17.076002+0000","last_active":"2024-09-15T22:50:22.486349+0000","last_peered":"2024-09-15T22:50:22.486349+0000","last_clean":"2024-09-15T22:50:22.486349+0000","last_became_active":"2024-09-15T22:50:17.075622+0000","last_became_peered":"2024-09-15T22:50:17.075622+0000","last_unstale":"2024-09-15T22:50:22.486349+0000","last_undegraded":"2024-09-15T22:50:22.486349+0000","last_fullsized":"2024-09-15T22:50:22.486349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305301+0000","last_change":"2024-09-15T22:50:17.047855+0000","last_active":"2024-09-15T22:50:22.305301+0000","last_peered":"2024-09-15T22:50:22.305301+0000","last_clean":"2024-09-15T22:50:22.305301+0000","last_became_active":"2024-09-15T22:50:17.047575+0000","last_became_peered":"2024-09-15T22:50:17.047575+0000","last_unstale":"2024-09-15T22:50:22.305301+0000","last_undegraded":"2024-09-15T22:50:22.305301+0000","last_fullsized":"2024-09-15T22:50:22.305301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:54.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486484+0000","last_change":"2024-09-15T22:50:17.065385+0000","last_active":"2024-09-15T22:50:22.486484+0000","last_peered":"2024-09-15T22:50:22.486484+0000","last_clean":"2024-09-15T22:50:22.486484+0000","last_became_active":"2024-09-15T22:50:17.065082+0000","last_became_peered":"2024-09-15T22:50:17.065082+0000","last_unstale":"2024-09-15T22:50:22.486484+0000","last_undegraded":"2024-09-15T22:50:22.486484+0000","last_fullsized":"2024-09-15T22:50:22.486484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:39.831313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:17.069029+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:17.068353+0000","last_became_peered":"2024-09-15T22:50:17.068353+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:10.316118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486448+0000","last_change":"2024-09-15T22:50:17.066254+0000","last_active":"2024-09-15T22:50:22.486448+0000","last_peered":"2024-09-15T22:50:22.486448+0000","last_clean":"2024-09-15T22:50:22.486448+0000","last_became_active":"2024-09-15T22:50:17.065906+0000","last_became_peered":"2024-09-15T22:50:17.065906+0000","last_unstale":"2024-09-15T22:50:22.486448+0000","last_undegraded":"2024-09-15T22:50:22.486448+0000","last_fullsized":"2024-09-15T22:50:22.486448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488087+0000","last_change":"2024-09-15T22:50:17.075262+0000","last_active":"2024-09-15T22:50:22.488087+0000","last_peered":"2024-09-15T22:50:22.488087+0000","last_clean":"2024-09-15T22:50:22.488087+0000","last_became_active":"2024-09-15T22:50:17.074935+0000","last_became_peered":"2024-09-15T22:50:17.074935+0000","last_unstale":"2024-09-15T22:50:22.488087+0000","last_undegraded":"2024-09-15T22:50:22.488087+0000","last_fullsized":"2024-09-15T22:50:22.488087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487272+0000","last_change":"2024-09-15T22:50:17.065618+0000","last_active":"2024-09-15T22:50:22.487272+0000","last_peered":"2024-09-15T22:50:22.487272+0000","last_clean":"2024-09-15T22:50:22.487272+0000","last_became_active":"2024-09-15T22:50:17.065380+0000","last_became_peered":"2024-09-15T22:50:17.065380+0000","last_unstale":"2024-09-15T22:50:22.487272+0000","last_undegraded":"2024-09-15T22:50:22.487272+0000","last_fullsized":"2024-09-15T22:50:22.487272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:41.033194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":860160,"data_stored":694509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:50:39.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:50:39.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 Processor -- start 2024-09-15T22:50:39.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 -- start start 2024-09-15T22:50:39.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5815ed30 0x7f9a58163dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a5809aa40 0x7f9a58166320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a580b3a40 con 0x7f9a5806bcc0 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9a580b3d20 con 0x7f9a5809aa40 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a60400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5815d240 con 0x7f9a5815ed30 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5da00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9a5806bcc0 0x7f9a5806c0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58430/0 (socket says 172.21.15.31:58430) 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5da00640 1 -- 172.21.15.31:0/371861882 learned_addr learned my addr 172.21.15.31:0/371861882 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5e400640 1 --2- 172.21.15.31:0/371861882 >> v2:172.21.15.31:3300/0 conn(0x7f9a5809aa40 0x7f9a58166320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5d000640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5815ed30 0x7f9a58163dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5e400640 1 -- 172.21.15.31:0/371861882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5815ed30 msgr2=0x7f9a58163dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5e400640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5815ed30 0x7f9a58163dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5e400640 1 -- 172.21.15.31:0/371861882 >> v1:172.21.15.31:6789/0 conn(0x7f9a5806bcc0 legacy=0x7f9a5806c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.653+0000 7f9a5e400640 1 -- 172.21.15.31:0/371861882 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5815d520 con 0x7f9a5809aa40 2024-09-15T22:50:39.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a5e400640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5809aa40 0x7f9a58166320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097c0 tx=0x7f9a5001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abfc8b03f225f8d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a57e00640 1 -- 172.21.15.31:0/371861882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a500b0070 con 0x7f9a5809aa40 2024-09-15T22:50:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a57e00640 1 -- 172.21.15.31:0/371861882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a500ab600 con 0x7f9a5809aa40 2024-09-15T22:50:39.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a57e00640 1 -- 172.21.15.31:0/371861882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a500ab9d0 con 0x7f9a5809aa40 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 -- 172.21.15.31:0/371861882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5809aa40 msgr2=0x7f9a58166320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5809aa40 0x7f9a58166320 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9a500097c0 tx=0x7f9a5001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 -- 172.21.15.31:0/371861882 shutdown_connections 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5809aa40 0x7f9a58166320 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 --2- 172.21.15.31:0/371861882 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5815ed30 0x7f9a58163dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 -- 172.21.15.31:0/371861882 >> 172.21.15.31:0/371861882 conn(0x7f9a58073540 msgr2=0x7f9a580b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 -- 172.21.15.31:0/371861882 shutdown_connections 2024-09-15T22:50:39.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.657+0000 7f9a60400640 1 -- 172.21.15.31:0/371861882 wait complete. 2024-09-15T22:50:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 Processor -- start 2024-09-15T22:50:39.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- start start 2024-09-15T22:50:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5809aa40 0x7f9a581531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a5815ed30 0x7f9a580cf870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9a580b6580 con 0x7f9a5806bcc0 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5815c690 con 0x7f9a5815ed30 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a580b6700 con 0x7f9a5809aa40 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39070/0 (socket says 172.21.15.31:39070) 2024-09-15T22:50:39.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 -- 172.21.15.31:0/3445869891 learned_addr learned my addr 172.21.15.31:0/3445869891 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5d000640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5809aa40 0x7f9a581531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 -- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5809aa40 msgr2=0x7f9a581531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5e400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a5815ed30 0x7f9a580cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5809aa40 0x7f9a581531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 -- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a5815ed30 msgr2=0x7f9a580cf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a5815ed30 0x7f9a580cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 -- 172.21.15.31:0/3445869891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a58154e40 con 0x7f9a5806bcc0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a5da00640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00caa0 tx=0x7f9a4c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c017070 con 0x7f9a5806bcc0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a4c00aba0 con 0x7f9a5806bcc0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a580b2360 con 0x7f9a5806bcc0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c012400 con 0x7f9a5806bcc0 2024-09-15T22:50:39.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a58153730 con 0x7f9a5806bcc0 2024-09-15T22:50:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.661+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5806c0a0 con 0x7f9a5806bcc0 2024-09-15T22:50:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.665+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a4c01a070 con 0x7f9a5806bcc0 2024-09-15T22:50:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.665+0000 7f9a55600640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 0x7f9a38069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:39.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.665+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a4c085d40 con 0x7f9a5806bcc0 2024-09-15T22:50:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.665+0000 7f9a5d000640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 0x7f9a38069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:39.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.665+0000 7f9a5d000640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 0x7f9a38069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b1900 tx=0x7f9a44008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:39.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.669+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a4c0564a0 con 0x7f9a5806bcc0 2024-09-15T22:50:39.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.833+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a580b2110 con 0x7f9a380678f0 2024-09-15T22:50:39.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.841+0000 7f9a55600640 1 -- 172.21.15.31:0/3445869891 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f9a580b2110 con 0x7f9a380678f0 2024-09-15T22:50:39.848 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:39.850 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:50:39.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 msgr2=0x7f9a38069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 0x7f9a38069db0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9a580b1900 tx=0x7f9a44008040 comp rx=0 tx=0).stop 2024-09-15T22:50:39.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 msgr2=0x7f9a58148520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:39.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00caa0 tx=0x7f9a4c00cf60 comp rx=0 tx=0).stop 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 shutdown_connections 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9a380678f0 0x7f9a38069db0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a5815ed30 0x7f9a580cf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a5809aa40 0x7f9a581531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 --2- 172.21.15.31:0/3445869891 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a5806bcc0 0x7f9a58148520 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 >> 172.21.15.31:0/3445869891 conn(0x7f9a58073540 msgr2=0x7f9a580d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 shutdown_connections 2024-09-15T22:50:39.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:39.845+0000 7f9a60400640 1 -- 172.21.15.31:0/3445869891 wait complete. 2024-09-15T22:50:39.868 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2024-09-15T22:50:39.559489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3350528,"data_stored":2018492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2232,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003462"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486560+0000","last_change":"2024-09-15T22:50:16.071034+0000","last_active":"2024-09-15T22:50:22.486560+0000","last_peered":"2024-09-15T22:50:22.486560+0000","last_clean":"2024-09-15T22:50:22.486560+0000","last_became_active":"2024-09-15T22:50:16.070808+0000","last_became_peered":"2024-09-15T22:50:16.070808+0000","last_unstale":"2024-09-15T22:50:22.486560+0000","last_undegraded":"2024-09-15T22:50:22.486560+0000","last_fullsized":"2024-09-15T22:50:22.486560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:07.036126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485037+0000","last_change":"2024-09-15T22:50:17.064575+0000","last_active":"2024-09-15T22:50:22.485037+0000","last_peered":"2024-09-15T22:50:22.485037+0000","last_clean":"2024-09-15T22:50:22.485037+0000","last_became_active":"2024-09-15T22:50:17.064271+0000","last_became_peered":"2024-09-15T22:50:17.064271+0000","last_unstale":"2024-09-15T22:50:22.485037+0000","last_undegraded":"2024-09-15T22:50:22.485037+0000","last_fullsized":"2024-09-15T22:50:22.485037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484032+0000","last_change":"2024-09-15T22:50:21.391770+0000","last_active":"2024-09-15T22:50:22.484032+0000","last_peered":"2024-09-15T22:50:22.484032+0000","last_clean":"2024-09-15T22:50:22.484032+0000","last_became_active":"2024-09-15T22:50:21.387296+0000","last_became_peered":"2024-09-15T22:50:21.387296+0000","last_unstale":"2024-09-15T22:50:22.484032+0000","last_undegraded":"2024-09-15T22:50:22.484032+0000","last_fullsized":"2024-09-15T22:50:22.484032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.401656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485239+0000","last_change":"2024-09-15T22:50:16.059723+0000","last_active":"2024-09-15T22:50:22.485239+0000","last_peered":"2024-09-15T22:50:22.485239+0000","last_clean":"2024-09-15T22:50:22.485239+0000","last_became_active":"2024-09-15T22:50:16.059365+0000","last_became_peered":"2024-09-15T22:50:16.059365+0000","last_unstale":"2024-09-15T22:50:22.485239+0000","last_undegraded":"2024-09-15T22:50:22.485239+0000","last_fullsized":"2024-09-15T22:50:22.485239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486397+0000","last_change":"2024-09-15T22:50:17.049966+0000","last_active":"2024-09-15T22:50:22.486397+0000","last_peered":"2024-09-15T22:50:22.486397+0000","last_clean":"2024-09-15T22:50:22.486397+0000","last_became_active":"2024-09-15T22:50:17.049585+0000","last_became_peered":"2024-09-15T22:50:17.049585+0000","last_unstale":"2024-09-15T22:50:22.486397+0000","last_undegraded":"2024-09-15T22:50:22.486397+0000","last_fullsized":"2024-09-15T22:50:22.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304395+0000","last_change":"2024-09-15T22:50:21.332999+0000","last_active":"2024-09-15T22:50:22.304395+0000","last_peered":"2024-09-15T22:50:22.304395+0000","last_clean":"2024-09-15T22:50:22.304395+0000","last_became_active":"2024-09-15T22:50:21.332489+0000","last_became_peered":"2024-09-15T22:50:21.332489+0000","last_unstale":"2024-09-15T22:50:22.304395+0000","last_undegraded":"2024-09-15T22:50:22.304395+0000","last_fullsized":"2024-09-15T22:50:22.304395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:14.476887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486836+0000","last_change":"2024-09-15T22:50:16.074061+0000","last_active":"2024-09-15T22:50:22.486836+0000","last_peered":"2024-09-15T22:50:22.486836+0000","last_clean":"2024-09-15T22:50:22.486836+0000","last_became_active":"2024-09-15T22:50:16.073371+0000","last_became_peered":"2024-09-15T22:50:16.073371+0000","last_unstale":"2024-09-15T22:50:22.486836+0000","last_undegraded":"2024-09-15T22:50:22.486836+0000","last_fullsized":"2024-09-15T22:50:22.486836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304993+0000","last_change":"2024-09-15T22:50:17.049531+0000","last_active":"2024-09-15T22:50:22.304993+0000","last_peered":"2024-09-15T22:50:22.304993+0000","last_clean":"2024-09-15T22:50:22.304993+0000","last_became_active":"2024-09-15T22:50:17.048655+0000","last_became_peered":"2024-09-15T22:50:17.048655+0000","last_unstale":"2024-09-15T22:50:22.304993+0000","last_undegraded":"2024-09-15T22:50:22.304993+0000","last_fullsized":"2024-09-15T22:50:22.304993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:35.848734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305466+0000","last_change":"2024-09-15T22:50:21.331612+0000","last_active":"2024-09-15T22:50:22.305466+0000","last_peered":"2024-09-15T22:50:22.305466+0000","last_clean":"2024-09-15T22:50:22.305466+0000","last_became_active":"2024-09-15T22:50:21.331183+0000","last_became_peered":"2024-09-15T22:50:21.331183+0000","last_unstale":"2024-09-15T22:50:22.305466+0000","last_undegraded":"2024-09-15T22:50:22.305466+0000","last_fullsized":"2024-09-15T22:50:22.305466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487042+0000","last_change":"2024-09-15T22:50:16.074167+0000","last_active":"2024-09-15T22:50:22.487042+0000","last_peered":"2024-09-15T22:50:22.487042+0000","last_clean":"2024-09-15T22:50:22.487042+0000","last_became_active":"2024-09-15T22:50:16.073667+0000","last_became_peered":"2024-09-15T22:50:16.073667+0000","last_unstale":"2024-09-15T22:50:22.487042+0000","last_undegraded":"2024-09-15T22:50:22.487042+0000","last_fullsized":"2024-09-15T22:50:22.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305928+0000","last_change":"2024-09-15T22:50:17.049937+0000","last_active":"2024-09-15T22:50:22.305928+0000","last_peered":"2024-09-15T22:50:22.305928+0000","last_clean":"2024-09-15T22:50:22.305928+0000","last_became_active":"2024-09-15T22:50:17.049500+0000","last_became_peered":"2024-09-15T22:50:17.049500+0000","last_unstale":"2024-09-15T22:50:22.305928+0000","last_undegraded":"2024-09-15T22:50:22.305928+0000","last_fullsized":"2024-09-15T22:50:22.305928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:59.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305411+0000","last_change":"2024-09-15T22:50:21.322140+0000","last_active":"2024-09-15T22:50:22.305411+0000","last_peered":"2024-09-15T22:50:22.305411+0000","last_clean":"2024-09-15T22:50:22.305411+0000","last_became_active":"2024-09-15T22:50:21.321613+0000","last_became_peered":"2024-09-15T22:50:21.321613+0000","last_unstale":"2024-09-15T22:50:22.305411+0000","last_undegraded":"2024-09-15T22:50:22.305411+0000","last_fullsized":"2024-09-15T22:50:22.305411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:25.347025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486025+0000","last_change":"2024-09-15T22:50:17.066161+0000","last_active":"2024-09-15T22:50:22.486025+0000","last_peered":"2024-09-15T22:50:22.486025+0000","last_clean":"2024-09-15T22:50:22.486025+0000","last_became_active":"2024-09-15T22:50:17.064352+0000","last_became_peered":"2024-09-15T22:50:17.064352+0000","last_unstale":"2024-09-15T22:50:22.486025+0000","last_undegraded":"2024-09-15T22:50:22.486025+0000","last_fullsized":"2024-09-15T22:50:22.486025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486824+0000","last_change":"2024-09-15T22:50:16.073863+0000","last_active":"2024-09-15T22:50:22.486824+0000","last_peered":"2024-09-15T22:50:22.486824+0000","last_clean":"2024-09-15T22:50:22.486824+0000","last_became_active":"2024-09-15T22:50:16.073568+0000","last_became_peered":"2024-09-15T22:50:16.073568+0000","last_unstale":"2024-09-15T22:50:22.486824+0000","last_undegraded":"2024-09-15T22:50:22.486824+0000","last_fullsized":"2024-09-15T22:50:22.486824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:50.833315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305147+0000","last_change":"2024-09-15T22:50:21.329220+0000","last_active":"2024-09-15T22:50:22.305147+0000","last_peered":"2024-09-15T22:50:22.305147+0000","last_clean":"2024-09-15T22:50:22.305147+0000","last_became_active":"2024-09-15T22:50:21.328859+0000","last_became_peered":"2024-09-15T22:50:21.328859+0000","last_unstale":"2024-09-15T22:50:22.305147+0000","last_undegraded":"2024-09-15T22:50:22.305147+0000","last_fullsized":"2024-09-15T22:50:22.305147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:53.380745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484221+0000","last_change":"2024-09-15T22:50:17.081686+0000","last_active":"2024-09-15T22:50:22.484221+0000","last_peered":"2024-09-15T22:50:22.484221+0000","last_clean":"2024-09-15T22:50:22.484221+0000","last_became_active":"2024-09-15T22:50:17.081267+0000","last_became_peered":"2024-09-15T22:50:17.081267+0000","last_unstale":"2024-09-15T22:50:22.484221+0000","last_undegraded":"2024-09-15T22:50:22.484221+0000","last_fullsized":"2024-09-15T22:50:22.484221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485397+0000","last_change":"2024-09-15T22:50:16.065960+0000","last_active":"2024-09-15T22:50:22.485397+0000","last_peered":"2024-09-15T22:50:22.485397+0000","last_clean":"2024-09-15T22:50:22.485397+0000","last_became_active":"2024-09-15T22:50:16.065603+0000","last_became_peered":"2024-09-15T22:50:16.065603+0000","last_unstale":"2024-09-15T22:50:22.485397+0000","last_undegraded":"2024-09-15T22:50:22.485397+0000","last_fullsized":"2024-09-15T22:50:22.485397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305841+0000","last_change":"2024-09-15T22:50:21.331723+0000","last_active":"2024-09-15T22:50:22.305841+0000","last_peered":"2024-09-15T22:50:22.305841+0000","last_clean":"2024-09-15T22:50:22.305841+0000","last_became_active":"2024-09-15T22:50:21.331153+0000","last_became_peered":"2024-09-15T22:50:21.331153+0000","last_unstale":"2024-09-15T22:50:22.305841+0000","last_undegraded":"2024-09-15T22:50:22.305841+0000","last_fullsized":"2024-09-15T22:50:22.305841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484852+0000","last_change":"2024-09-15T22:50:17.063766+0000","last_active":"2024-09-15T22:50:22.484852+0000","last_peered":"2024-09-15T22:50:22.484852+0000","last_clean":"2024-09-15T22:50:22.484852+0000","last_became_active":"2024-09-15T22:50:17.063505+0000","last_became_peered":"2024-09-15T22:50:17.063505+0000","last_unstale":"2024-09-15T22:50:22.484852+0000","last_undegraded":"2024-09-15T22:50:22.484852+0000","last_fullsized":"2024-09-15T22:50:22.484852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486133+0000","last_change":"2024-09-15T22:50:16.058862+0000","last_active":"2024-09-15T22:50:22.486133+0000","last_peered":"2024-09-15T22:50:22.486133+0000","last_clean":"2024-09-15T22:50:22.486133+0000","last_became_active":"2024-09-15T22:50:16.058559+0000","last_became_peered":"2024-09-15T22:50:16.058559+0000","last_unstale":"2024-09-15T22:50:22.486133+0000","last_undegraded":"2024-09-15T22:50:22.486133+0000","last_fullsized":"2024-09-15T22:50:22.486133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488018+0000","last_change":"2024-09-15T22:50:21.388463+0000","last_active":"2024-09-15T22:50:22.488018+0000","last_peered":"2024-09-15T22:50:22.488018+0000","last_clean":"2024-09-15T22:50:22.488018+0000","last_became_active":"2024-09-15T22:50:21.387965+0000","last_became_peered":"2024-09-15T22:50:21.387965+0000","last_unstale":"2024-09-15T22:50:22.488018+0000","last_undegraded":"2024-09-15T22:50:22.488018+0000","last_fullsized":"2024-09-15T22:50:22.488018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304813+0000","last_change":"2024-09-15T22:50:17.056742+0000","last_active":"2024-09-15T22:50:22.304813+0000","last_peered":"2024-09-15T22:50:22.304813+0000","last_clean":"2024-09-15T22:50:22.304813+0000","last_became_active":"2024-09-15T22:50:17.056447+0000","last_became_peered":"2024-09-15T22:50:17.056447+0000","last_unstale":"2024-09-15T22:50:22.304813+0000","last_undegraded":"2024-09-15T22:50:22.304813+0000","last_fullsized":"2024-09-15T22:50:22.304813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486107+0000","last_change":"2024-09-15T22:50:16.072521+0000","last_active":"2024-09-15T22:50:22.486107+0000","last_peered":"2024-09-15T22:50:22.486107+0000","last_clean":"2024-09-15T22:50:22.486107+0000","last_became_active":"2024-09-15T22:50:16.071920+0000","last_became_peered":"2024-09-15T22:50:16.071920+0000","last_unstale":"2024-09-15T22:50:22.486107+0000","last_undegraded":"2024-09-15T22:50:22.486107+0000","last_fullsized":"2024-09-15T22:50:22.486107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305040+0000","last_change":"2024-09-15T22:50:21.333094+0000","last_active":"2024-09-15T22:50:22.305040+0000","last_peered":"2024-09-15T22:50:22.305040+0000","last_clean":"2024-09-15T22:50:22.305040+0000","last_became_active":"2024-09-15T22:50:21.332195+0000","last_became_peered":"2024-09-15T22:50:21.332195+0000","last_unstale":"2024-09-15T22:50:22.305040+0000","last_undegraded":"2024-09-15T22:50:22.305040+0000","last_fullsized":"2024-09-15T22:50:22.305040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:51.604505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486855+0000","last_change":"2024-09-15T22:50:17.068190+0000","last_active":"2024-09-15T22:50:22.486855+0000","last_peered":"2024-09-15T22:50:22.486855+0000","last_clean":"2024-09-15T22:50:22.486855+0000","last_became_active":"2024-09-15T22:50:17.067975+0000","last_became_peered":"2024-09-15T22:50:17.067975+0000","last_unstale":"2024-09-15T22:50:22.486855+0000","last_undegraded":"2024-09-15T22:50:22.486855+0000","last_fullsized":"2024-09-15T22:50:22.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487083+0000","last_change":"2024-09-15T22:50:16.076299+0000","last_active":"2024-09-15T22:50:22.487083+0000","last_peered":"2024-09-15T22:50:22.487083+0000","last_clean":"2024-09-15T22:50:22.487083+0000","last_became_active":"2024-09-15T22:50:16.075995+0000","last_became_peered":"2024-09-15T22:50:16.075995+0000","last_unstale":"2024-09-15T22:50:22.487083+0000","last_undegraded":"2024-09-15T22:50:22.487083+0000","last_fullsized":"2024-09-15T22:50:22.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304527+0000","last_change":"2024-09-15T22:50:21.387662+0000","last_active":"2024-09-15T22:50:22.304527+0000","last_peered":"2024-09-15T22:50:22.304527+0000","last_clean":"2024-09-15T22:50:22.304527+0000","last_became_active":"2024-09-15T22:50:21.387238+0000","last_became_peered":"2024-09-15T22:50:21.387238+0000","last_unstale":"2024-09-15T22:50:22.304527+0000","last_undegraded":"2024-09-15T22:50:22.304527+0000","last_fullsized":"2024-09-15T22:50:22.304527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:29.299907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484756+0000","last_change":"2024-09-15T22:50:17.065264+0000","last_active":"2024-09-15T22:50:22.484756+0000","last_peered":"2024-09-15T22:50:22.484756+0000","last_clean":"2024-09-15T22:50:22.484756+0000","last_became_active":"2024-09-15T22:50:17.064957+0000","last_became_peered":"2024-09-15T22:50:17.064957+0000","last_unstale":"2024-09-15T22:50:22.484756+0000","last_undegraded":"2024-09-15T22:50:22.484756+0000","last_fullsized":"2024-09-15T22:50:22.484756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488183+0000","last_change":"2024-09-15T22:50:16.065838+0000","last_active":"2024-09-15T22:50:22.488183+0000","last_peered":"2024-09-15T22:50:22.488183+0000","last_clean":"2024-09-15T22:50:22.488183+0000","last_became_active":"2024-09-15T22:50:16.065431+0000","last_became_peered":"2024-09-15T22:50:16.065431+0000","last_unstale":"2024-09-15T22:50:22.488183+0000","last_undegraded":"2024-09-15T22:50:22.488183+0000","last_fullsized":"2024-09-15T22:50:22.488183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484368+0000","last_change":"2024-09-15T22:50:21.386971+0000","last_active":"2024-09-15T22:50:22.484368+0000","last_peered":"2024-09-15T22:50:22.484368+0000","last_clean":"2024-09-15T22:50:22.484368+0000","last_became_active":"2024-09-15T22:50:21.386649+0000","last_became_peered":"2024-09-15T22:50:21.386649+0000","last_unstale":"2024-09-15T22:50:22.484368+0000","last_undegraded":"2024-09-15T22:50:22.484368+0000","last_fullsized":"2024-09-15T22:50:22.484368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.952001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487665+0000","last_change":"2024-09-15T22:50:17.061858+0000","last_active":"2024-09-15T22:50:22.487665+0000","last_peered":"2024-09-15T22:50:22.487665+0000","last_clean":"2024-09-15T22:50:22.487665+0000","last_became_active":"2024-09-15T22:50:17.061576+0000","last_became_peered":"2024-09-15T22:50:17.061576+0000","last_unstale":"2024-09-15T22:50:22.487665+0000","last_undegraded":"2024-09-15T22:50:22.487665+0000","last_fullsized":"2024-09-15T22:50:22.487665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487045+0000","last_change":"2024-09-15T22:50:16.074301+0000","last_active":"2024-09-15T22:50:22.487045+0000","last_peered":"2024-09-15T22:50:22.487045+0000","last_clean":"2024-09-15T22:50:22.487045+0000","last_became_active":"2024-09-15T22:50:16.073757+0000","last_became_peered":"2024-09-15T22:50:16.073757+0000","last_unstale":"2024-09-15T22:50:22.487045+0000","last_undegraded":"2024-09-15T22:50:22.487045+0000","last_fullsized":"2024-09-15T22:50:22.487045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485694+0000","last_change":"2024-09-15T22:50:21.387039+0000","last_active":"2024-09-15T22:50:22.485694+0000","last_peered":"2024-09-15T22:50:22.485694+0000","last_clean":"2024-09-15T22:50:22.485694+0000","last_became_active":"2024-09-15T22:50:21.386588+0000","last_became_peered":"2024-09-15T22:50:21.386588+0000","last_unstale":"2024-09-15T22:50:22.485694+0000","last_undegraded":"2024-09-15T22:50:22.485694+0000","last_fullsized":"2024-09-15T22:50:22.485694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306041+0000","last_change":"2024-09-15T22:50:17.073775+0000","last_active":"2024-09-15T22:50:22.306041+0000","last_peered":"2024-09-15T22:50:22.306041+0000","last_clean":"2024-09-15T22:50:22.306041+0000","last_became_active":"2024-09-15T22:50:17.073501+0000","last_became_peered":"2024-09-15T22:50:17.073501+0000","last_unstale":"2024-09-15T22:50:22.306041+0000","last_undegraded":"2024-09-15T22:50:22.306041+0000","last_fullsized":"2024-09-15T22:50:22.306041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.114390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487762+0000","last_change":"2024-09-15T22:50:16.062735+0000","last_active":"2024-09-15T22:50:22.487762+0000","last_peered":"2024-09-15T22:50:22.487762+0000","last_clean":"2024-09-15T22:50:22.487762+0000","last_became_active":"2024-09-15T22:50:16.062407+0000","last_became_peered":"2024-09-15T22:50:16.062407+0000","last_unstale":"2024-09-15T22:50:22.487762+0000","last_undegraded":"2024-09-15T22:50:22.487762+0000","last_fullsized":"2024-09-15T22:50:22.487762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485248+0000","last_change":"2024-09-15T22:50:21.334715+0000","last_active":"2024-09-15T22:50:22.485248+0000","last_peered":"2024-09-15T22:50:22.485248+0000","last_clean":"2024-09-15T22:50:22.485248+0000","last_became_active":"2024-09-15T22:50:21.334378+0000","last_became_peered":"2024-09-15T22:50:21.334378+0000","last_unstale":"2024-09-15T22:50:22.485248+0000","last_undegraded":"2024-09-15T22:50:22.485248+0000","last_fullsized":"2024-09-15T22:50:22.485248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305984+0000","last_change":"2024-09-15T22:50:17.059567+0000","last_active":"2024-09-15T22:50:22.305984+0000","last_peered":"2024-09-15T22:50:22.305984+0000","last_clean":"2024-09-15T22:50:22.305984+0000","last_became_active":"2024-09-15T22:50:17.059236+0000","last_became_peered":"2024-09-15T22:50:17.059236+0000","last_unstale":"2024-09-15T22:50:22.305984+0000","last_undegraded":"2024-09-15T22:50:22.305984+0000","last_fullsized":"2024-09-15T22:50:22.305984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305510+0000","last_change":"2024-09-15T22:50:16.064966+0000","last_active":"2024-09-15T22:50:22.305510+0000","last_peered":"2024-09-15T22:50:22.305510+0000","last_clean":"2024-09-15T22:50:22.305510+0000","last_became_active":"2024-09-15T22:50:16.063647+0000","last_became_peered":"2024-09-15T22:50:16.063647+0000","last_unstale":"2024-09-15T22:50:22.305510+0000","last_undegraded":"2024-09-15T22:50:22.305510+0000","last_fullsized":"2024-09-15T22:50:22.305510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:05.094689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487711+0000","last_change":"2024-09-15T22:50:21.324683+0000","last_active":"2024-09-15T22:50:22.487711+0000","last_peered":"2024-09-15T22:50:22.487711+0000","last_clean":"2024-09-15T22:50:22.487711+0000","last_became_active":"2024-09-15T22:50:21.324107+0000","last_became_peered":"2024-09-15T22:50:21.324107+0000","last_unstale":"2024-09-15T22:50:22.487711+0000","last_undegraded":"2024-09-15T22:50:22.487711+0000","last_fullsized":"2024-09-15T22:50:22.487711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484084+0000","last_change":"2024-09-15T22:50:17.076106+0000","last_active":"2024-09-15T22:50:22.484084+0000","last_peered":"2024-09-15T22:50:22.484084+0000","last_clean":"2024-09-15T22:50:22.484084+0000","last_became_active":"2024-09-15T22:50:17.075941+0000","last_became_peered":"2024-09-15T22:50:17.075941+0000","last_unstale":"2024-09-15T22:50:22.484084+0000","last_undegraded":"2024-09-15T22:50:22.484084+0000","last_fullsized":"2024-09-15T22:50:22.484084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301938+0000","last_change":"2024-09-15T22:50:16.058921+0000","last_active":"2024-09-15T22:50:22.301938+0000","last_peered":"2024-09-15T22:50:22.301938+0000","last_clean":"2024-09-15T22:50:22.301938+0000","last_became_active":"2024-09-15T22:50:16.056403+0000","last_became_peered":"2024-09-15T22:50:16.056403+0000","last_unstale":"2024-09-15T22:50:22.301938+0000","last_undegraded":"2024-09-15T22:50:22.301938+0000","last_fullsized":"2024-09-15T22:50:22.301938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488128+0000","last_change":"2024-09-15T22:50:21.328492+0000","last_active":"2024-09-15T22:50:22.488128+0000","last_peered":"2024-09-15T22:50:22.488128+0000","last_clean":"2024-09-15T22:50:22.488128+0000","last_became_active":"2024-09-15T22:50:21.327821+0000","last_became_peered":"2024-09-15T22:50:21.327821+0000","last_unstale":"2024-09-15T22:50:22.488128+0000","last_undegraded":"2024-09-15T22:50:22.488128+0000","last_fullsized":"2024-09-15T22:50:22.488128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485106+0000","last_change":"2024-09-15T22:50:17.048995+0000","last_active":"2024-09-15T22:50:22.485106+0000","last_peered":"2024-09-15T22:50:22.485106+0000","last_clean":"2024-09-15T22:50:22.485106+0000","last_became_active":"2024-09-15T22:50:17.048715+0000","last_became_peered":"2024-09-15T22:50:17.048715+0000","last_unstale":"2024-09-15T22:50:22.485106+0000","last_undegraded":"2024-09-15T22:50:22.485106+0000","last_fullsized":"2024-09-15T22:50:22.485106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:53.664696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486222+0000","last_change":"2024-09-15T22:50:16.072709+0000","last_active":"2024-09-15T22:50:22.486222+0000","last_peered":"2024-09-15T22:50:22.486222+0000","last_clean":"2024-09-15T22:50:22.486222+0000","last_became_active":"2024-09-15T22:50:16.072241+0000","last_became_peered":"2024-09-15T22:50:16.072241+0000","last_unstale":"2024-09-15T22:50:22.486222+0000","last_undegraded":"2024-09-15T22:50:22.486222+0000","last_fullsized":"2024-09-15T22:50:22.486222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486771+0000","last_change":"2024-09-15T22:50:21.386663+0000","last_active":"2024-09-15T22:50:22.486771+0000","last_peered":"2024-09-15T22:50:22.486771+0000","last_clean":"2024-09-15T22:50:22.486771+0000","last_became_active":"2024-09-15T22:50:21.386297+0000","last_became_peered":"2024-09-15T22:50:21.386297+0000","last_unstale":"2024-09-15T22:50:22.486771+0000","last_undegraded":"2024-09-15T22:50:22.486771+0000","last_fullsized":"2024-09-15T22:50:22.486771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:39.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485330+0000","last_change":"2024-09-15T22:50:17.059375+0000","last_active":"2024-09-15T22:50:22.485330+0000","last_peered":"2024-09-15T22:50:22.485330+0000","last_clean":"2024-09-15T22:50:22.485330+0000","last_became_active":"2024-09-15T22:50:17.059132+0000","last_became_peered":"2024-09-15T22:50:17.059132+0000","last_unstale":"2024-09-15T22:50:22.485330+0000","last_undegraded":"2024-09-15T22:50:22.485330+0000","last_fullsized":"2024-09-15T22:50:22.485330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:16.056464+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:16.055773+0000","last_became_peered":"2024-09-15T22:50:16.055773+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:58.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486332+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:50:22.486332+0000","last_peered":"2024-09-15T22:50:22.486332+0000","last_clean":"2024-09-15T22:50:22.486332+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:50:22.486332+0000","last_undegraded":"2024-09-15T22:50:22.486332+0000","last_fullsized":"2024-09-15T22:50:22.486332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486472+0000","last_change":"2024-09-15T22:50:21.392217+0000","last_active":"2024-09-15T22:50:22.486472+0000","last_peered":"2024-09-15T22:50:22.486472+0000","last_clean":"2024-09-15T22:50:22.486472+0000","last_became_active":"2024-09-15T22:50:21.387886+0000","last_became_peered":"2024-09-15T22:50:21.387886+0000","last_unstale":"2024-09-15T22:50:22.486472+0000","last_undegraded":"2024-09-15T22:50:22.486472+0000","last_fullsized":"2024-09-15T22:50:22.486472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486289+0000","last_change":"2024-09-15T22:50:17.072970+0000","last_active":"2024-09-15T22:50:22.486289+0000","last_peered":"2024-09-15T22:50:22.486289+0000","last_clean":"2024-09-15T22:50:22.486289+0000","last_became_active":"2024-09-15T22:50:17.072660+0000","last_became_peered":"2024-09-15T22:50:17.072660+0000","last_unstale":"2024-09-15T22:50:22.486289+0000","last_undegraded":"2024-09-15T22:50:22.486289+0000","last_fullsized":"2024-09-15T22:50:22.486289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302167+0000","last_change":"2024-09-15T22:50:16.069049+0000","last_active":"2024-09-15T22:50:22.302167+0000","last_peered":"2024-09-15T22:50:22.302167+0000","last_clean":"2024-09-15T22:50:22.302167+0000","last_became_active":"2024-09-15T22:50:16.068684+0000","last_became_peered":"2024-09-15T22:50:16.068684+0000","last_unstale":"2024-09-15T22:50:22.302167+0000","last_undegraded":"2024-09-15T22:50:22.302167+0000","last_fullsized":"2024-09-15T22:50:22.302167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486339+0000","last_change":"2024-09-15T22:50:21.385944+0000","last_active":"2024-09-15T22:50:22.486339+0000","last_peered":"2024-09-15T22:50:22.486339+0000","last_clean":"2024-09-15T22:50:22.486339+0000","last_became_active":"2024-09-15T22:50:21.385537+0000","last_became_peered":"2024-09-15T22:50:21.385537+0000","last_unstale":"2024-09-15T22:50:22.486339+0000","last_undegraded":"2024-09-15T22:50:22.486339+0000","last_fullsized":"2024-09-15T22:50:22.486339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305085+0000","last_change":"2024-09-15T22:50:17.067273+0000","last_active":"2024-09-15T22:50:22.305085+0000","last_peered":"2024-09-15T22:50:22.305085+0000","last_clean":"2024-09-15T22:50:22.305085+0000","last_became_active":"2024-09-15T22:50:17.066944+0000","last_became_peered":"2024-09-15T22:50:17.066944+0000","last_unstale":"2024-09-15T22:50:22.305085+0000","last_undegraded":"2024-09-15T22:50:22.305085+0000","last_fullsized":"2024-09-15T22:50:22.305085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:59.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487904+0000","last_change":"2024-09-15T22:50:16.059543+0000","last_active":"2024-09-15T22:50:22.487904+0000","last_peered":"2024-09-15T22:50:22.487904+0000","last_clean":"2024-09-15T22:50:22.487904+0000","last_became_active":"2024-09-15T22:50:16.056601+0000","last_became_peered":"2024-09-15T22:50:16.056601+0000","last_unstale":"2024-09-15T22:50:22.487904+0000","last_undegraded":"2024-09-15T22:50:22.487904+0000","last_fullsized":"2024-09-15T22:50:22.487904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485917+0000","last_change":"2024-09-15T22:50:21.330038+0000","last_active":"2024-09-15T22:50:22.485917+0000","last_peered":"2024-09-15T22:50:22.485917+0000","last_clean":"2024-09-15T22:50:22.485917+0000","last_became_active":"2024-09-15T22:50:21.329579+0000","last_became_peered":"2024-09-15T22:50:21.329579+0000","last_unstale":"2024-09-15T22:50:22.485917+0000","last_undegraded":"2024-09-15T22:50:22.485917+0000","last_fullsized":"2024-09-15T22:50:22.485917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487400+0000","last_change":"2024-09-15T22:50:17.066201+0000","last_active":"2024-09-15T22:50:22.487400+0000","last_peered":"2024-09-15T22:50:22.487400+0000","last_clean":"2024-09-15T22:50:22.487400+0000","last_became_active":"2024-09-15T22:50:17.065922+0000","last_became_peered":"2024-09-15T22:50:17.065922+0000","last_unstale":"2024-09-15T22:50:22.487400+0000","last_undegraded":"2024-09-15T22:50:22.487400+0000","last_fullsized":"2024-09-15T22:50:22.487400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:13.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302362+0000","last_change":"2024-09-15T22:50:16.059590+0000","last_active":"2024-09-15T22:50:22.302362+0000","last_peered":"2024-09-15T22:50:22.302362+0000","last_clean":"2024-09-15T22:50:22.302362+0000","last_became_active":"2024-09-15T22:50:16.059168+0000","last_became_peered":"2024-09-15T22:50:16.059168+0000","last_unstale":"2024-09-15T22:50:22.302362+0000","last_undegraded":"2024-09-15T22:50:22.302362+0000","last_fullsized":"2024-09-15T22:50:22.302362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304215+0000","last_change":"2024-09-15T22:50:21.387467+0000","last_active":"2024-09-15T22:50:22.304215+0000","last_peered":"2024-09-15T22:50:22.304215+0000","last_clean":"2024-09-15T22:50:22.304215+0000","last_became_active":"2024-09-15T22:50:21.387053+0000","last_became_peered":"2024-09-15T22:50:21.387053+0000","last_unstale":"2024-09-15T22:50:22.304215+0000","last_undegraded":"2024-09-15T22:50:22.304215+0000","last_fullsized":"2024-09-15T22:50:22.304215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:55.525858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487044+0000","last_change":"2024-09-15T22:50:17.073751+0000","last_active":"2024-09-15T22:50:22.487044+0000","last_peered":"2024-09-15T22:50:22.487044+0000","last_clean":"2024-09-15T22:50:22.487044+0000","last_became_active":"2024-09-15T22:50:17.065140+0000","last_became_peered":"2024-09-15T22:50:17.065140+0000","last_unstale":"2024-09-15T22:50:22.487044+0000","last_undegraded":"2024-09-15T22:50:22.487044+0000","last_fullsized":"2024-09-15T22:50:22.487044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:19.682526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305439+0000","last_change":"2024-09-15T22:50:16.065101+0000","last_active":"2024-09-15T22:50:22.305439+0000","last_peered":"2024-09-15T22:50:22.305439+0000","last_clean":"2024-09-15T22:50:22.305439+0000","last_became_active":"2024-09-15T22:50:16.064796+0000","last_became_peered":"2024-09-15T22:50:16.064796+0000","last_unstale":"2024-09-15T22:50:22.305439+0000","last_undegraded":"2024-09-15T22:50:22.305439+0000","last_fullsized":"2024-09-15T22:50:22.305439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:16.223077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304254+0000","last_change":"2024-09-15T22:50:21.331825+0000","last_active":"2024-09-15T22:50:22.304254+0000","last_peered":"2024-09-15T22:50:22.304254+0000","last_clean":"2024-09-15T22:50:22.304254+0000","last_became_active":"2024-09-15T22:50:21.331115+0000","last_became_peered":"2024-09-15T22:50:21.331115+0000","last_unstale":"2024-09-15T22:50:22.304254+0000","last_undegraded":"2024-09-15T22:50:22.304254+0000","last_fullsized":"2024-09-15T22:50:22.304254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:22.486441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486479+0000","last_change":"2024-09-15T22:50:17.069472+0000","last_active":"2024-09-15T22:50:22.486479+0000","last_peered":"2024-09-15T22:50:22.486479+0000","last_clean":"2024-09-15T22:50:22.486479+0000","last_became_active":"2024-09-15T22:50:17.066357+0000","last_became_peered":"2024-09-15T22:50:17.066357+0000","last_unstale":"2024-09-15T22:50:22.486479+0000","last_undegraded":"2024-09-15T22:50:22.486479+0000","last_fullsized":"2024-09-15T22:50:22.486479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301701+0000","last_change":"2024-09-15T22:50:16.054885+0000","last_active":"2024-09-15T22:50:22.301701+0000","last_peered":"2024-09-15T22:50:22.301701+0000","last_clean":"2024-09-15T22:50:22.301701+0000","last_became_active":"2024-09-15T22:50:16.054595+0000","last_became_peered":"2024-09-15T22:50:16.054595+0000","last_unstale":"2024-09-15T22:50:22.301701+0000","last_undegraded":"2024-09-15T22:50:22.301701+0000","last_fullsized":"2024-09-15T22:50:22.301701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486700+0000","last_change":"2024-09-15T22:50:21.326386+0000","last_active":"2024-09-15T22:50:22.486700+0000","last_peered":"2024-09-15T22:50:22.486700+0000","last_clean":"2024-09-15T22:50:22.486700+0000","last_became_active":"2024-09-15T22:50:21.323287+0000","last_became_peered":"2024-09-15T22:50:21.323287+0000","last_unstale":"2024-09-15T22:50:22.486700+0000","last_undegraded":"2024-09-15T22:50:22.486700+0000","last_fullsized":"2024-09-15T22:50:22.486700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485918+0000","last_change":"2024-09-15T22:50:17.075345+0000","last_active":"2024-09-15T22:50:22.485918+0000","last_peered":"2024-09-15T22:50:22.485918+0000","last_clean":"2024-09-15T22:50:22.485918+0000","last_became_active":"2024-09-15T22:50:17.071860+0000","last_became_peered":"2024-09-15T22:50:17.071860+0000","last_unstale":"2024-09-15T22:50:22.485918+0000","last_undegraded":"2024-09-15T22:50:22.485918+0000","last_fullsized":"2024-09-15T22:50:22.485918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486616+0000","last_change":"2024-09-15T22:50:16.066823+0000","last_active":"2024-09-15T22:50:22.486616+0000","last_peered":"2024-09-15T22:50:22.486616+0000","last_clean":"2024-09-15T22:50:22.486616+0000","last_became_active":"2024-09-15T22:50:16.066066+0000","last_became_peered":"2024-09-15T22:50:16.066066+0000","last_unstale":"2024-09-15T22:50:22.486616+0000","last_undegraded":"2024-09-15T22:50:22.486616+0000","last_fullsized":"2024-09-15T22:50:22.486616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484534+0000","last_change":"2024-09-15T22:50:21.387848+0000","last_active":"2024-09-15T22:50:22.484534+0000","last_peered":"2024-09-15T22:50:22.484534+0000","last_clean":"2024-09-15T22:50:22.484534+0000","last_became_active":"2024-09-15T22:50:21.387224+0000","last_became_peered":"2024-09-15T22:50:21.387224+0000","last_unstale":"2024-09-15T22:50:22.484534+0000","last_undegraded":"2024-09-15T22:50:22.484534+0000","last_fullsized":"2024-09-15T22:50:22.484534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.174091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486681+0000","last_change":"2024-09-15T22:50:17.071304+0000","last_active":"2024-09-15T22:50:22.486681+0000","last_peered":"2024-09-15T22:50:22.486681+0000","last_clean":"2024-09-15T22:50:22.486681+0000","last_became_active":"2024-09-15T22:50:17.070613+0000","last_became_peered":"2024-09-15T22:50:17.070613+0000","last_unstale":"2024-09-15T22:50:22.486681+0000","last_undegraded":"2024-09-15T22:50:22.486681+0000","last_fullsized":"2024-09-15T22:50:22.486681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:02.870943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305454+0000","last_change":"2024-09-15T22:50:16.069513+0000","last_active":"2024-09-15T22:50:22.305454+0000","last_peered":"2024-09-15T22:50:22.305454+0000","last_clean":"2024-09-15T22:50:22.305454+0000","last_became_active":"2024-09-15T22:50:16.069194+0000","last_became_peered":"2024-09-15T22:50:16.069194+0000","last_unstale":"2024-09-15T22:50:22.305454+0000","last_undegraded":"2024-09-15T22:50:22.305454+0000","last_fullsized":"2024-09-15T22:50:22.305454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:32.487332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484440+0000","last_change":"2024-09-15T22:50:21.385231+0000","last_active":"2024-09-15T22:50:22.484440+0000","last_peered":"2024-09-15T22:50:22.484440+0000","last_clean":"2024-09-15T22:50:22.484440+0000","last_became_active":"2024-09-15T22:50:21.384687+0000","last_became_peered":"2024-09-15T22:50:21.384687+0000","last_unstale":"2024-09-15T22:50:22.484440+0000","last_undegraded":"2024-09-15T22:50:22.484440+0000","last_fullsized":"2024-09-15T22:50:22.484440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:58.714208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485419+0000","last_change":"2024-09-15T22:50:17.062760+0000","last_active":"2024-09-15T22:50:22.485419+0000","last_peered":"2024-09-15T22:50:22.485419+0000","last_clean":"2024-09-15T22:50:22.485419+0000","last_became_active":"2024-09-15T22:50:17.062472+0000","last_became_peered":"2024-09-15T22:50:17.062472+0000","last_unstale":"2024-09-15T22:50:22.485419+0000","last_undegraded":"2024-09-15T22:50:22.485419+0000","last_fullsized":"2024-09-15T22:50:22.485419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:55.399729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486167+0000","last_change":"2024-09-15T22:50:16.060509+0000","last_active":"2024-09-15T22:50:22.486167+0000","last_peered":"2024-09-15T22:50:22.486167+0000","last_clean":"2024-09-15T22:50:22.486167+0000","last_became_active":"2024-09-15T22:50:16.060218+0000","last_became_peered":"2024-09-15T22:50:16.060218+0000","last_unstale":"2024-09-15T22:50:22.486167+0000","last_undegraded":"2024-09-15T22:50:22.486167+0000","last_fullsized":"2024-09-15T22:50:22.486167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305780+0000","last_change":"2024-09-15T22:50:21.389097+0000","last_active":"2024-09-15T22:50:22.305780+0000","last_peered":"2024-09-15T22:50:22.305780+0000","last_clean":"2024-09-15T22:50:22.305780+0000","last_became_active":"2024-09-15T22:50:21.388634+0000","last_became_peered":"2024-09-15T22:50:21.388634+0000","last_unstale":"2024-09-15T22:50:22.305780+0000","last_undegraded":"2024-09-15T22:50:22.305780+0000","last_fullsized":"2024-09-15T22:50:22.305780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.326409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486187+0000","last_change":"2024-09-15T22:50:17.077973+0000","last_active":"2024-09-15T22:50:22.486187+0000","last_peered":"2024-09-15T22:50:22.486187+0000","last_clean":"2024-09-15T22:50:22.486187+0000","last_became_active":"2024-09-15T22:50:17.077686+0000","last_became_peered":"2024-09-15T22:50:17.077686+0000","last_unstale":"2024-09-15T22:50:22.486187+0000","last_undegraded":"2024-09-15T22:50:22.486187+0000","last_fullsized":"2024-09-15T22:50:22.486187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:28.191364+0000","last_change":"2024-09-15T22:50:16.062195+0000","last_active":"2024-09-15T22:50:28.191364+0000","last_peered":"2024-09-15T22:50:28.191364+0000","last_clean":"2024-09-15T22:50:28.191364+0000","last_became_active":"2024-09-15T22:50:16.061907+0000","last_became_peered":"2024-09-15T22:50:16.061907+0000","last_unstale":"2024-09-15T22:50:28.191364+0000","last_undegraded":"2024-09-15T22:50:28.191364+0000","last_fullsized":"2024-09-15T22:50:28.191364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485394+0000","last_change":"2024-09-15T22:50:21.332064+0000","last_active":"2024-09-15T22:50:22.485394+0000","last_peered":"2024-09-15T22:50:22.485394+0000","last_clean":"2024-09-15T22:50:22.485394+0000","last_became_active":"2024-09-15T22:50:21.331679+0000","last_became_peered":"2024-09-15T22:50:21.331679+0000","last_unstale":"2024-09-15T22:50:22.485394+0000","last_undegraded":"2024-09-15T22:50:22.485394+0000","last_fullsized":"2024-09-15T22:50:22.485394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306155+0000","last_change":"2024-09-15T22:50:17.066523+0000","last_active":"2024-09-15T22:50:22.306155+0000","last_peered":"2024-09-15T22:50:22.306155+0000","last_clean":"2024-09-15T22:50:22.306155+0000","last_became_active":"2024-09-15T22:50:17.066271+0000","last_became_peered":"2024-09-15T22:50:17.066271+0000","last_unstale":"2024-09-15T22:50:22.306155+0000","last_undegraded":"2024-09-15T22:50:22.306155+0000","last_fullsized":"2024-09-15T22:50:22.306155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487798+0000","last_change":"2024-09-15T22:50:16.072533+0000","last_active":"2024-09-15T22:50:22.487798+0000","last_peered":"2024-09-15T22:50:22.487798+0000","last_clean":"2024-09-15T22:50:22.487798+0000","last_became_active":"2024-09-15T22:50:16.072230+0000","last_became_peered":"2024-09-15T22:50:16.072230+0000","last_unstale":"2024-09-15T22:50:22.487798+0000","last_undegraded":"2024-09-15T22:50:22.487798+0000","last_fullsized":"2024-09-15T22:50:22.487798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305802+0000","last_change":"2024-09-15T22:50:21.333434+0000","last_active":"2024-09-15T22:50:22.305802+0000","last_peered":"2024-09-15T22:50:22.305802+0000","last_clean":"2024-09-15T22:50:22.305802+0000","last_became_active":"2024-09-15T22:50:21.332505+0000","last_became_peered":"2024-09-15T22:50:21.332505+0000","last_unstale":"2024-09-15T22:50:22.305802+0000","last_undegraded":"2024-09-15T22:50:22.305802+0000","last_fullsized":"2024-09-15T22:50:22.305802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486491+0000","last_change":"2024-09-15T22:50:17.052446+0000","last_active":"2024-09-15T22:50:22.486491+0000","last_peered":"2024-09-15T22:50:22.486491+0000","last_clean":"2024-09-15T22:50:22.486491+0000","last_became_active":"2024-09-15T22:50:17.052187+0000","last_became_peered":"2024-09-15T22:50:17.052187+0000","last_unstale":"2024-09-15T22:50:22.486491+0000","last_undegraded":"2024-09-15T22:50:22.486491+0000","last_fullsized":"2024-09-15T22:50:22.486491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306067+0000","last_change":"2024-09-15T22:50:16.067884+0000","last_active":"2024-09-15T22:50:22.306067+0000","last_peered":"2024-09-15T22:50:22.306067+0000","last_clean":"2024-09-15T22:50:22.306067+0000","last_became_active":"2024-09-15T22:50:16.067613+0000","last_became_peered":"2024-09-15T22:50:16.067613+0000","last_unstale":"2024-09-15T22:50:22.306067+0000","last_undegraded":"2024-09-15T22:50:22.306067+0000","last_fullsized":"2024-09-15T22:50:22.306067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:02.473555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484670+0000","last_change":"2024-09-15T22:50:21.329190+0000","last_active":"2024-09-15T22:50:22.484670+0000","last_peered":"2024-09-15T22:50:22.484670+0000","last_clean":"2024-09-15T22:50:22.484670+0000","last_became_active":"2024-09-15T22:50:21.328672+0000","last_became_peered":"2024-09-15T22:50:21.328672+0000","last_unstale":"2024-09-15T22:50:22.484670+0000","last_undegraded":"2024-09-15T22:50:22.484670+0000","last_fullsized":"2024-09-15T22:50:22.484670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:10.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306101+0000","last_change":"2024-09-15T22:50:17.065691+0000","last_active":"2024-09-15T22:50:22.306101+0000","last_peered":"2024-09-15T22:50:22.306101+0000","last_clean":"2024-09-15T22:50:22.306101+0000","last_became_active":"2024-09-15T22:50:17.065428+0000","last_became_peered":"2024-09-15T22:50:17.065428+0000","last_unstale":"2024-09-15T22:50:22.306101+0000","last_undegraded":"2024-09-15T22:50:22.306101+0000","last_fullsized":"2024-09-15T22:50:22.306101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:42.029371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486901+0000","last_change":"2024-09-15T22:50:16.071238+0000","last_active":"2024-09-15T22:50:22.486901+0000","last_peered":"2024-09-15T22:50:22.486901+0000","last_clean":"2024-09-15T22:50:22.486901+0000","last_became_active":"2024-09-15T22:50:16.070890+0000","last_became_peered":"2024-09-15T22:50:16.070890+0000","last_unstale":"2024-09-15T22:50:22.486901+0000","last_undegraded":"2024-09-15T22:50:22.486901+0000","last_fullsized":"2024-09-15T22:50:22.486901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484106+0000","last_change":"2024-09-15T22:50:21.387626+0000","last_active":"2024-09-15T22:50:22.484106+0000","last_peered":"2024-09-15T22:50:22.484106+0000","last_clean":"2024-09-15T22:50:22.484106+0000","last_became_active":"2024-09-15T22:50:21.386716+0000","last_became_peered":"2024-09-15T22:50:21.386716+0000","last_unstale":"2024-09-15T22:50:22.484106+0000","last_undegraded":"2024-09-15T22:50:22.484106+0000","last_fullsized":"2024-09-15T22:50:22.484106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:12.968147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486614+0000","last_change":"2024-09-15T22:50:21.386695+0000","last_active":"2024-09-15T22:50:22.486614+0000","last_peered":"2024-09-15T22:50:22.486614+0000","last_clean":"2024-09-15T22:50:22.486614+0000","last_became_active":"2024-09-15T22:50:21.386288+0000","last_became_peered":"2024-09-15T22:50:21.386288+0000","last_unstale":"2024-09-15T22:50:22.486614+0000","last_undegraded":"2024-09-15T22:50:22.486614+0000","last_fullsized":"2024-09-15T22:50:22.486614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486042+0000","last_change":"2024-09-15T22:50:17.071310+0000","last_active":"2024-09-15T22:50:22.486042+0000","last_peered":"2024-09-15T22:50:22.486042+0000","last_clean":"2024-09-15T22:50:22.486042+0000","last_became_active":"2024-09-15T22:50:17.070951+0000","last_became_peered":"2024-09-15T22:50:17.070951+0000","last_unstale":"2024-09-15T22:50:22.486042+0000","last_undegraded":"2024-09-15T22:50:22.486042+0000","last_fullsized":"2024-09-15T22:50:22.486042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304617+0000","last_change":"2024-09-15T22:50:16.062316+0000","last_active":"2024-09-15T22:50:22.304617+0000","last_peered":"2024-09-15T22:50:22.304617+0000","last_clean":"2024-09-15T22:50:22.304617+0000","last_became_active":"2024-09-15T22:50:16.062018+0000","last_became_peered":"2024-09-15T22:50:16.062018+0000","last_unstale":"2024-09-15T22:50:22.304617+0000","last_undegraded":"2024-09-15T22:50:22.304617+0000","last_fullsized":"2024-09-15T22:50:22.304617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:18.421004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486740+0000","last_change":"2024-09-15T22:50:21.334779+0000","last_active":"2024-09-15T22:50:22.486740+0000","last_peered":"2024-09-15T22:50:22.486740+0000","last_clean":"2024-09-15T22:50:22.486740+0000","last_became_active":"2024-09-15T22:50:21.334375+0000","last_became_peered":"2024-09-15T22:50:21.334375+0000","last_unstale":"2024-09-15T22:50:22.486740+0000","last_undegraded":"2024-09-15T22:50:22.486740+0000","last_fullsized":"2024-09-15T22:50:22.486740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484755+0000","last_change":"2024-09-15T22:50:17.068912+0000","last_active":"2024-09-15T22:50:22.484755+0000","last_peered":"2024-09-15T22:50:22.484755+0000","last_clean":"2024-09-15T22:50:22.484755+0000","last_became_active":"2024-09-15T22:50:17.068633+0000","last_became_peered":"2024-09-15T22:50:17.068633+0000","last_unstale":"2024-09-15T22:50:22.484755+0000","last_undegraded":"2024-09-15T22:50:22.484755+0000","last_fullsized":"2024-09-15T22:50:22.484755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484365+0000","last_change":"2024-09-15T22:50:16.063180+0000","last_active":"2024-09-15T22:50:22.484365+0000","last_peered":"2024-09-15T22:50:22.484365+0000","last_clean":"2024-09-15T22:50:22.484365+0000","last_became_active":"2024-09-15T22:50:16.062573+0000","last_became_peered":"2024-09-15T22:50:16.062573+0000","last_unstale":"2024-09-15T22:50:22.484365+0000","last_undegraded":"2024-09-15T22:50:22.484365+0000","last_fullsized":"2024-09-15T22:50:22.484365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486218+0000","last_change":"2024-09-15T22:50:16.061455+0000","last_active":"2024-09-15T22:50:22.486218+0000","last_peered":"2024-09-15T22:50:22.486218+0000","last_clean":"2024-09-15T22:50:22.486218+0000","last_became_active":"2024-09-15T22:50:16.061101+0000","last_became_peered":"2024-09-15T22:50:16.061101+0000","last_unstale":"2024-09-15T22:50:22.486218+0000","last_undegraded":"2024-09-15T22:50:22.486218+0000","last_fullsized":"2024-09-15T22:50:22.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486076+0000","last_change":"2024-09-15T22:50:17.051703+0000","last_active":"2024-09-15T22:50:22.486076+0000","last_peered":"2024-09-15T22:50:22.486076+0000","last_clean":"2024-09-15T22:50:22.486076+0000","last_became_active":"2024-09-15T22:50:17.051442+0000","last_became_peered":"2024-09-15T22:50:17.051442+0000","last_unstale":"2024-09-15T22:50:22.486076+0000","last_undegraded":"2024-09-15T22:50:22.486076+0000","last_fullsized":"2024-09-15T22:50:22.486076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302396+0000","last_change":"2024-09-15T22:50:21.330393+0000","last_active":"2024-09-15T22:50:22.302396+0000","last_peered":"2024-09-15T22:50:22.302396+0000","last_clean":"2024-09-15T22:50:22.302396+0000","last_became_active":"2024-09-15T22:50:21.329923+0000","last_became_peered":"2024-09-15T22:50:21.329923+0000","last_unstale":"2024-09-15T22:50:22.302396+0000","last_undegraded":"2024-09-15T22:50:22.302396+0000","last_fullsized":"2024-09-15T22:50:22.302396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.927144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484326+0000","last_change":"2024-09-15T22:50:16.062501+0000","last_active":"2024-09-15T22:50:22.484326+0000","last_peered":"2024-09-15T22:50:22.484326+0000","last_clean":"2024-09-15T22:50:22.484326+0000","last_became_active":"2024-09-15T22:50:16.061957+0000","last_became_peered":"2024-09-15T22:50:16.061957+0000","last_unstale":"2024-09-15T22:50:22.484326+0000","last_undegraded":"2024-09-15T22:50:22.484326+0000","last_fullsized":"2024-09-15T22:50:22.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305592+0000","last_change":"2024-09-15T22:50:17.057565+0000","last_active":"2024-09-15T22:50:22.305592+0000","last_peered":"2024-09-15T22:50:22.305592+0000","last_clean":"2024-09-15T22:50:22.305592+0000","last_became_active":"2024-09-15T22:50:17.057276+0000","last_became_peered":"2024-09-15T22:50:17.057276+0000","last_unstale":"2024-09-15T22:50:22.305592+0000","last_undegraded":"2024-09-15T22:50:22.305592+0000","last_fullsized":"2024-09-15T22:50:22.305592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:03.054052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484704+0000","last_change":"2024-09-15T22:50:21.330952+0000","last_active":"2024-09-15T22:50:22.484704+0000","last_peered":"2024-09-15T22:50:22.484704+0000","last_clean":"2024-09-15T22:50:22.484704+0000","last_became_active":"2024-09-15T22:50:21.330543+0000","last_became_peered":"2024-09-15T22:50:21.330543+0000","last_unstale":"2024-09-15T22:50:22.484704+0000","last_undegraded":"2024-09-15T22:50:22.484704+0000","last_fullsized":"2024-09-15T22:50:22.484704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:57.065313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485812+0000","last_change":"2024-09-15T22:50:17.075360+0000","last_active":"2024-09-15T22:50:22.485812+0000","last_peered":"2024-09-15T22:50:22.485812+0000","last_clean":"2024-09-15T22:50:22.485812+0000","last_became_active":"2024-09-15T22:50:17.072943+0000","last_became_peered":"2024-09-15T22:50:17.072943+0000","last_unstale":"2024-09-15T22:50:22.485812+0000","last_undegraded":"2024-09-15T22:50:22.485812+0000","last_fullsized":"2024-09-15T22:50:22.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301837+0000","last_change":"2024-09-15T22:50:17.062719+0000","last_active":"2024-09-15T22:50:22.301837+0000","last_peered":"2024-09-15T22:50:22.301837+0000","last_clean":"2024-09-15T22:50:22.301837+0000","last_became_active":"2024-09-15T22:50:17.060683+0000","last_became_peered":"2024-09-15T22:50:17.060683+0000","last_unstale":"2024-09-15T22:50:22.301837+0000","last_undegraded":"2024-09-15T22:50:22.301837+0000","last_fullsized":"2024-09-15T22:50:22.301837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305406+0000","last_change":"2024-09-15T22:50:17.067025+0000","last_active":"2024-09-15T22:50:22.305406+0000","last_peered":"2024-09-15T22:50:22.305406+0000","last_clean":"2024-09-15T22:50:22.305406+0000","last_became_active":"2024-09-15T22:50:17.066744+0000","last_became_peered":"2024-09-15T22:50:17.066744+0000","last_unstale":"2024-09-15T22:50:22.305406+0000","last_undegraded":"2024-09-15T22:50:22.305406+0000","last_fullsized":"2024-09-15T22:50:22.305406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:50.397722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485996+0000","last_change":"2024-09-15T22:50:17.080748+0000","last_active":"2024-09-15T22:50:22.485996+0000","last_peered":"2024-09-15T22:50:22.485996+0000","last_clean":"2024-09-15T22:50:22.485996+0000","last_became_active":"2024-09-15T22:50:17.080432+0000","last_became_peered":"2024-09-15T22:50:17.080432+0000","last_unstale":"2024-09-15T22:50:22.485996+0000","last_undegraded":"2024-09-15T22:50:22.485996+0000","last_fullsized":"2024-09-15T22:50:22.485996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484735+0000","last_change":"2024-09-15T22:50:17.057480+0000","last_active":"2024-09-15T22:50:22.484735+0000","last_peered":"2024-09-15T22:50:22.484735+0000","last_clean":"2024-09-15T22:50:22.484735+0000","last_became_active":"2024-09-15T22:50:17.056801+0000","last_became_peered":"2024-09-15T22:50:17.056801+0000","last_unstale":"2024-09-15T22:50:22.484735+0000","last_undegraded":"2024-09-15T22:50:22.484735+0000","last_fullsized":"2024-09-15T22:50:22.484735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487677+0000","last_change":"2024-09-15T22:50:17.070941+0000","last_active":"2024-09-15T22:50:22.487677+0000","last_peered":"2024-09-15T22:50:22.487677+0000","last_clean":"2024-09-15T22:50:22.487677+0000","last_became_active":"2024-09-15T22:50:17.070675+0000","last_became_peered":"2024-09-15T22:50:17.070675+0000","last_unstale":"2024-09-15T22:50:22.487677+0000","last_undegraded":"2024-09-15T22:50:22.487677+0000","last_fullsized":"2024-09-15T22:50:22.487677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487164+0000","last_change":"2024-09-15T22:50:17.069743+0000","last_active":"2024-09-15T22:50:22.487164+0000","last_peered":"2024-09-15T22:50:22.487164+0000","last_clean":"2024-09-15T22:50:22.487164+0000","last_became_active":"2024-09-15T22:50:17.069457+0000","last_became_peered":"2024-09-15T22:50:17.069457+0000","last_unstale":"2024-09-15T22:50:22.487164+0000","last_undegraded":"2024-09-15T22:50:22.487164+0000","last_fullsized":"2024-09-15T22:50:22.487164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484640+0000","last_change":"2024-09-15T22:50:17.061920+0000","last_active":"2024-09-15T22:50:22.484640+0000","last_peered":"2024-09-15T22:50:22.484640+0000","last_clean":"2024-09-15T22:50:22.484640+0000","last_became_active":"2024-09-15T22:50:17.061519+0000","last_became_peered":"2024-09-15T22:50:17.061519+0000","last_unstale":"2024-09-15T22:50:22.484640+0000","last_undegraded":"2024-09-15T22:50:22.484640+0000","last_fullsized":"2024-09-15T22:50:22.484640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304510+0000","last_change":"2024-09-15T22:50:17.073525+0000","last_active":"2024-09-15T22:50:22.304510+0000","last_peered":"2024-09-15T22:50:22.304510+0000","last_clean":"2024-09-15T22:50:22.304510+0000","last_became_active":"2024-09-15T22:50:17.073252+0000","last_became_peered":"2024-09-15T22:50:17.073252+0000","last_unstale":"2024-09-15T22:50:22.304510+0000","last_undegraded":"2024-09-15T22:50:22.304510+0000","last_fullsized":"2024-09-15T22:50:22.304510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:26.300782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484201+0000","last_change":"2024-09-15T22:50:17.062213+0000","last_active":"2024-09-15T22:50:22.484201+0000","last_peered":"2024-09-15T22:50:22.484201+0000","last_clean":"2024-09-15T22:50:22.484201+0000","last_became_active":"2024-09-15T22:50:17.061935+0000","last_became_peered":"2024-09-15T22:50:17.061935+0000","last_unstale":"2024-09-15T22:50:22.484201+0000","last_undegraded":"2024-09-15T22:50:22.484201+0000","last_fullsized":"2024-09-15T22:50:22.484201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305356+0000","last_change":"2024-09-15T22:50:17.065311+0000","last_active":"2024-09-15T22:50:22.305356+0000","last_peered":"2024-09-15T22:50:22.305356+0000","last_clean":"2024-09-15T22:50:22.305356+0000","last_became_active":"2024-09-15T22:50:17.064941+0000","last_became_peered":"2024-09-15T22:50:17.064941+0000","last_unstale":"2024-09-15T22:50:22.305356+0000","last_undegraded":"2024-09-15T22:50:22.305356+0000","last_fullsized":"2024-09-15T22:50:22.305356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:10.798798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485778+0000","last_change":"2024-09-15T22:50:17.066892+0000","last_active":"2024-09-15T22:50:22.485778+0000","last_peered":"2024-09-15T22:50:22.485778+0000","last_clean":"2024-09-15T22:50:22.485778+0000","last_became_active":"2024-09-15T22:50:17.066604+0000","last_became_peered":"2024-09-15T22:50:17.066604+0000","last_unstale":"2024-09-15T22:50:22.485778+0000","last_undegraded":"2024-09-15T22:50:22.485778+0000","last_fullsized":"2024-09-15T22:50:22.485778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486617+0000","last_change":"2024-09-15T22:50:17.063913+0000","last_active":"2024-09-15T22:50:22.486617+0000","last_peered":"2024-09-15T22:50:22.486617+0000","last_clean":"2024-09-15T22:50:22.486617+0000","last_became_active":"2024-09-15T22:50:17.063640+0000","last_became_peered":"2024-09-15T22:50:17.063640+0000","last_unstale":"2024-09-15T22:50:22.486617+0000","last_undegraded":"2024-09-15T22:50:22.486617+0000","last_fullsized":"2024-09-15T22:50:22.486617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486943+0000","last_change":"2024-09-15T22:50:17.065821+0000","last_active":"2024-09-15T22:50:22.486943+0000","last_peered":"2024-09-15T22:50:22.486943+0000","last_clean":"2024-09-15T22:50:22.486943+0000","last_became_active":"2024-09-15T22:50:17.065504+0000","last_became_peered":"2024-09-15T22:50:17.065504+0000","last_unstale":"2024-09-15T22:50:22.486943+0000","last_undegraded":"2024-09-15T22:50:22.486943+0000","last_fullsized":"2024-09-15T22:50:22.486943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:48.700096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302260+0000","last_change":"2024-09-15T22:50:17.059784+0000","last_active":"2024-09-15T22:50:22.302260+0000","last_peered":"2024-09-15T22:50:22.302260+0000","last_clean":"2024-09-15T22:50:22.302260+0000","last_became_active":"2024-09-15T22:50:17.059381+0000","last_became_peered":"2024-09-15T22:50:17.059381+0000","last_unstale":"2024-09-15T22:50:22.302260+0000","last_undegraded":"2024-09-15T22:50:22.302260+0000","last_fullsized":"2024-09-15T22:50:22.302260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306503+0000","last_change":"2024-09-15T22:50:17.069837+0000","last_active":"2024-09-15T22:50:22.306503+0000","last_peered":"2024-09-15T22:50:22.306503+0000","last_clean":"2024-09-15T22:50:22.306503+0000","last_became_active":"2024-09-15T22:50:17.068275+0000","last_became_peered":"2024-09-15T22:50:17.068275+0000","last_unstale":"2024-09-15T22:50:22.306503+0000","last_undegraded":"2024-09-15T22:50:22.306503+0000","last_fullsized":"2024-09-15T22:50:22.306503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.202716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304393+0000","last_change":"2024-09-15T22:50:17.047980+0000","last_active":"2024-09-15T22:50:22.304393+0000","last_peered":"2024-09-15T22:50:22.304393+0000","last_clean":"2024-09-15T22:50:22.304393+0000","last_became_active":"2024-09-15T22:50:17.047534+0000","last_became_peered":"2024-09-15T22:50:17.047534+0000","last_unstale":"2024-09-15T22:50:22.304393+0000","last_undegraded":"2024-09-15T22:50:22.304393+0000","last_fullsized":"2024-09-15T22:50:22.304393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:25.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486065+0000","last_change":"2024-09-15T22:50:17.064022+0000","last_active":"2024-09-15T22:50:22.486065+0000","last_peered":"2024-09-15T22:50:22.486065+0000","last_clean":"2024-09-15T22:50:22.486065+0000","last_became_active":"2024-09-15T22:50:17.063674+0000","last_became_peered":"2024-09-15T22:50:17.063674+0000","last_unstale":"2024-09-15T22:50:22.486065+0000","last_undegraded":"2024-09-15T22:50:22.486065+0000","last_fullsized":"2024-09-15T22:50:22.486065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485117+0000","last_change":"2024-09-15T22:50:17.068410+0000","last_active":"2024-09-15T22:50:22.485117+0000","last_peered":"2024-09-15T22:50:22.485117+0000","last_clean":"2024-09-15T22:50:22.485117+0000","last_became_active":"2024-09-15T22:50:17.068107+0000","last_became_peered":"2024-09-15T22:50:17.068107+0000","last_unstale":"2024-09-15T22:50:22.485117+0000","last_undegraded":"2024-09-15T22:50:22.485117+0000","last_fullsized":"2024-09-15T22:50:22.485117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:30.669334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484956+0000","last_change":"2024-09-15T22:50:17.065023+0000","last_active":"2024-09-15T22:50:22.484956+0000","last_peered":"2024-09-15T22:50:22.484956+0000","last_clean":"2024-09-15T22:50:22.484956+0000","last_became_active":"2024-09-15T22:50:17.062070+0000","last_became_peered":"2024-09-15T22:50:17.062070+0000","last_unstale":"2024-09-15T22:50:22.484956+0000","last_undegraded":"2024-09-15T22:50:22.484956+0000","last_fullsized":"2024-09-15T22:50:22.484956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306061+0000","last_change":"2024-09-15T22:50:17.057591+0000","last_active":"2024-09-15T22:50:22.306061+0000","last_peered":"2024-09-15T22:50:22.306061+0000","last_clean":"2024-09-15T22:50:22.306061+0000","last_became_active":"2024-09-15T22:50:17.057197+0000","last_became_peered":"2024-09-15T22:50:17.057197+0000","last_unstale":"2024-09-15T22:50:22.306061+0000","last_undegraded":"2024-09-15T22:50:22.306061+0000","last_fullsized":"2024-09-15T22:50:22.306061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:44.340627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486588+0000","last_change":"2024-09-15T22:50:17.068923+0000","last_active":"2024-09-15T22:50:22.486588+0000","last_peered":"2024-09-15T22:50:22.486588+0000","last_clean":"2024-09-15T22:50:22.486588+0000","last_became_active":"2024-09-15T22:50:17.068660+0000","last_became_peered":"2024-09-15T22:50:17.068660+0000","last_unstale":"2024-09-15T22:50:22.486588+0000","last_undegraded":"2024-09-15T22:50:22.486588+0000","last_fullsized":"2024-09-15T22:50:22.486588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487061+0000","last_change":"2024-09-15T22:50:17.061612+0000","last_active":"2024-09-15T22:50:22.487061+0000","last_peered":"2024-09-15T22:50:22.487061+0000","last_clean":"2024-09-15T22:50:22.487061+0000","last_became_active":"2024-09-15T22:50:17.061326+0000","last_became_peered":"2024-09-15T22:50:17.061326+0000","last_unstale":"2024-09-15T22:50:22.487061+0000","last_undegraded":"2024-09-15T22:50:22.487061+0000","last_fullsized":"2024-09-15T22:50:22.487061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487332+0000","last_change":"2024-09-15T22:50:17.069598+0000","last_active":"2024-09-15T22:50:22.487332+0000","last_peered":"2024-09-15T22:50:22.487332+0000","last_clean":"2024-09-15T22:50:22.487332+0000","last_became_active":"2024-09-15T22:50:17.069306+0000","last_became_peered":"2024-09-15T22:50:17.069306+0000","last_unstale":"2024-09-15T22:50:22.487332+0000","last_undegraded":"2024-09-15T22:50:22.487332+0000","last_fullsized":"2024-09-15T22:50:22.487332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.715006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484518+0000","last_change":"2024-09-15T22:50:17.065548+0000","last_active":"2024-09-15T22:50:22.484518+0000","last_peered":"2024-09-15T22:50:22.484518+0000","last_clean":"2024-09-15T22:50:22.484518+0000","last_became_active":"2024-09-15T22:50:17.065190+0000","last_became_peered":"2024-09-15T22:50:17.065190+0000","last_unstale":"2024-09-15T22:50:22.484518+0000","last_undegraded":"2024-09-15T22:50:22.484518+0000","last_fullsized":"2024-09-15T22:50:22.484518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486349+0000","last_change":"2024-09-15T22:50:17.076002+0000","last_active":"2024-09-15T22:50:22.486349+0000","last_peered":"2024-09-15T22:50:22.486349+0000","last_clean":"2024-09-15T22:50:22.486349+0000","last_became_active":"2024-09-15T22:50:17.075622+0000","last_became_peered":"2024-09-15T22:50:17.075622+0000","last_unstale":"2024-09-15T22:50:22.486349+0000","last_undegraded":"2024-09-15T22:50:22.486349+0000","last_fullsized":"2024-09-15T22:50:22.486349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305301+0000","last_change":"2024-09-15T22:50:17.047855+0000","last_active":"2024-09-15T22:50:22.305301+0000","last_peered":"2024-09-15T22:50:22.305301+0000","last_clean":"2024-09-15T22:50:22.305301+0000","last_became_active":"2024-09-15T22:50:17.047575+0000","last_became_peered":"2024-09-15T22:50:17.047575+0000","last_unstale":"2024-09-15T22:50:22.305301+0000","last_undegraded":"2024-09-15T22:50:22.305301+0000","last_fullsized":"2024-09-15T22:50:22.305301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:54.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486484+0000","last_change":"2024-09-15T22:50:17.065385+0000","last_active":"2024-09-15T22:50:22.486484+0000","last_peered":"2024-09-15T22:50:22.486484+0000","last_clean":"2024-09-15T22:50:22.486484+0000","last_became_active":"2024-09-15T22:50:17.065082+0000","last_became_peered":"2024-09-15T22:50:17.065082+0000","last_unstale":"2024-09-15T22:50:22.486484+0000","last_undegraded":"2024-09-15T22:50:22.486484+0000","last_fullsized":"2024-09-15T22:50:22.486484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:39.831313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:17.069029+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:17.068353+0000","last_became_peered":"2024-09-15T22:50:17.068353+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:10.316118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486448+0000","last_change":"2024-09-15T22:50:17.066254+0000","last_active":"2024-09-15T22:50:22.486448+0000","last_peered":"2024-09-15T22:50:22.486448+0000","last_clean":"2024-09-15T22:50:22.486448+0000","last_became_active":"2024-09-15T22:50:17.065906+0000","last_became_peered":"2024-09-15T22:50:17.065906+0000","last_unstale":"2024-09-15T22:50:22.486448+0000","last_undegraded":"2024-09-15T22:50:22.486448+0000","last_fullsized":"2024-09-15T22:50:22.486448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488087+0000","last_change":"2024-09-15T22:50:17.075262+0000","last_active":"2024-09-15T22:50:22.488087+0000","last_peered":"2024-09-15T22:50:22.488087+0000","last_clean":"2024-09-15T22:50:22.488087+0000","last_became_active":"2024-09-15T22:50:17.074935+0000","last_became_peered":"2024-09-15T22:50:17.074935+0000","last_unstale":"2024-09-15T22:50:22.488087+0000","last_undegraded":"2024-09-15T22:50:22.488087+0000","last_fullsized":"2024-09-15T22:50:22.488087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487272+0000","last_change":"2024-09-15T22:50:17.065618+0000","last_active":"2024-09-15T22:50:22.487272+0000","last_peered":"2024-09-15T22:50:22.487272+0000","last_clean":"2024-09-15T22:50:22.487272+0000","last_became_active":"2024-09-15T22:50:17.065380+0000","last_became_peered":"2024-09-15T22:50:17.065380+0000","last_unstale":"2024-09-15T22:50:22.487272+0000","last_undegraded":"2024-09-15T22:50:22.487272+0000","last_fullsized":"2024-09-15T22:50:22.487272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:41.033194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":860160,"data_stored":694509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542151,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542151,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542153,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542151,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:50:39.873 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:50:39.874 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-15T22:50:39.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-15T22:50:39.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-15T22:50:39.874 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-15T22:50:40.058 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.053+0000 7f2003600640 1 Processor -- start 2024-09-15T22:50:40.059 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.053+0000 7f2003600640 1 -- start start 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1ffc0b4750 0x7f1ffc06c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1ffc06f0c0 con 0x7f1ffc15e590 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1ffc06f310 con 0x7f1ffc0b4750 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2003600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc06f5f0 con 0x7f1ffc0b42e0 2024-09-15T22:50:40.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39076/0 (socket says 172.21.15.31:39076) 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 -- 172.21.15.31:0/3461691601 learned_addr learned my addr 172.21.15.31:0/3461691601 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f1ffbe00640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2001600640 1 --2- 172.21.15.31:0/3461691601 >> v2:172.21.15.102:3300/0 conn(0x7f1ffc0b4750 0x7f1ffc06c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 -- 172.21.15.31:0/3461691601 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 msgr2=0x7f1ffc06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc06bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 -- 172.21.15.31:0/3461691601 >> v2:172.21.15.102:3300/0 conn(0x7f1ffc0b4750 msgr2=0x7f1ffc06c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 --2- 172.21.15.31:0/3461691601 >> v2:172.21.15.102:3300/0 conn(0x7f1ffc0b4750 0x7f1ffc06c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f2000c00640 1 -- 172.21.15.31:0/3461691601 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc06f8d0 con 0x7f1ffc15e590 2024-09-15T22:50:40.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.057+0000 7f1ffbe00640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:40.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2000c00640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0b4070 tx=0x7f1fec01c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d138ec651b6f6b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f1ffb400640 1 -- 172.21.15.31:0/3461691601 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0a5670 con 0x7f1ffc15e590 2024-09-15T22:50:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f1ffb400640 1 -- 172.21.15.31:0/3461691601 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fec0a5810 con 0x7f1ffc15e590 2024-09-15T22:50:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f1ffb400640 1 -- 172.21.15.31:0/3461691601 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fec0a5be0 con 0x7f1ffc15e590 2024-09-15T22:50:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- 172.21.15.31:0/3461691601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 msgr2=0x7f1ffc0ae2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc0b4070 tx=0x7f1fec01c960 comp rx=0 tx=0).stop 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- 172.21.15.31:0/3461691601 shutdown_connections 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- 172.21.15.31:0/3461691601 >> v2:172.21.15.102:3300/0 conn(0x7f1ffc0b4750 0x7f1ffc06c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- 172.21.15.31:0/3461691601 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc0ae2c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- 172.21.15.31:0/3461691601 >> 172.21.15.31:0/3461691601 conn(0x7f1ffc073560 msgr2=0x7f1ffc0b2fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- 172.21.15.31:0/3461691601 shutdown_connections 2024-09-15T22:50:40.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- 172.21.15.31:0/3461691601 wait complete. 2024-09-15T22:50:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 Processor -- start 2024-09-15T22:50:40.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- start start 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ffc0b4750 0x7f1ffc159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc070d40 con 0x7f1ffc15e590 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1ffc070bc0 con 0x7f1ffc0b4750 2024-09-15T22:50:40.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.061+0000 7f2003600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc070ec0 con 0x7f1ffc0b42e0 2024-09-15T22:50:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39086/0 (socket says 172.21.15.31:39086) 2024-09-15T22:50:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 -- 172.21.15.31:0/4799129 learned_addr learned my addr 172.21.15.31:0/4799129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:40.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2000c00640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f1ffbe00640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ffc0b4750 0x7f1ffc159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 -- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 msgr2=0x7f1ffc156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 -- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ffc0b4750 msgr2=0x7f1ffc159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ffc0b4750 0x7f1ffc159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 -- 172.21.15.31:0/4799129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc159b70 con 0x7f1ffc15e590 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2001600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e930 tx=0x7f1ff400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4017070 con 0x7f1ffc15e590 2024-09-15T22:50:40.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff400c9a0 con 0x7f1ffc15e590 2024-09-15T22:50:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400cd70 con 0x7f1ffc15e590 2024-09-15T22:50:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc159e50 con 0x7f1ffc15e590 2024-09-15T22:50:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc09be80 con 0x7f1ffc15e590 2024-09-15T22:50:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ffc0ae2c0 con 0x7f1ffc15e590 2024-09-15T22:50:40.071 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.065+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1ff401a070 con 0x7f1ffc15e590 2024-09-15T22:50:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.069+0000 7f1ff8c00640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 0x7f1fdc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.069+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1ff4086310 con 0x7f1ffc15e590 2024-09-15T22:50:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.069+0000 7f2000c00640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 0x7f1fdc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.069+0000 7f2000c00640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 0x7f1fdc069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0ae000 tx=0x7f1fec0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.073+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1ff4056560 con 0x7f1ffc15e590 2024-09-15T22:50:40.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.277+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1ffc0b34e0 con 0x7f1ffc15e590 2024-09-15T22:50:40.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.277+0000 7f1ff8c00640 1 -- 172.21.15.31:0/4799129 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+166891 (secure 0 0 0) 0x7f1ff405a860 con 0x7f1ffc15e590 2024-09-15T22:50:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 msgr2=0x7f1fdc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 0x7f1fdc069db0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1fec0ae000 tx=0x7f1fec0a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 msgr2=0x7f1ffc15f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400e930 tx=0x7f1ff400edf0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 shutdown_connections 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1fdc0678f0 0x7f1fdc069db0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1ffc15e590 0x7f1ffc15f680 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1ffc0b4750 0x7f1ffc159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 --2- 172.21.15.31:0/4799129 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1ffc0b42e0 0x7f1ffc156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 >> 172.21.15.31:0/4799129 conn(0x7f1ffc073560 msgr2=0x7f1ffc0b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 shutdown_connections 2024-09-15T22:50:40.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.281+0000 7f2003600640 1 -- 172.21.15.31:0/4799129 wait complete. 2024-09-15T22:50:40.306 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":5,"flags":0,"active_gid":4107,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6832","nonce":2404770539},{"type":"v1","addr":"172.21.15.102:6833","nonce":2404770539}]},"active_addr":"172.21.15.102:6833/2404770539","active_change":"2024-09-15T22:49:57.538905+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":90802231}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":454081437}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3564948217}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2457629636}]}]} 2024-09-15T22:50:40.312 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-15T22:50:40.312 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-15T22:50:40.312 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:40.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 Processor -- start 2024-09-15T22:50:40.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 -- start start 2024-09-15T22:50:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7940b47a0 0x7fa794072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa7940726a0 0x7fa79415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa794072ad0 con 0x7fa79406f270 2024-09-15T22:50:40.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa79415ba60 con 0x7fa7940b47a0 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79c600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa7940affa0 con 0x7fa7940726a0 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7940b47a0 0x7fa794072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa7940b47a0 0x7fa794072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39092/0 (socket says 172.21.15.31:39092) 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 -- 172.21.15.31:0/2589673150 learned_addr learned my addr 172.21.15.31:0/2589673150 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa79a600640 1 --2- 172.21.15.31:0/2589673150 >> v2:172.21.15.102:3300/0 conn(0x7fa7940726a0 0x7fa79415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 -- 172.21.15.31:0/2589673150 >> v2:172.21.15.102:3300/0 conn(0x7fa7940726a0 msgr2=0x7fa79415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 --2- 172.21.15.31:0/2589673150 >> v2:172.21.15.102:3300/0 conn(0x7fa7940726a0 0x7fa79415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 -- 172.21.15.31:0/2589673150 >> v1:172.21.15.102:6789/0 conn(0x7fa79406f270 legacy=0x7fa79406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.449+0000 7fa799200640 1 -- 172.21.15.31:0/2589673150 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa794072d40 con 0x7fa7940b47a0 2024-09-15T22:50:40.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa799200640 1 --2- 172.21.15.31:0/2589673150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7940b47a0 0x7fa794072160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7940735b0 tx=0x7fa78001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=276f1208bc563bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa793e00640 1 -- 172.21.15.31:0/2589673150 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800ab610 con 0x7fa7940b47a0 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa793e00640 1 -- 172.21.15.31:0/2589673150 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7800b0070 con 0x7fa7940b47a0 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa793e00640 1 -- 172.21.15.31:0/2589673150 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7800ab9d0 con 0x7fa7940b47a0 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 -- 172.21.15.31:0/2589673150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7940b47a0 msgr2=0x7fa794072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 --2- 172.21.15.31:0/2589673150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7940b47a0 0x7fa794072160 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa7940735b0 tx=0x7fa78001c520 comp rx=0 tx=0).stop 2024-09-15T22:50:40.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 -- 172.21.15.31:0/2589673150 shutdown_connections 2024-09-15T22:50:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 --2- 172.21.15.31:0/2589673150 >> v2:172.21.15.102:3300/0 conn(0x7fa7940726a0 0x7fa79415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 --2- 172.21.15.31:0/2589673150 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa7940b47a0 0x7fa794072160 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 -- 172.21.15.31:0/2589673150 >> 172.21.15.31:0/2589673150 conn(0x7fa794067e00 msgr2=0x7fa79406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 -- 172.21.15.31:0/2589673150 shutdown_connections 2024-09-15T22:50:40.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.453+0000 7fa79c600640 1 -- 172.21.15.31:0/2589673150 wait complete. 2024-09-15T22:50:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 Processor -- start 2024-09-15T22:50:40.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- start start 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 0x7fa794152ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 0x7fa7940b0120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa7940b4c30 con 0x7fa79406f270 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa794155a10 con 0x7fa7940b47a0 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa794153000 con 0x7fa7940726a0 2024-09-15T22:50:40.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39098/0 (socket says 172.21.15.31:39098) 2024-09-15T22:50:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 -- 172.21.15.31:0/4154224557 learned_addr learned my addr 172.21.15.31:0/4154224557 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799200640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 0x7fa794152ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79a600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 0x7fa7940b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 -- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 msgr2=0x7fa794152ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 0x7fa794152ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 -- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 msgr2=0x7fa7940b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 0x7fa7940b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 -- 172.21.15.31:0/4154224557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa794150b50 con 0x7fa79406f270 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799200640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 0x7fa794152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:40.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79a600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 0x7fa7940b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa799c00640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c450 tx=0x7fa78800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788016020 con 0x7fa79406f270 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa7880052d0 con 0x7fa79406f270 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa788007260 con 0x7fa79406f270 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa794150e30 con 0x7fa79406f270 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.457+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79414d7d0 con 0x7fa79406f270 2024-09-15T22:50:40.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79415d190 con 0x7fa79406f270 2024-09-15T22:50:40.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa788007400 con 0x7fa79406f270 2024-09-15T22:50:40.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa791600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa7880859b0 con 0x7fa79406f270 2024-09-15T22:50:40.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa799200640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.461+0000 7fa799200640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa7800af000 tx=0x7fa7800a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.465+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa788020020 con 0x7fa79406f270 2024-09-15T22:50:40.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.629+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa79415bfd0 con 0x7fa79406f270 2024-09-15T22:50:40.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa791600640 1 -- 172.21.15.31:0/4154224557 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fa788005480 con 0x7fa79406f270 2024-09-15T22:50:40.641 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:40.641 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 msgr2=0x7fa774069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa7800af000 tx=0x7fa7800a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 msgr2=0x7fa7940b2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa78800c450 tx=0x7fa78800c910 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 shutdown_connections 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa7740678c0 0x7fa774069d80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa7940b47a0 0x7fa7940b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa7940726a0 0x7fa794152ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 --2- 172.21.15.31:0/4154224557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa79406f270 0x7fa7940b2bb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 >> 172.21.15.31:0/4154224557 conn(0x7fa794067e00 msgr2=0x7fa7941531c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 shutdown_connections 2024-09-15T22:50:40.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.633+0000 7fa79c600640 1 -- 172.21.15.31:0/4154224557 wait complete. 2024-09-15T22:50:40.659 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-15T22:50:40.660 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:40.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.793+0000 7feb29400640 1 Processor -- start 2024-09-15T22:50:40.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.793+0000 7feb29400640 1 -- start start 2024-09-15T22:50:40.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb29400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 0x7feb2406ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb29400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb2406d210 0x7feb2406e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb29400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb2415e690 con 0x7feb2415e2b0 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb29400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feb240aeb10 con 0x7feb2406d210 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb29400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb240aedf0 con 0x7feb240af8d0 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb23e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feb2415e2b0 0x7feb240b5620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58440/0 (socket says 172.21.15.31:58440) 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb23e00640 1 -- 172.21.15.31:0/4248294957 learned_addr learned my addr 172.21.15.31:0/4248294957 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb28a00640 1 --2- 172.21.15.31:0/4248294957 >> v2:172.21.15.31:3300/0 conn(0x7feb2406d210 0x7feb2406e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb1b400640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 0x7feb2406ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb28a00640 1 -- 172.21.15.31:0/4248294957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 msgr2=0x7feb2406ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb28a00640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 0x7feb2406ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb28a00640 1 -- 172.21.15.31:0/4248294957 >> v1:172.21.15.31:6789/0 conn(0x7feb2415e2b0 legacy=0x7feb240b5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb28a00640 1 -- 172.21.15.31:0/4248294957 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb240af0d0 con 0x7feb2406d210 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb23400640 1 -- 172.21.15.31:0/4248294957 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110198405 0 0) 0x7feb2415e690 con 0x7feb2415e2b0 2024-09-15T22:50:40.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.797+0000 7feb1b400640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 0x7feb2406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb28a00640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb2406e840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097c0 tx=0x7feb1c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd03b6802979a3c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb23400640 1 -- 172.21.15.31:0/4248294957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0b0070 con 0x7feb2406d210 2024-09-15T22:50:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb23400640 1 -- 172.21.15.31:0/4248294957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1c0ab600 con 0x7feb2406d210 2024-09-15T22:50:40.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb23400640 1 -- 172.21.15.31:0/4248294957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1c0ab9d0 con 0x7feb2406d210 2024-09-15T22:50:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- 172.21.15.31:0/4248294957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 msgr2=0x7feb2406e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb2406e840 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7feb1c0097c0 tx=0x7feb1c01c3e0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- 172.21.15.31:0/4248294957 shutdown_connections 2024-09-15T22:50:40.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb2406e840 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 --2- 172.21.15.31:0/4248294957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb240af8d0 0x7feb2406ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- 172.21.15.31:0/4248294957 >> 172.21.15.31:0/4248294957 conn(0x7feb24072600 msgr2=0x7feb24072a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- 172.21.15.31:0/4248294957 shutdown_connections 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- 172.21.15.31:0/4248294957 wait complete. 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 Processor -- start 2024-09-15T22:50:40.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.801+0000 7feb29400640 1 -- start start 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb240af8d0 0x7feb24155010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 0x7feb241522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feb240b5d30 con 0x7feb2406d210 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb240afcb0 con 0x7feb240af8d0 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb2416afa0 con 0x7feb2415e2b0 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39118/0 (socket says 172.21.15.31:39118) 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 -- 172.21.15.31:0/1543347655 learned_addr learned my addr 172.21.15.31:0/1543347655 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb28a00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 0x7feb241522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb1b400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb240af8d0 0x7feb24155010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 -- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 msgr2=0x7feb241522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 0x7feb241522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 -- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb240af8d0 msgr2=0x7feb24155010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb240af8d0 0x7feb24155010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 -- 172.21.15.31:0/1543347655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb241536c0 con 0x7feb2406d210 2024-09-15T22:50:40.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb28a00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 0x7feb241522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb23e00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb1400c7c0 tx=0x7feb1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb14018070 con 0x7feb2406d210 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb1400a640 con 0x7feb2406d210 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb1400aa30 con 0x7feb2406d210 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb241539a0 con 0x7feb2406d210 2024-09-15T22:50:40.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb24153f60 con 0x7feb2406d210 2024-09-15T22:50:40.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb2415e8b0 con 0x7feb2406d210 2024-09-15T22:50:40.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.805+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb1400abd0 con 0x7feb2406d210 2024-09-15T22:50:40.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.809+0000 7feb20c00640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 0x7feb00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:40.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.809+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb14085590 con 0x7feb2406d210 2024-09-15T22:50:40.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.809+0000 7feb1b400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 0x7feb00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:40.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.809+0000 7feb1b400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 0x7feb00069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb24159f60 tx=0x7feb0c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:40.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.813+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb14055d90 con 0x7feb2406d210 2024-09-15T22:50:40.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb240b5730 con 0x7feb2406d210 2024-09-15T22:50:40.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb20c00640 1 -- 172.21.15.31:0/1543347655 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7feb14055690 con 0x7feb2406d210 2024-09-15T22:50:40.986 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:40.986 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 msgr2=0x7feb00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 0x7feb00069d80 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb24159f60 tx=0x7feb0c008040 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 msgr2=0x7feb24152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7feb1400c7c0 tx=0x7feb1400cc80 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 shutdown_connections 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb000678c0 0x7feb00069d80 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb2415e2b0 0x7feb241522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb240af8d0 0x7feb24155010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 --2- 172.21.15.31:0/1543347655 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb2406d210 0x7feb24152e70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 >> 172.21.15.31:0/1543347655 conn(0x7feb24072600 msgr2=0x7feb240703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:40.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 shutdown_connections 2024-09-15T22:50:40.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:40.981+0000 7feb29400640 1 -- 172.21.15.31:0/1543347655 wait complete. 2024-09-15T22:50:41.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-15T22:50:41.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-15T22:50:41.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-15T22:50:41.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-15T22:50:41.009 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-15T22:50:41.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-15T22:50:41.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-15T22:50:41.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-15T22:50:41.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 Processor -- start 2024-09-15T22:50:41.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 -- start start 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1b800ced0 0x7fc1b8038c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc1b8008b30 0x7fc1b8008fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1b8055ef0 con 0x7fc1b80e2a70 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b8039190 con 0x7fc1b8008b30 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c4800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc1b80e7660 con 0x7fc1b800ced0 2024-09-15T22:50:41.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c1400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1b800ced0 0x7fc1b8038c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c1400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc1b800ced0 0x7fc1b8038c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57038/0 (socket says 172.21.15.31:57038) 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.249+0000 7fc1c1400640 1 -- 172.21.15.31:0/1733581574 learned_addr learned my addr 172.21.15.31:0/1733581574 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.253+0000 7fc1c1400640 1 -- 172.21.15.31:0/1733581574 >> v2:172.21.15.31:3300/0 conn(0x7fc1b8008b30 msgr2=0x7fc1b8008fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.253+0000 7fc1c1400640 1 --2- 172.21.15.31:0/1733581574 >> v2:172.21.15.31:3300/0 conn(0x7fc1b8008b30 0x7fc1b8008fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.253+0000 7fc1c1400640 1 -- 172.21.15.31:0/1733581574 >> v1:172.21.15.102:6789/0 conn(0x7fc1b80e2a70 legacy=0x7fc1b800c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.253+0000 7fc1c1400640 1 -- 172.21.15.31:0/1733581574 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b80e6770 con 0x7fc1b800ced0 2024-09-15T22:50:41.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c1400640 1 --2- 172.21.15.31:0/1733581574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b800ced0 0x7fc1b8038c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b803c850 tx=0x7fc1ac01c4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9d5ae2aafe7b90 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c0a00640 1 -- 172.21.15.31:0/1733581574 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0aa610 con 0x7fc1b800ced0 2024-09-15T22:50:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c0a00640 1 -- 172.21.15.31:0/1733581574 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1ac0af070 con 0x7fc1b800ced0 2024-09-15T22:50:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c0a00640 1 -- 172.21.15.31:0/1733581574 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1ac0aa9d0 con 0x7fc1b800ced0 2024-09-15T22:50:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 -- 172.21.15.31:0/1733581574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b800ced0 msgr2=0x7fc1b8038c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 --2- 172.21.15.31:0/1733581574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b800ced0 0x7fc1b8038c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc1b803c850 tx=0x7fc1ac01c4b0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 -- 172.21.15.31:0/1733581574 shutdown_connections 2024-09-15T22:50:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 --2- 172.21.15.31:0/1733581574 >> v2:172.21.15.31:3300/0 conn(0x7fc1b8008b30 0x7fc1b8008fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 --2- 172.21.15.31:0/1733581574 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b800ced0 0x7fc1b8038c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7fc1c4800640 1 -- 172.21.15.31:0/1733581574 >> 172.21.15.31:0/1733581574 conn(0x7fc1b80567c0 msgr2=0x7fc1b8056bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.257+0000 7f4677e00640 1 Processor -- start 2024-09-15T22:50:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4677e00640 1 -- start start 2024-09-15T22:50:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fc1c4800640 1 -- 172.21.15.31:0/1733581574 shutdown_connections 2024-09-15T22:50:41.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 Processor -- start 2024-09-15T22:50:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fc1c4800640 1 -- 172.21.15.31:0/1733581574 wait complete. 2024-09-15T22:50:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 -- start start 2024-09-15T22:50:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7ff260a00640 1 Processor -- start 2024-09-15T22:50:41.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7ff260a00640 1 -- start start 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4677e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f46700cf560 0x7f46700cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4677e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700cef30 con 0x7f467015e5e0 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4677e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46700cf210 con 0x7f46700b6990 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4677e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f46700d2e90 con 0x7f46700cf560 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f492c15e600 0x7f492c0cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c0d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.267 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f492c15e9e0 con 0x7f492c0cf9e0 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f492c0ceee0 con 0x7f492c15e600 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f4931e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f492c0b5fc0 con 0x7f492c0d1500 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f492aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f492c15e600 0x7f492c0cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f492aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f492c15e600 0x7f492c0cf4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57044/0 (socket says 172.21.15.31:57044) 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f492aa00640 1 -- 172.21.15.31:0/3068164055 learned_addr learned my addr 172.21.15.31:0/3068164055 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7f492b400640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c0d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fd15be00640 1 Processor -- start 2024-09-15T22:50:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fc1c4800640 1 Processor -- start 2024-09-15T22:50:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fc1c4800640 1 -- start start 2024-09-15T22:50:41.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.261+0000 7fd15be00640 1 -- start start 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4674a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f46700b6990 0x7f467006cef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52536/0 (socket says 172.21.15.31:52536) 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4674a00640 1 -- 172.21.15.31:0/3730521313 learned_addr learned my addr 172.21.15.31:0/3730521313 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff260a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff25c0aee60 0x7ff25c0b2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff260a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff25c073b00 0x7ff25c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25aa00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff25c0734b0 0x7ff25c072290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52546/0 (socket says 172.21.15.31:52546) 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff260a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c06e980 con 0x7ff25c0734b0 2024-09-15T22:50:41.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff260a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c15e6e0 con 0x7ff25c0aee60 2024-09-15T22:50:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff260a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff25c06e730 con 0x7ff25c073b00 2024-09-15T22:50:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25aa00640 1 -- 172.21.15.31:0/2894701023 learned_addr learned my addr 172.21.15.31:0/2894701023 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25be00640 1 --2- 172.21.15.31:0/2894701023 >> v2:172.21.15.102:3300/0 conn(0x7ff25c073b00 0x7ff25c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1056922495 0 0) 0x7f46700cf210 con 0x7f46700b6990 2024-09-15T22:50:41.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4658003530 con 0x7f46700b6990 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25b400640 1 --2- 172.21.15.31:0/2894701023 >> v2:172.21.15.31:3300/0 conn(0x7ff25c0aee60 0x7ff25c0b2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25be00640 1 -- 172.21.15.31:0/2894701023 >> v2:172.21.15.31:3300/0 conn(0x7ff25c0aee60 msgr2=0x7ff25c0b2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25be00640 1 --2- 172.21.15.31:0/2894701023 >> v2:172.21.15.31:3300/0 conn(0x7ff25c0aee60 0x7ff25c0b2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25be00640 1 -- 172.21.15.31:0/2894701023 >> v1:172.21.15.102:6789/0 conn(0x7ff25c0734b0 legacy=0x7ff25c072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25be00640 1 -- 172.21.15.31:0/2894701023 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c06ec60 con 0x7ff25c073b00 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7ff25a000640 1 -- 172.21.15.31:0/2894701023 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648279581 0 0) 0x7ff25c06e980 con 0x7ff25c0734b0 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v1:172.21.15.102:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1148543959 0 0) 0x7f4658003530 con 0x7f46700b6990 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 >> v2:172.21.15.31:3300/0 conn(0x7f46700cf560 msgr2=0x7f46700cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 --2- 172.21.15.31:0/3730521313 >> v2:172.21.15.31:3300/0 conn(0x7f46700cf560 0x7f46700cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 >> v1:172.21.15.31:6789/0 conn(0x7f467015e5e0 legacy=0x7f46700d3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 0x7fc1b8188350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1b800ced0 0x7fc1b80e5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 --> v1:172.21.15.102:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46700d2b20 con 0x7f46700b6990 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v1:172.21.15.102:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f465c001680 con 0x7f46700b6990 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 >> v1:172.21.15.102:6789/0 conn(0x7f46700b6990 legacy=0x7f467006cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 0x7f4658003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15be00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd15c0af710 0x7fd15c06e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 0x7fc1b8188350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c1e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 0x7fc1b8188350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57060/0 (socket says 172.21.15.31:57060) 2024-09-15T22:50:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c1e00640 1 -- 172.21.15.31:0/992103728 learned_addr learned my addr 172.21.15.31:0/992103728 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1b80e2a70 0x7fc1b80db170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4658004810 0x7f4658004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46580053d0 0x7f465800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f465800c210 con 0x7f4658004810 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f465800c3c0 con 0x7f4658003a10 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f465800c5c0 con 0x7f46580053d0 2024-09-15T22:50:41.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15be00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15c06eeb0 con 0x7fd15c15e550 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15be00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd15c06f190 con 0x7fd15c0b3a60 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15be00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd15c06ec70 con 0x7fd15c0af710 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15a000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fd15c0b3a60 0x7fd15c15de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52558/0 (socket says 172.21.15.31:52558) 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15a000640 1 -- 172.21.15.31:0/3114077889 learned_addr learned my addr 172.21.15.31:0/3114077889 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c1400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1b800ced0 0x7fc1b80e5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b8007760 con 0x7fc1b80e2a70 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1b80e72f0 con 0x7fc1b8008b30 2024-09-15T22:50:41.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc1b800c110 con 0x7fc1b800ced0 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4675400640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 0x7f4658003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4674a00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4658004810 0x7f4658004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4675e00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46580053d0 0x7f465800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f4675400640 1 -- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46580053d0 msgr2=0x7f465800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f492aa00640 1 -- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 msgr2=0x7f492c0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f492aa00640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c0d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f492aa00640 1 -- 172.21.15.31:0/3068164055 >> v1:172.21.15.31:6789/0 conn(0x7f492c0cf9e0 legacy=0x7f492c0d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f492aa00640 1 -- 172.21.15.31:0/3068164055 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c0b6210 con 0x7f492c15e600 2024-09-15T22:50:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7fd15aa00640 1 --2- 172.21.15.31:0/3114077889 >> v2:172.21.15.102:3300/0 conn(0x7fd15c0af710 0x7fd15c06e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7f4675400640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f46580053d0 0x7f465800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.265+0000 7f492b400640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c0d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7f4675400640 1 -- 172.21.15.31:0/3730521313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4658004810 msgr2=0x7f4658004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7f4675400640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4658004810 0x7f4658004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7f4675400640 1 -- 172.21.15.31:0/3730521313 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4658003530 con 0x7f4658003a10 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7f4675e00640 1 -- 172.21.15.31:0/3730521313 reap_dead start 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fd159600640 1 -- 172.21.15.31:0/3114077889 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3373552584 0 0) 0x7fd15c06f190 con 0x7fd15c0b3a60 2024-09-15T22:50:41.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 -- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1b800ced0 msgr2=0x7fc1b80e5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1b800ced0 0x7fc1b80e5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 -- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1b80e2a70 msgr2=0x7fc1b80db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc1b80e2a70 0x7fc1b80db170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1b8037820 con 0x7fc1b8008b30 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fd159600640 1 -- 172.21.15.31:0/3114077889 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd140003530 con 0x7fd15c0b3a60 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fd15aa00640 1 -- 172.21.15.31:0/3114077889 >> v1:172.21.15.102:6789/0 conn(0x7fd15c0b3a60 legacy=0x7fd15c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fd15aa00640 1 -- 172.21.15.31:0/3114077889 >> v1:172.21.15.31:6789/0 conn(0x7fd15c15e550 legacy=0x7fd15c1541f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fd15aa00640 1 -- 172.21.15.31:0/3114077889 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c06f470 con 0x7fd15c0af710 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc1b800ced0 0x7fc1b80e5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c1e00640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 0x7fc1b8188350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c490 tx=0x7fc1b000c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0017070 con 0x7fc1b8008b30 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1b0003600 con 0x7fc1b8008b30 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1b0003a30 con 0x7fc1b8008b30 2024-09-15T22:50:41.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1b8037b00 con 0x7fc1b8008b30 2024-09-15T22:50:41.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff25be00640 1 --2- 172.21.15.31:0/2894701023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c0b3490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0cc8e0 tx=0x7ff24c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1cf04c9554d4253 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f492aa00640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c15e600 0x7f492c0cf4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f492c08e140 tx=0x7f491c01c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc5ce77e9d54082e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15aa00640 1 --2- 172.21.15.31:0/3114077889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c06e730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097c0 tx=0x7fd14c01d600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f14a096ca23d0880 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 Processor -- start 2024-09-15T22:50:41.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4929600640 1 -- 172.21.15.31:0/3068164055 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0aa5f0 con 0x7f492c15e600 2024-09-15T22:50:41.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd159600640 1 -- 172.21.15.31:0/3114077889 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0a9650 con 0x7fd15c0af710 2024-09-15T22:50:41.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd159600640 1 -- 172.21.15.31:0/3114077889 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd14c0a97f0 con 0x7fd15c0af710 2024-09-15T22:50:41.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd159600640 1 -- 172.21.15.31:0/3114077889 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14c0a9bc0 con 0x7fd15c0af710 2024-09-15T22:50:41.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4929600640 1 -- 172.21.15.31:0/3068164055 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f491c0af070 con 0x7f492c15e600 2024-09-15T22:50:41.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4929600640 1 -- 172.21.15.31:0/3068164055 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f491c0aa9b0 con 0x7f492c15e600 2024-09-15T22:50:41.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 -- start start 2024-09-15T22:50:41.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.269+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1b80d68e0 con 0x7fc1b8008b30 2024-09-15T22:50:41.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1b0003bd0 con 0x7fc1b8008b30 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc1b8038c50 con 0x7fc1b8008b30 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1a00678c0 0x7fc1a0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 -- 172.21.15.31:0/3114077889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 msgr2=0x7fd15c06e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 --2- 172.21.15.31:0/3114077889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c06e730 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0097c0 tx=0x7fd14c01d600 comp rx=0 tx=0).stop 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 -- 172.21.15.31:0/3114077889 shutdown_connections 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 --2- 172.21.15.31:0/3114077889 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c06e730 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 -- 172.21.15.31:0/3114077889 >> 172.21.15.31:0/3114077889 conn(0x7fd15c06be90 msgr2=0x7fd15c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc1b0085050 con 0x7fc1b8008b30 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7fc1a0070fc0 0x7fc1a0073400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff25a000640 1 -- 172.21.15.31:0/2894701023 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0b0070 con 0x7ff25c073b00 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff25a000640 1 -- 172.21.15.31:0/2894701023 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff24c0ab600 con 0x7ff25c073b00 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff25a000640 1 -- 172.21.15.31:0/2894701023 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff24c0ab9d0 con 0x7ff25c073b00 2024-09-15T22:50:41.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1c1400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1a00678c0 0x7fc1a0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 -- 172.21.15.31:0/3114077889 shutdown_connections 2024-09-15T22:50:41.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fd15be00640 1 -- 172.21.15.31:0/3114077889 wait complete. 2024-09-15T22:50:41.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc1a0073ad0 con 0x7fc1a0070fc0 2024-09-15T22:50:41.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1c2800640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7fc1a0070fc0 0x7fc1a0073400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc1b008a060 con 0x7fc1b8008b30 2024-09-15T22:50:41.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 -- 172.21.15.31:0/2894701023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 msgr2=0x7ff25c0b3490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 --2- 172.21.15.31:0/2894701023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c0b3490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ff25c0cc8e0 tx=0x7ff24c01c4a0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe0c162b60 0x7efe0c0b16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c0b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 -- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c15e600 msgr2=0x7f492c0cf4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c15e600 0x7f492c0cf4a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f492c08e140 tx=0x7f491c01c4d0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 -- 172.21.15.31:0/2894701023 shutdown_connections 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe0c0b6180 con 0x7efe0c0b25d0 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efe0c0af160 con 0x7efe0c162b60 2024-09-15T22:50:41.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe11c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c0b6460 con 0x7efe0c09aa40 2024-09-15T22:50:41.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4675400640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 0x7f4658003e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4664001760 tx=0x7f466401c3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e918f876a86036fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 --2- 172.21.15.31:0/2894701023 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c0b3490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 --2- 172.21.15.31:0/2894701023 >> v2:172.21.15.31:3300/0 conn(0x7ff25c0aee60 0x7ff25c0b2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7ff260a00640 1 -- 172.21.15.31:0/2894701023 >> 172.21.15.31:0/2894701023 conn(0x7ff25c06be90 msgr2=0x7ff25c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 -- 172.21.15.31:0/3068164055 shutdown_connections 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c0d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 --2- 172.21.15.31:0/3068164055 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c15e600 0x7f492c0cf4a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe0a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c0b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe0aa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe0c162b60 0x7efe0c0b16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe0a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c0b2090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53750/0 (socket says 172.21.15.31:53750) 2024-09-15T22:50:41.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7efe0a000640 1 -- 172.21.15.31:0/3171738788 learned_addr learned my addr 172.21.15.31:0/3171738788 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f4931e00640 1 -- 172.21.15.31:0/3068164055 >> 172.21.15.31:0/3068164055 conn(0x7f492c09d860 msgr2=0x7f492c08bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4931e00640 1 -- 172.21.15.31:0/3068164055 shutdown_connections 2024-09-15T22:50:41.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7ff260a00640 1 -- 172.21.15.31:0/2894701023 shutdown_connections 2024-09-15T22:50:41.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664001380 con 0x7f4658003a10 2024-09-15T22:50:41.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46640052f0 con 0x7f4658003a10 2024-09-15T22:50:41.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.273+0000 7f466fe00640 1 -- 172.21.15.31:0/3730521313 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664003840 con 0x7f4658003a10 2024-09-15T22:50:41.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fc1c1400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1a00678c0 0x7fc1a0069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0ae000 tx=0x7fc1ac0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4931e00640 1 -- 172.21.15.31:0/3068164055 wait complete. 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7efe0aa00640 1 -- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 msgr2=0x7efe0c0b2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7efe0aa00640 1 --2- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c0b2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7efe0aa00640 1 -- 172.21.15.31:0/3171738788 >> v1:172.21.15.31:6789/0 conn(0x7efe0c0b25d0 legacy=0x7efe0c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7efe0aa00640 1 -- 172.21.15.31:0/3171738788 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c0b42f0 con 0x7efe0c162b60 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7ff260a00640 1 -- 172.21.15.31:0/2894701023 wait complete. 2024-09-15T22:50:41.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fc1c2800640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7fc1a0070fc0 0x7fc1a0073400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4677e00640 1 -- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 msgr2=0x7f4658003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4677e00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 0x7f4658003e30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4664001760 tx=0x7f466401c3b0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4931e00640 1 Processor -- start 2024-09-15T22:50:41.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 Processor -- start 2024-09-15T22:50:41.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 -- start start 2024-09-15T22:50:41.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7ff260a00640 1 Processor -- start 2024-09-15T22:50:41.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c1f7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7f4931e00640 1 -- start start 2024-09-15T22:50:41.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 0x7fd15c143790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd15c15e550 0x7fd15c153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15be00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c1683e0 con 0x7fd15c0b3a60 2024-09-15T22:50:41.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7ff260a00640 1 -- start start 2024-09-15T22:50:41.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== osd.0 v2:172.21.15.31:6801/1549484768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc1a0073ad0 con 0x7fc1a0070fc0 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 0x7fd15c143790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 0x7fd15c143790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39166/0 (socket says 172.21.15.31:39166) 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15a000640 1 -- 172.21.15.31:0/315815982 learned_addr learned my addr 172.21.15.31:0/315815982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15aa00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c1f7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.277+0000 7fd15b400640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd15c15e550 0x7fd15c153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 -- 172.21.15.31:0/3730521313 shutdown_connections 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 --2- 172.21.15.31:0/3730521313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4658003a10 0x7f4658003e30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 -- 172.21.15.31:0/3730521313 >> 172.21.15.31:0/3730521313 conn(0x7f46700d4500 msgr2=0x7f46700d4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd15c154d10 con 0x7fd15c0af710 2024-09-15T22:50:41.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd15c168560 con 0x7fd15c15e550 2024-09-15T22:50:41.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c76000640 1 Processor -- start 2024-09-15T22:50:41.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 -- 172.21.15.31:0/3730521313 shutdown_connections 2024-09-15T22:50:41.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 -- 172.21.15.31:0/3730521313 wait complete. 2024-09-15T22:50:41.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c0cf9e0 0x7f492c152c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c154570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 0x7f492c0c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 -- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd15c15e550 msgr2=0x7fd15c153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd15c15e550 0x7fd15c153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 -- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 msgr2=0x7fd15c1f7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd15c0af710 0x7fd15c1f7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd15c0cdd80 con 0x7fd15c0b3a60 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c76000640 1 -- start start 2024-09-15T22:50:41.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 0x7f492c0c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 0x7f492c0c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39168/0 (socket says 172.21.15.31:39168) 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f492c0d3390 con 0x7f492c15e600 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f492c0b6d90 con 0x7f492c0cf9e0 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 -- 172.21.15.31:0/602695744 learned_addr learned my addr 172.21.15.31:0/602695744 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f492c0d3510 con 0x7f492c0d1500 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492a000640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c154570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7efe0aa00640 1 --2- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c162b60 0x7efe0c0b16f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe04009d90 tx=0x7efe0401c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86c1a3fb8ae56ef8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7efe09600640 1 -- 172.21.15.31:0/3171738788 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040b2070 con 0x7efe0c162b60 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7efe09600640 1 -- 172.21.15.31:0/3171738788 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040a5860 con 0x7efe0c162b60 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7efe09600640 1 -- 172.21.15.31:0/3171738788 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040a5c30 con 0x7efe0c162b60 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c76000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c76000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 0x7f1c7015e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 -- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 msgr2=0x7f492c154570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f492c0d1500 0x7f492c154570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 -- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c0cf9e0 msgr2=0x7f492c152c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f492c0cf9e0 0x7f492c152c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f492c0cac40 con 0x7f492c15e600 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 Processor -- start 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c6f400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 0x7f1c7015e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c6f400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 0x7f1c7015e680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57124/0 (socket says 172.21.15.31:57124) 2024-09-15T22:50:41.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53776/0 (socket says 172.21.15.31:53776) 2024-09-15T22:50:41.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f1c6fe00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f1c7015ebc0 0x7f1c7015a300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52562/0 (socket says 172.21.15.31:52562) 2024-09-15T22:50:41.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7fd15a000640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 0x7fd15c143790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd148001470 tx=0x7fd148001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f4677e00640 1 -- start start 2024-09-15T22:50:41.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c6f400640 1 -- 172.21.15.31:0/2280965670 learned_addr learned my addr 172.21.15.31:0/2280965670 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.281+0000 7f492b400640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 0x7f492c0c8a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4924007e30 tx=0x7f492400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c0734b0 0x7ff25c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd148007070 con 0x7fd15c0b3a60 2024-09-15T22:50:41.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c162b60 msgr2=0x7efe0c0b16f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd148015020 con 0x7fd15c0b3a60 2024-09-15T22:50:41.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd14800b8b0 con 0x7fd15c0b3a60 2024-09-15T22:50:41.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 --2- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c162b60 0x7efe0c0b16f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efe04009d90 tx=0x7efe0401c8a0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c09c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff25c0aee60 0x7ff25c1512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c16afd0 con 0x7ff25c0734b0 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff25c16ae50 con 0x7ff25c073b00 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff260a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff25c16b150 con 0x7ff25c0aee60 2024-09-15T22:50:41.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- 172.21.15.31:0/3171738788 shutdown_connections 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 --2- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c0b2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 --2- 172.21.15.31:0/3171738788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c162b60 0x7efe0c0b16f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- 172.21.15.31:0/3171738788 >> 172.21.15.31:0/3171738788 conn(0x7efe0c073540 msgr2=0x7efe0c0b2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- 172.21.15.31:0/3171738788 shutdown_connections 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd15c0ce060 con 0x7fd15c0b3a60 2024-09-15T22:50:41.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd15c0ce620 con 0x7fd15c0b3a60 2024-09-15T22:50:41.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c700b59e0 con 0x7f1c7015ebc0 2024-09-15T22:50:41.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- 172.21.15.31:0/3171738788 wait complete. 2024-09-15T22:50:41.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1c700d0680 con 0x7f1c70067a00 2024-09-15T22:50:41.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c700b6c90 con 0x7f1c700b5600 2024-09-15T22:50:41.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c09c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c09c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57130/0 (socket says 172.21.15.31:57130) 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 -- 172.21.15.31:0/2404722137 learned_addr learned my addr 172.21.15.31:0/2404722137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25be00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff25c0aee60 0x7ff25c1512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c6ea00640 1 -- 172.21.15.31:0/2280965670 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 498910202 0 0) 0x7f1c700b59e0 con 0x7f1c7015ebc0 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c6ea00640 1 -- 172.21.15.31:0/2280965670 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c50003530 con 0x7f1c7015ebc0 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4677e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 0x7f46700cc130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4677e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 0x7f46700c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4677e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46700c9f60 0x7f4670162190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924003ba0 con 0x7f492c15e600 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 -- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff25c0aee60 msgr2=0x7ff25c1512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff25c0aee60 0x7ff25c1512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 -- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c0734b0 msgr2=0x7ff25c15c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff25c0734b0 0x7ff25c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c09cd30 con 0x7ff25c073b00 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4924003d40 con 0x7f492c15e600 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c67e00640 1 -- 172.21.15.31:0/2280965670 >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 msgr2=0x7f1c7015e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c67e00640 1 --2- 172.21.15.31:0/2280965670 >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 0x7f1c7015e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c67e00640 1 -- 172.21.15.31:0/2280965670 >> v1:172.21.15.102:6789/0 conn(0x7f1c7015ebc0 legacy=0x7f1c7015a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f1c67e00640 1 -- 172.21.15.31:0/2280965670 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c70161610 con 0x7f1c700b5600 2024-09-15T22:50:41.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f492c15dc90 con 0x7f492c15e600 2024-09-15T22:50:41.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff25aa00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c09c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff25400c8c0 tx=0x7ff25400cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4675400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 0x7f46700cc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4675400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 0x7f46700cc130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53802/0 (socket says 172.21.15.31:53802) 2024-09-15T22:50:41.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd15c0cea20 con 0x7fd15c0b3a60 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff254018070 con 0x7ff25c073b00 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff25400a640 con 0x7ff25c073b00 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff25400aa70 con 0x7ff25c073b00 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c09d010 con 0x7ff25c073b00 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff25c09d5d0 con 0x7ff25c073b00 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 Processor -- start 2024-09-15T22:50:41.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7efe11c00640 1 -- start start 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4674a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 0x7f46700c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4674a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 0x7f46700c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39184/0 (socket says 172.21.15.31:39184) 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4675400640 1 -- 172.21.15.31:0/3946269262 learned_addr learned my addr 172.21.15.31:0/3946269262 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b3c50 con 0x7f46700cd920 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f46700b6dd0 con 0x7f46700c9f60 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46700c9f60 0x7f4670162190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f46700cd490 con 0x7f4658003a10 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f492c0ca8f0 con 0x7f492c15e600 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f492c15daa0 con 0x7f492c15e600 2024-09-15T22:50:41.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.285+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4924016b90 con 0x7f492c15e600 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4d36c00640 1 Processor -- start 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 -- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46700c9f60 msgr2=0x7f4670162190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f46700c9f60 0x7f4670162190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 -- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 msgr2=0x7f46700c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 0x7f46700c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46700cc880 con 0x7f4658003a10 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4674a00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f46700cd920 0x7f46700c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:41.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4675400640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 0x7f46700cc130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f466401c1e0 tx=0x7f4658005840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff234001040 con 0x7ff25c073b00 2024-09-15T22:50:41.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c147fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c0b25d0 0x7efe0c149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe0c1485a0 0x7efe0c159760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f1c67e00640 1 --2- 172.21.15.31:0/2280965670 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c58013db0 tx=0x7f1c58024bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b8554522ed4dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c16f510 con 0x7efe0c1485a0 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efe0c0b4a20 con 0x7efe0c0b25d0 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe11c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe0c16f690 con 0x7efe0c09aa40 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c147fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c147fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53804/0 (socket says 172.21.15.31:53804) 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 -- 172.21.15.31:0/3775191045 learned_addr learned my addr 172.21.15.31:0/3775191045 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0a000640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c0b25d0 0x7efe0c149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 -- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c0b25d0 msgr2=0x7efe0c149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe0c0b25d0 0x7efe0c149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 -- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe0c1485a0 msgr2=0x7efe0c159760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe0c1485a0 0x7efe0c159760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7efe0aa00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe0c151c80 con 0x7efe0c09aa40 2024-09-15T22:50:41.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4d36c00640 1 -- start start 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46640ba070 con 0x7f4658003a10 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46700ccb60 con 0x7f4658003a10 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4664003de0 con 0x7f4658003a10 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4664007250 con 0x7f4658003a10 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f46700cd120 con 0x7f4658003a10 2024-09-15T22:50:41.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd14800ba50 con 0x7fd15c0b3a60 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f46700ceb50 con 0x7f4658003a10 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd153400640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd13c067990 0x7fd13c069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd1480867c0 con 0x7fd15c0b3a60 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd153400640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7fd13c071090 0x7fd13c0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd13c073ba0 con 0x7fd13c071090 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d280e0d30 0x7f4d280514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d280519e0 0x7f4d28051e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d28052390 con 0x7f4d280e0950 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4d28055610 con 0x7f4d280519e0 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4d280558f0 con 0x7f4d280e0d30 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d280e0d30 0x7f4d280514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f1c6ea00640 1 -- 172.21.15.31:0/2280965670 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580ba070 con 0x7f1c700b5600 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f1c6ea00640 1 -- 172.21.15.31:0/2280965670 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c580adb70 con 0x7f1c700b5600 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.289+0000 7f1c6ea00640 1 -- 172.21.15.31:0/2280965670 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c580b5440 con 0x7f1c700b5600 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 msgr2=0x7f1c700b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 --2- 172.21.15.31:0/2280965670 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1c58013db0 tx=0x7f1c58024bd0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4d280e0d30 0x7f4d280514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57160/0 (socket says 172.21.15.31:57160) 2024-09-15T22:50:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d35800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f4d280e0950 0x7f4d28054dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52572/0 (socket says 172.21.15.31:52572) 2024-09-15T22:50:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 -- 172.21.15.31:0/1269112192 learned_addr learned my addr 172.21.15.31:0/1269112192 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe0aa00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c147fb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe04009d90 tx=0x7efe04019640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff25401b070 con 0x7ff25c073b00 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff238067990 0x7ff238069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff254085720 con 0x7ff25c073b00 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7ff238071110 0x7ff238073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff238073c20 con 0x7ff238071110 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7ff25408c050 con 0x7ff25c073b00 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040bd020 con 0x7efe0c09aa40 2024-09-15T22:50:41.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd15aa00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd13c067990 0x7fd13c069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d36200640 1 --2- 172.21.15.31:0/1269112192 >> v2:172.21.15.31:3300/0 conn(0x7f4d280519e0 0x7f4d28051e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 shutdown_connections 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 --2- 172.21.15.31:0/2280965670 >> v2:172.21.15.102:3300/0 conn(0x7f1c70067a00 0x7f1c7015e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 --2- 172.21.15.31:0/2280965670 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c700b5600 0x7f1c700b6750 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 >> 172.21.15.31:0/2280965670 conn(0x7f1c70073680 msgr2=0x7f1c7006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 shutdown_connections 2024-09-15T22:50:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd15b400640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7fd13c071090 0x7fd13c0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe040b8670 con 0x7efe0c09aa40 2024-09-15T22:50:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7ff25b400640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff238067990 0x7ff238069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd14808d050 con 0x7fd15c0b3a60 2024-09-15T22:50:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe040b2040 con 0x7efe0c09aa40 2024-09-15T22:50:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe0c151f60 con 0x7efe0c09aa40 2024-09-15T22:50:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe0c152a40 con 0x7efe0c09aa40 2024-09-15T22:50:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f1c76000640 1 -- 172.21.15.31:0/2280965670 wait complete. 2024-09-15T22:50:41.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd15b400640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7fd13c071090 0x7fd13c0734d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 -- 172.21.15.31:0/1269112192 >> v2:172.21.15.31:3300/0 conn(0x7f4d280519e0 msgr2=0x7f4d28051e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 --2- 172.21.15.31:0/1269112192 >> v2:172.21.15.31:3300/0 conn(0x7f4d280519e0 0x7f4d28051e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 -- 172.21.15.31:0/1269112192 >> v1:172.21.15.102:6789/0 conn(0x7f4d280e0950 legacy=0x7f4d28054dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4d34e00640 1 -- 172.21.15.31:0/1269112192 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2800bf90 con 0x7f4d280e0d30 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7fd15aa00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd13c067990 0x7fd13c069e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0b0000 tx=0x7fd14c0a8000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4924004030 con 0x7f492c15e600 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f4923400640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f490c067910 0x7f490c069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f492405d310 con 0x7f492c15e600 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7ff25b400640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff238067990 0x7ff238069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff25c1fe870 tx=0x7ff244008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7ff25be00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7ff238071110 0x7ff238073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f46640bd070 con 0x7f4658003a10 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.293+0000 7f466d600640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4650067990 0x7f4650069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f466411f640 con 0x7f4658003a10 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f466d600640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f4650071110 0x7f4650073550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46640aeec0 con 0x7f4650071110 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4664126050 con 0x7f4658003a10 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4674a00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4650067990 0x7f4650069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4923400640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f490c071db0 0x7f490c074250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f490c074920 con 0x7f490c071db0 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f492405bca0 con 0x7f492c15e600 2024-09-15T22:50:41.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f492a000640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f490c071db0 0x7f490c074250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== osd.5 v2:172.21.15.102:6824/4486619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd13c073ba0 con 0x7fd13c071090 2024-09-15T22:50:41.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f1c76000640 1 Processor -- start 2024-09-15T22:50:41.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f492aa00640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f490c067910 0x7f490c069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f1c76000640 1 -- start start 2024-09-15T22:50:41.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4675e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f4650071110 0x7f4650073550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7ff25be00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7ff238071110 0x7ff238073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe040c0020 con 0x7efe0c09aa40 2024-09-15T22:50:41.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efe0c151a30 con 0x7efe0c09aa40 2024-09-15T22:50:41.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4675e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f4650071110 0x7f4650073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4674a00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4650067990 0x7f4650069e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f465c001c00 tx=0x7f465c0014b0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f492a000640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f490c071db0 0x7f490c074250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4d34e00640 1 --2- 172.21.15.31:0/1269112192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0d30 0x7f4d280514a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d28010a40 tx=0x7f4d1c01c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bed5adf481cb371d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7efe02a00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdec067910 0x7efdec069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f492aa00640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f490c067910 0x7f490c069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ae000 tx=0x7f491c004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f1c76000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c70067a00 0x7f1c7015bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efe04120c80 con 0x7efe0c09aa40 2024-09-15T22:50:41.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f1c76000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c700b5600 0x7f1c70163f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4d2fe00640 1 -- 172.21.15.31:0/1269112192 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0ab660 con 0x7f4d280e0d30 2024-09-15T22:50:41.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4d2fe00640 1 -- 172.21.15.31:0/1269112192 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d1c0b0070 con 0x7f4d280e0d30 2024-09-15T22:50:41.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.297+0000 7f4d2fe00640 1 -- 172.21.15.31:0/1269112192 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1c0aba20 con 0x7f4d280e0d30 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe02a00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7efdec071090 0x7efdec0734d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdec073ba0 con 0x7efdec071090 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7efe041233d0 con 0x7efe0c09aa40 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 0x7f1c7015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c70067a00 0x7f1c7015bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c67e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c70067a00 0x7f1c7015bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53806/0 (socket says 172.21.15.31:53806) 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe0b400640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7efdec071090 0x7efdec0734d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c700b5600 0x7f1c70163f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c700b5600 0x7f1c70163f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57168/0 (socket says 172.21.15.31:57168) 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 0x7f1c7015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 0x7f1c7015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39222/0 (socket says 172.21.15.31:39222) 2024-09-15T22:50:41.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c67e00640 1 -- 172.21.15.31:0/1229140536 learned_addr learned my addr 172.21.15.31:0/1229140536 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== osd.4 v2:172.21.15.102:6800/3006746036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f490c074920 con 0x7f490c071db0 2024-09-15T22:50:41.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7006f380 con 0x7f1c7015ebc0 2024-09-15T22:50:41.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1c7006f200 con 0x7f1c700b5600 2024-09-15T22:50:41.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe0a000640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdec067910 0x7efdec069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1c7006f500 con 0x7f1c70067a00 2024-09-15T22:50:41.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 -- 172.21.15.31:0/1269112192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0d30 msgr2=0x7f4d280514a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 --2- 172.21.15.31:0/1269112192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0d30 0x7f4d280514a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4d28010a40 tx=0x7f4d1c01c480 comp rx=0 tx=0).stop 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 -- 172.21.15.31:0/1269112192 shutdown_connections 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 --2- 172.21.15.31:0/1269112192 >> v2:172.21.15.31:3300/0 conn(0x7f4d280519e0 0x7f4d28051e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 --2- 172.21.15.31:0/1269112192 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0d30 0x7f4d280514a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 -- 172.21.15.31:0/1269112192 >> 172.21.15.31:0/1269112192 conn(0x7f4d280567e0 msgr2=0x7f4d28056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 -- 172.21.15.31:0/1269112192 shutdown_connections 2024-09-15T22:50:41.341 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 -- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c70067a00 msgr2=0x7f1c7015bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f4d36c00640 1 -- 172.21.15.31:0/1269112192 wait complete. 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe0a000640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdec067910 0x7efdec069dd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe0c149200 tx=0x7efdf8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1c70067a00 0x7f1c7015bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 -- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c700b5600 msgr2=0x7f1c70163f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1c700b5600 0x7f1c70163f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7014f8d0 con 0x7f1c7015ebc0 2024-09-15T22:50:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== osd.3 v2:172.21.15.31:6816/2974285706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46640aeec0 con 0x7f4650071110 2024-09-15T22:50:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7efe0b400640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7efdec071090 0x7efdec0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c6fe00640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 0x7f1c7015d0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c700d0630 tx=0x7f1c6800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68018070 con 0x7f1c7015ebc0 2024-09-15T22:50:41.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c7014fb90 con 0x7f1c7015ebc0 2024-09-15T22:50:41.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== osd.2 v2:172.21.15.31:6800/2940701196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efdec073ba0 con 0x7efdec071090 2024-09-15T22:50:41.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c701644d0 con 0x7f1c7015ebc0 2024-09-15T22:50:41.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.301+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== osd.1 v2:172.21.15.31:6824/844776262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff238073c20 con 0x7ff238071110 2024-09-15T22:50:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c7015e680 con 0x7f1c7015ebc0 2024-09-15T22:50:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c68004d70 con 0x7f1c7015ebc0 2024-09-15T22:50:41.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c68022060 con 0x7f1c7015ebc0 2024-09-15T22:50:41.346 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f4d36c00640 1 Processor -- start 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f4d36c00640 1 -- start start 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.305+0000 7f4d36c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 0x7f4d28034b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0950 0x7f4d2804a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280e0d30 0x7f4d2804abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2800d610 con 0x7f4d280e0d30 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2800d490 con 0x7f4d280e0950 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d2800d790 con 0x7f4d280519e0 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d34e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0950 0x7f4d2804a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 0x7f4d28034b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d34e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0950 0x7f4d2804a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57180/0 (socket says 172.21.15.31:57180) 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 0x7f4d28034b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53818/0 (socket says 172.21.15.31:53818) 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 -- 172.21.15.31:0/866992929 learned_addr learned my addr 172.21.15.31:0/866992929 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 -- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0950 msgr2=0x7f4d2804a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d280e0950 0x7f4d2804a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 -- 172.21.15.31:0/866992929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280e0d30 msgr2=0x7f4d2804abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d280e0d30 0x7f4d2804abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d2804b250 con 0x7f4d280519e0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d35800640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 0x7f4d28034b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006abd0 tx=0x7f4d30074b50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3008f070 con 0x7f4d280519e0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d300696d0 con 0x7f4d280519e0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d30072870 con 0x7f4d280519e0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d280de350 con 0x7f4d280519e0 2024-09-15T22:50:41.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f4d36c00640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d28035070 con 0x7f4d280519e0 2024-09-15T22:50:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.309+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1c6801b070 con 0x7f1c7015ebc0 2024-09-15T22:50:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67400640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1c4c0678c0 0x7f1c4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1c68054290 con 0x7f1c7015ebc0 2024-09-15T22:50:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67e00640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1c4c0678c0 0x7f1c4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7fc1c4800640 1 -- 172.21.15.31:0/992103728 --> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc1b800c5a0 con 0x7fc1a0070fc0 2024-09-15T22:50:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4d280dea10 con 0x7f4d280519e0 2024-09-15T22:50:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67400640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7f1c4c070f40 0x7f1c4c073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7fc1b6000640 1 -- 172.21.15.31:0/992103728 <== osd.0 v2:172.21.15.31:6801/1549484768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc1b800c5a0 con 0x7fc1a0070fc0 2024-09-15T22:50:41.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c4c073a50 con 0x7f1c4c070f40 2024-09-15T22:50:41.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1c68055fc0 con 0x7f1c7015ebc0 2024-09-15T22:50:41.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c6f400640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7f1c4c070f40 0x7f1c4c073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d30092070 con 0x7f4d280519e0 2024-09-15T22:50:41.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7fc1a0070fc0 msgr2=0x7fc1a0073400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7fc1ab400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7fc1a0070fc0 0x7fc1a0073400 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.313+0000 7f1c6f400640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7f1c4c070f40 0x7f1c4c073380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1a00678c0 msgr2=0x7fc1a0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678c0 0x7f4d10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1a00678c0 0x7fc1a0069d80 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc1ac0ae000 tx=0x7fc1ac0a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 msgr2=0x7fc1b8188350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 --2- 172.21.15.31:0/992103728 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc1b8008b30 0x7fc1b8188350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000c490 tx=0x7fc1b000c950 comp rx=0 tx=0).stop 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1c2800640 1 -- 172.21.15.31:0/992103728 reap_dead start 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 shutdown_connections 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 >> 172.21.15.31:0/992103728 conn(0x7fc1b80567c0 msgr2=0x7fc1b8050f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4d30101850 con 0x7f4d280519e0 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d34e00640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678c0 0x7f4d10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f4d10070f40 0x7f4d10073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d10073a50 con 0x7f4d10070f40 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4d300cdca0 con 0x7f4d280519e0 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== osd.7 v2:172.21.15.102:6816/944524781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c4c073a50 con 0x7f1c4c070f40 2024-09-15T22:50:41.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f1c67e00640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1c4c0678c0 0x7f1c4c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c58013db0 tx=0x7f1c580af070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d36200640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f4d10070f40 0x7f4d10073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d34e00640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678c0 0x7f4d10069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0af000 tx=0x7f4d1c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 shutdown_connections 2024-09-15T22:50:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7fc1ab400640 1 -- 172.21.15.31:0/992103728 wait complete. 2024-09-15T22:50:41.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d36200640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f4d10070f40 0x7f4d10073380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.317+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== osd.6 v2:172.21.15.102:6808/1303586807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4d10073a50 con 0x7f4d10070f40 2024-09-15T22:50:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.325+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 --> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46700d42e0 con 0x7f4650071110 2024-09-15T22:50:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.325+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 --> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd15c06e730 con 0x7fd13c071090 2024-09-15T22:50:41.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.325+0000 7fd153400640 1 -- 172.21.15.31:0/315815982 <== osd.5 v2:172.21.15.102:6824/4486619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd15c06e730 con 0x7fd13c071090 2024-09-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7fd13c071090 msgr2=0x7fd13c0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7fd13c071090 0x7fd13c0734d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f466d600640 1 -- 172.21.15.31:0/3946269262 <== osd.3 v2:172.21.15.31:6816/2974285706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46700d42e0 con 0x7f4650071110 2024-09-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd13c067990 msgr2=0x7fd13c069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd13c067990 0x7fd13c069e50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0b0000 tx=0x7fd14c0a8000 comp rx=0 tx=0).stop 2024-09-15T22:50:41.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 msgr2=0x7fd15c143790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 --2- 172.21.15.31:0/315815982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd15c0b3a60 0x7fd15c143790 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd148001470 tx=0x7fd148001930 comp rx=0 tx=0).stop 2024-09-15T22:50:41.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15b400640 1 -- 172.21.15.31:0/315815982 reap_dead start 2024-09-15T22:50:41.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 shutdown_connections 2024-09-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 >> 172.21.15.31:0/315815982 conn(0x7fd15c06be90 msgr2=0x7fd15c0ad310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 shutdown_connections 2024-09-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7fd15be00640 1 -- 172.21.15.31:0/315815982 wait complete. 2024-09-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f4650071110 msgr2=0x7f4650073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f4650071110 0x7f4650073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4650067990 msgr2=0x7f4650069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4650067990 0x7f4650069e50 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f465c001c00 tx=0x7f465c0014b0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 msgr2=0x7f46700cc130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 --2- 172.21.15.31:0/3946269262 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4658003a10 0x7f46700cc130 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f466401c1e0 tx=0x7f4658005840 comp rx=0 tx=0).stop 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4675e00640 1 -- 172.21.15.31:0/3946269262 reap_dead start 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 shutdown_connections 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.329+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 >> 172.21.15.31:0/3946269262 conn(0x7f46700d4500 msgr2=0x7f46700b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.333+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 shutdown_connections 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.333+0000 7f4677e00640 1 -- 172.21.15.31:0/3946269262 wait complete. 2024-09-15T22:50:41.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.333+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 --> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff234002de0 con 0x7ff238071110 2024-09-15T22:50:41.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.333+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 --> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f492c068f20 con 0x7f490c071db0 2024-09-15T22:50:41.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4923400640 1 -- 172.21.15.31:0/602695744 <== osd.4 v2:172.21.15.102:6800/3006746036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f492c068f20 con 0x7f490c071db0 2024-09-15T22:50:41.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff253400640 1 -- 172.21.15.31:0/2404722137 <== osd.1 v2:172.21.15.31:6824/844776262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7ff234002de0 con 0x7ff238071110 2024-09-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f490c071db0 msgr2=0x7f490c074250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f490c071db0 0x7f490c074250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 --> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7efe0c0b2090 con 0x7efdec071090 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f490c067910 msgr2=0x7f490c069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f490c067910 0x7f490c069dd0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f491c0ae000 tx=0x7f491c004740 comp rx=0 tx=0).stop 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 msgr2=0x7f492c0c8a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 --2- 172.21.15.31:0/602695744 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f492c15e600 0x7f492c0c8a60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4924007e30 tx=0x7f492400d4a0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f492b400640 1 -- 172.21.15.31:0/602695744 reap_dead start 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7ff238071110 msgr2=0x7ff238073550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7ff238071110 0x7ff238073550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe02a00640 1 -- 172.21.15.31:0/3775191045 <== osd.2 v2:172.21.15.31:6800/2940701196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7efe0c0b2090 con 0x7efdec071090 2024-09-15T22:50:41.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 shutdown_connections 2024-09-15T22:50:41.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 >> 172.21.15.31:0/602695744 conn(0x7f492c09d860 msgr2=0x7f492c0d3940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7efdec071090 msgr2=0x7efdec0734d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7efdec071090 0x7efdec0734d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 shutdown_connections 2024-09-15T22:50:41.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7f4931e00640 1 -- 172.21.15.31:0/602695744 wait complete. 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff238067990 msgr2=0x7ff238069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff238067990 0x7ff238069e50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff25c1fe870 tx=0x7ff244008040 comp rx=0 tx=0).stop 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdec067910 msgr2=0x7efdec069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdec067910 0x7efdec069dd0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7efe0c149200 tx=0x7efdf8008040 comp rx=0 tx=0).stop 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 msgr2=0x7efe0c147fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7efe11c00640 1 --2- 172.21.15.31:0/3775191045 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe0c09aa40 0x7efe0c147fb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efe04009d90 tx=0x7efe04019640 comp rx=0 tx=0).stop 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 msgr2=0x7ff25c09c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.337+0000 7ff260a00640 1 --2- 172.21.15.31:0/2404722137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff25c073b00 0x7ff25c09c630 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff25400c8c0 tx=0x7ff25400cd80 comp rx=0 tx=0).stop 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7ff25be00640 1 -- 172.21.15.31:0/2404722137 reap_dead start 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 shutdown_connections 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 >> 172.21.15.31:0/2404722137 conn(0x7ff25c06be90 msgr2=0x7ff25c0b1c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7efe0b400640 1 -- 172.21.15.31:0/3775191045 reap_dead start 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 shutdown_connections 2024-09-15T22:50:41.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 >> 172.21.15.31:0/3775191045 conn(0x7efe0c073540 msgr2=0x7efe0c157ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 shutdown_connections 2024-09-15T22:50:41.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 shutdown_connections 2024-09-15T22:50:41.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7ff260a00640 1 -- 172.21.15.31:0/2404722137 wait complete. 2024-09-15T22:50:41.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.341+0000 7efe11c00640 1 -- 172.21.15.31:0/3775191045 wait complete. 2024-09-15T22:50:41.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.345+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 --> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c700b6720 con 0x7f1c4c070f40 2024-09-15T22:50:41.369 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:41.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:50:41.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c67400640 1 -- 172.21.15.31:0/1229140536 <== osd.7 v2:172.21.15.102:6816/944524781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c700b6720 con 0x7f1c4c070f40 2024-09-15T22:50:41.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 --> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4d2800db40 con 0x7f4d10070f40 2024-09-15T22:50:41.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7f1c4c070f40 msgr2=0x7f1c4c073380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7f1c4c070f40 0x7f1c4c073380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1c4c0678c0 msgr2=0x7f1c4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1c4c0678c0 0x7f1c4c069d80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1c58013db0 tx=0x7f1c580af070 comp rx=0 tx=0).stop 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 msgr2=0x7f1c7015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d2d600640 1 -- 172.21.15.31:0/866992929 <== osd.6 v2:172.21.15.102:6808/1303586807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4d2800db40 con 0x7f4d10070f40 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 --2- 172.21.15.31:0/1229140536 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1c7015ebc0 0x7f1c7015d0a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1c700d0630 tx=0x7f1c6800cb90 comp rx=0 tx=0).stop 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c6fe00640 1 -- 172.21.15.31:0/1229140536 reap_dead start 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 shutdown_connections 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 >> 172.21.15.31:0/1229140536 conn(0x7f1c70073680 msgr2=0x7f1c70153880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 shutdown_connections 2024-09-15T22:50:41.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f1c76000640 1 -- 172.21.15.31:0/1229140536 wait complete. 2024-09-15T22:50:41.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f4d10070f40 msgr2=0x7f4d10073380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f4d10070f40 0x7f4d10073380 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678c0 msgr2=0x7f4d10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678c0 0x7f4d10069d80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f4d1c0af000 tx=0x7f4d1c0a7000 comp rx=0 tx=0).stop 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 msgr2=0x7f4d28034b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 --2- 172.21.15.31:0/866992929 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d280519e0 0x7f4d28034b30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4d3006abd0 tx=0x7f4d30074b50 comp rx=0 tx=0).stop 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d36200640 1 -- 172.21.15.31:0/866992929 reap_dead start 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 shutdown_connections 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.349+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 >> 172.21.15.31:0/866992929 conn(0x7f4d280567e0 msgr2=0x7f4d28056bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.357+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 shutdown_connections 2024-09-15T22:50:41.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.357+0000 7f4d22a00640 1 -- 172.21.15.31:0/866992929 wait complete. 2024-09-15T22:50:41.381 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:41.382 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:50:41.383 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:41.383 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:50:41.384 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:41.384 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:50:41.387 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:41.387 INFO:teuthology.orchestra.run.smithi031.stdout:60129542155 2024-09-15T22:50:41.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:50:41.388 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:50:41.394 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:41.394 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:50:41.401 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:41.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:50:41.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.617+0000 7fab26400640 1 Processor -- start 2024-09-15T22:50:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.617+0000 7fab26400640 1 -- start start 2024-09-15T22:50:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 Processor -- start 2024-09-15T22:50:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 -- start start 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab26400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab2006f910 0x7fab200ad640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab26400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab200727d0 con 0x7fab20162750 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab26400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab20072ab0 con 0x7fab2006f4d0 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab26400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fab200733e0 con 0x7fab2006f910 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab25000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fab20162750 0x7fab20071d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58492/0 (socket says 172.21.15.31:58492) 2024-09-15T22:50:41.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab25000640 1 -- 172.21.15.31:0/2187572612 learned_addr learned my addr 172.21.15.31:0/2187572612 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935330212 0 0) 0x7fab200727d0 con 0x7fab20162750 2024-09-15T22:50:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab04003530 con 0x7fab20162750 2024-09-15T22:50:41.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1583176449 0 0) 0x7fab04003530 con 0x7fab20162750 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab2006f910 msgr2=0x7fab200ad640 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab2006f910 0x7fab200ad640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 >> v1:172.21.15.102:6789/0 conn(0x7fab2006f4d0 legacy=0x7fab200acf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab20072d90 con 0x7fab20162750 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7fab0c0016a0 con 0x7fab20162750 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 >> v1:172.21.15.31:6789/0 conn(0x7fab20162750 legacy=0x7fab20071d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040039f0 0x7fab04003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab04004810 0x7fab04004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040051d0 0x7fab0400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fab200733e0 con 0x7fab040039f0 2024-09-15T22:50:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fab0400c100 con 0x7fab040051d0 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fab0400c300 con 0x7fab04004810 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff3940cff80 0x7ff39406e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff39415e550 0x7ff3941541f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff39406eeb0 con 0x7ff3940af710 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff39406ec70 con 0x7ff39415e550 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.621+0000 7ff39a000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff39406f190 con 0x7ff3940cff80 2024-09-15T22:50:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040039f0 0x7fab04003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff39415e550 0x7ff3941541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff39415e550 0x7ff3941541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39254/0 (socket says 172.21.15.31:39254) 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 -- 172.21.15.31:0/436169937 learned_addr learned my addr 172.21.15.31:0/436169937 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff398c00640 1 --2- 172.21.15.31:0/436169937 >> v2:172.21.15.102:3300/0 conn(0x7ff3940cff80 0x7ff39406e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 -- 172.21.15.31:0/436169937 >> v2:172.21.15.102:3300/0 conn(0x7ff3940cff80 msgr2=0x7ff39406e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 --2- 172.21.15.31:0/436169937 >> v2:172.21.15.102:3300/0 conn(0x7ff3940cff80 0x7ff39406e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 -- 172.21.15.31:0/436169937 >> v1:172.21.15.31:6789/0 conn(0x7ff3940af710 legacy=0x7ff39415de40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7ff399600640 1 -- 172.21.15.31:0/436169937 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39406f470 con 0x7ff39415e550 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 -- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab04004810 msgr2=0x7fab04004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab04004810 0x7fab04004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 -- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040051d0 msgr2=0x7fab0400b9d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040051d0 0x7fab0400b9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.625+0000 7fab25000640 1 -- 172.21.15.31:0/2187572612 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab20072d90 con 0x7fab040039f0 2024-09-15T22:50:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7f306ce00640 1 Processor -- start 2024-09-15T22:50:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7fca9ee00640 1 Processor -- start 2024-09-15T22:50:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7fca9ee00640 1 -- start start 2024-09-15T22:50:41.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7ff399600640 1 --2- 172.21.15.31:0/436169937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff39415e550 0x7ff3941541f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3940b2cf0 tx=0x7ff38001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da4aae5f50d4b682 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7fab25000640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040039f0 0x7fab04003df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00c4e0 tx=0x7fab0c01cdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f65d4cf0755b1ddd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.629+0000 7f306ce00640 1 -- start start 2024-09-15T22:50:41.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f306ce00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 0x7f30680b3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9ee00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca900e64d0 0x7fca900e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9ee00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca90006be0 0x7fca9004f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9ee00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca900e6df0 con 0x7fca9004fcd0 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9ee00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fca90050230 con 0x7fca900e64d0 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9ee00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca90005e20 con 0x7fca90006be0 2024-09-15T22:50:41.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f306ce00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f30680b3590 0x7f30680b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca900e64d0 0x7fca900e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fca900e64d0 0x7fca900e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39270/0 (socket says 172.21.15.31:39270) 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 -- 172.21.15.31:0/1291628742 learned_addr learned my addr 172.21.15.31:0/1291628742 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9d000640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca90006be0 0x7fca9004f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f306ce00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30680ae260 con 0x7f306815df50 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f306ce00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f306815a8c0 con 0x7f306815a4e0 2024-09-15T22:50:41.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f306ce00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f30680b1550 con 0x7f30680b3590 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff393400640 1 -- 172.21.15.31:0/436169937 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800b1070 con 0x7ff39415e550 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff393400640 1 -- 172.21.15.31:0/436169937 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3800a4e30 con 0x7ff39415e550 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff393400640 1 -- 172.21.15.31:0/436169937 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3800ac640 con 0x7ff39415e550 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 0x7f30680b3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 0x7f30680b3050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39268/0 (socket says 172.21.15.31:39268) 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065e00640 1 -- 172.21.15.31:0/1278356941 learned_addr learned my addr 172.21.15.31:0/1278356941 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065400640 1 --2- 172.21.15.31:0/1278356941 >> v2:172.21.15.102:3300/0 conn(0x7f30680b3590 0x7f30680b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 -- 172.21.15.31:0/436169937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff39415e550 msgr2=0x7ff3941541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 --2- 172.21.15.31:0/436169937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff39415e550 0x7ff3941541f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff3940b2cf0 tx=0x7ff38001c450 comp rx=0 tx=0).stop 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 -- 172.21.15.31:0/1291628742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca90006be0 msgr2=0x7fca9004f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca90006be0 0x7fca9004f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 -- 172.21.15.31:0/1291628742 >> v1:172.21.15.102:6789/0 conn(0x7fca9004fcd0 legacy=0x7fca9001c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fca9da00640 1 -- 172.21.15.31:0/1291628742 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca90006100 con 0x7fca900e64d0 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 -- 172.21.15.31:0/436169937 shutdown_connections 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 --2- 172.21.15.31:0/436169937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff39415e550 0x7ff3941541f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 --2- 172.21.15.31:0/436169937 >> v2:172.21.15.102:3300/0 conn(0x7ff3940cff80 0x7ff39406e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 -- 172.21.15.31:0/436169937 >> 172.21.15.31:0/436169937 conn(0x7ff39406be90 msgr2=0x7ff39406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 -- 172.21.15.31:0/436169937 shutdown_connections 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c00c0e0 con 0x7fab040039f0 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c0a9070 con 0x7fab040039f0 2024-09-15T22:50:41.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab1f400640 1 -- 172.21.15.31:0/2187572612 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0058e0 con 0x7fab040039f0 2024-09-15T22:50:41.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7ff39a000640 1 -- 172.21.15.31:0/436169937 wait complete. 2024-09-15T22:50:41.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab26400640 1 -- 172.21.15.31:0/2187572612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040039f0 msgr2=0x7fab04003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab26400640 1 --2- 172.21.15.31:0/2187572612 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab040039f0 0x7fab04003df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fab0c00c4e0 tx=0x7fab0c01cdd0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7fab25a00640 1 -- 172.21.15.31:0/2187572612 reap_dead start 2024-09-15T22:50:41.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 Processor -- start 2024-09-15T22:50:41.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fab26400640 1 -- 172.21.15.31:0/2187572612 shutdown_connections 2024-09-15T22:50:41.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fab26400640 1 -- 172.21.15.31:0/2187572612 >> 172.21.15.31:0/2187572612 conn(0x7fab2006c2c0 msgr2=0x7fab200b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fab26400640 1 -- 172.21.15.31:0/2187572612 shutdown_connections 2024-09-15T22:50:41.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fab26400640 1 -- 172.21.15.31:0/2187572612 wait complete. 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 -- start start 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 0x7ff394165db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff39415e550 0x7ff39409ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940738a0 con 0x7ff3940af710 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff394073720 con 0x7ff3940cff80 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7ff39a000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff394073a20 con 0x7ff39415e550 2024-09-15T22:50:41.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fca9da00640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca900e64d0 0x7fca900e68b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca8c006fd0 tx=0x7fca8c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eea0e641505a5db server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fca97e00640 1 -- 172.21.15.31:0/1291628742 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0a95f0 con 0x7fca900e64d0 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fca97e00640 1 -- 172.21.15.31:0/1291628742 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c0a9790 con 0x7fca900e64d0 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7fca97e00640 1 -- 172.21.15.31:0/1291628742 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0a9b60 con 0x7fca900e64d0 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065400640 1 -- 172.21.15.31:0/1278356941 >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 msgr2=0x7f30680b3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065400640 1 --2- 172.21.15.31:0/1278356941 >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 0x7f30680b3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065400640 1 -- 172.21.15.31:0/1278356941 >> v1:172.21.15.102:6789/0 conn(0x7f306815df50 legacy=0x7f306815e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.633+0000 7f3065400640 1 -- 172.21.15.31:0/1278356941 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30680b0940 con 0x7f30680b3590 2024-09-15T22:50:41.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.637+0000 7f7e17200640 1 Processor -- start 2024-09-15T22:50:41.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff398c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 0x7ff394165db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff398c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39282/0 (socket says 172.21.15.31:39282) 2024-09-15T22:50:41.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 -- 172.21.15.31:0/1291628742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca900e64d0 msgr2=0x7fca900e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca900e64d0 0x7fca900e68b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fca8c006fd0 tx=0x7fca8c01c530 comp rx=0 tx=0).stop 2024-09-15T22:50:41.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff398c00640 1 -- 172.21.15.31:0/2673703937 learned_addr learned my addr 172.21.15.31:0/2673703937 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f3065400640 1 --2- 172.21.15.31:0/1278356941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30680b3590 0x7f30680b39b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3068070b10 tx=0x7f305401ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af9dcac08272139 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 Processor -- start 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 -- 172.21.15.31:0/1291628742 shutdown_connections 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca90006be0 0x7fca9004f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 --2- 172.21.15.31:0/1291628742 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca900e64d0 0x7fca900e68b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 -- 172.21.15.31:0/1291628742 >> 172.21.15.31:0/1291628742 conn(0x7fca900360a0 msgr2=0x7fca900364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 -- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff39415e550 msgr2=0x7ff39409ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff39415e550 0x7ff39409ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f3064a00640 1 -- 172.21.15.31:0/1278356941 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540b5070 con 0x7f30680b3590 2024-09-15T22:50:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 -- 172.21.15.31:0/1291628742 shutdown_connections 2024-09-15T22:50:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 -- start start 2024-09-15T22:50:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fca9ee00640 1 -- 172.21.15.31:0/1291628742 wait complete. 2024-09-15T22:50:41.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f3064a00640 1 -- 172.21.15.31:0/1278356941 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30540a89b0 con 0x7f30680b3590 2024-09-15T22:50:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f3064a00640 1 -- 172.21.15.31:0/1278356941 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30540a8dc0 con 0x7f30680b3590 2024-09-15T22:50:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 -- 172.21.15.31:0/2673703937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 msgr2=0x7ff394153dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 -- 172.21.15.31:0/2673703937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39409bca0 con 0x7ff3940cff80 2024-09-15T22:50:41.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff398c00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 -- start start 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 0x7f7e1815c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1806f960 con 0x7f7e1806ef80 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7e1806fc40 con 0x7f7e180b51d0 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e17200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1806ff20 con 0x7f7e18158c90 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53862/0 (socket says 172.21.15.31:53862) 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e15400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f7e1806ef80 0x7f7e180b4ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52618/0 (socket says 172.21.15.31:52618) 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e15400640 1 -- 172.21.15.31:0/2861093709 learned_addr learned my addr 172.21.15.31:0/2861093709 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e16800640 1 --2- 172.21.15.31:0/2861093709 >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 0x7f7e1815c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab20147ac0 0x7fab2009dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab2015c2e0 0x7fab2015c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fab20162cb0 con 0x7fab2015c2e0 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fab20162b30 con 0x7fab040039f0 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab26400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fab200b3100 con 0x7fab20147ac0 2024-09-15T22:50:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7ff393e00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 0x7ff394165db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c3e0 tx=0x7ff38400c8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab25000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab25000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57204/0 (socket says 172.21.15.31:57204) 2024-09-15T22:50:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab25000640 1 -- 172.21.15.31:0/7799382 learned_addr learned my addr 172.21.15.31:0/7799382 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e15e00640 1 -- 172.21.15.31:0/2861093709 >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 msgr2=0x7f7e1815c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7fab1fe00640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab20147ac0 0x7fab2009dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.641+0000 7f7e14a00640 1 -- 172.21.15.31:0/2861093709 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3284910139 0 0) 0x7f7e1806f960 con 0x7f7e1806ef80 2024-09-15T22:50:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 Processor -- start 2024-09-15T22:50:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384011790 con 0x7ff3940cff80 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff384017070 con 0x7ff3940cff80 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff384011790 con 0x7ff3940cff80 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7ff39a000640 1 -- 172.21.15.31:0/2673703937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39409bf80 con 0x7ff3940cff80 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7ff39a000640 1 -- 172.21.15.31:0/2673703937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39409c540 con 0x7ff3940cff80 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 -- 172.21.15.31:0/1278356941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30680b3590 msgr2=0x7f30680b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 --2- 172.21.15.31:0/1278356941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30680b3590 0x7f30680b39b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3068070b10 tx=0x7f305401ecb0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 -- 172.21.15.31:0/1278356941 shutdown_connections 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 --2- 172.21.15.31:0/1278356941 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30680b3590 0x7f30680b39b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 --2- 172.21.15.31:0/1278356941 >> v2:172.21.15.31:3300/0 conn(0x7f306815a4e0 0x7f30680b3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f306ce00640 1 -- 172.21.15.31:0/1278356941 >> 172.21.15.31:0/1278356941 conn(0x7f30680b1d50 msgr2=0x7f30680b2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f7e15e00640 1 --2- 172.21.15.31:0/2861093709 >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 0x7f7e1815c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f7e15e00640 1 -- 172.21.15.31:0/2861093709 >> v1:172.21.15.102:6789/0 conn(0x7f7e1806ef80 legacy=0x7f7e180b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f7e15e00640 1 -- 172.21.15.31:0/2861093709 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e18070200 con 0x7f7e18158c90 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 -- start start 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca9004fcd0 0x7fca90039d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 0x7fca90038fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fca9001dd60 con 0x7fca90006be0 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fca900e2a50 con 0x7fca900dcce0 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9ee00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fca900e4bd0 con 0x7fca9004fcd0 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39304/0 (socket says 172.21.15.31:39304) 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9da00640 1 -- 172.21.15.31:0/2531355258 learned_addr learned my addr 172.21.15.31:0/2531355258 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fca9da00640 1 -- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca9004fcd0 msgr2=0x7fca90039d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 -- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab20147ac0 msgr2=0x7fab2009dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab20147ac0 0x7fab2009dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 -- 172.21.15.31:0/7799382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab2015c2e0 msgr2=0x7fab2015c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab2015c2e0 0x7fab2015c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 -- 172.21.15.31:0/7799382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab201476c0 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab25000640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0019a0 tx=0x7fab04005840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0a5b50 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab0c0a5cf0 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab0c0a5b50 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab2015f620 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab2009ae50 con 0x7fab040039f0 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f480e800640 1 Processor -- start 2024-09-15T22:50:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.645+0000 7f480e800640 1 -- start start 2024-09-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff394073de0 con 0x7ff3940cff80 2024-09-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f7e16800640 1 --2- 172.21.15.31:0/2861093709 >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 0x7f7e1815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f480e800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f480815a5f0 0x7f48080b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f480e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4808072870 0x7f48080ce400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9e400640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 0x7fca90038fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9da00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca9004fcd0 0x7fca90039d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9da00640 1 -- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 msgr2=0x7fca90038fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9da00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 0x7fca90038fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9da00640 1 -- 172.21.15.31:0/2531355258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca900da430 con 0x7fca90006be0 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9e400640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 0x7fca90038fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff384011930 con 0x7ff3940cff80 2024-09-15T22:50:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f480e800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48080b59a0 con 0x7f48080b5490 2024-09-15T22:50:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f480e800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f48080b4d50 con 0x7f4808072870 2024-09-15T22:50:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f480e800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f480815a9d0 con 0x7f480815a5f0 2024-09-15T22:50:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4806a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f48080b5490 0x7f4808072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58514/0 (socket says 172.21.15.31:58514) 2024-09-15T22:50:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4806a00640 1 -- 172.21.15.31:0/233640916 learned_addr learned my addr 172.21.15.31:0/233640916 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab200adf90 con 0x7fab040039f0 2024-09-15T22:50:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9da00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01abe0 tx=0x7fca8c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4807e00640 1 --2- 172.21.15.31:0/233640916 >> v2:172.21.15.31:3300/0 conn(0x7f4808072870 0x7f48080ce400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f0046000640 1 Processor -- start 2024-09-15T22:50:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f7e15e00640 1 --2- 172.21.15.31:0/2861093709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e080097c0 tx=0x7f7e0801e660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bbe074bd2aa1852f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4806000640 1 -- 172.21.15.31:0/233640916 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 486946231 0 0) 0x7f48080b59a0 con 0x7f48080b5490 2024-09-15T22:50:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f0046000640 1 -- start start 2024-09-15T22:50:41.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f7e14a00640 1 -- 172.21.15.31:0/2861093709 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e080a8040 con 0x7f7e18158c90 2024-09-15T22:50:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f7e14a00640 1 -- 172.21.15.31:0/2861093709 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e080b1070 con 0x7f7e18158c90 2024-09-15T22:50:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f7e14a00640 1 -- 172.21.15.31:0/2861093709 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e080ac860 con 0x7f7e18158c90 2024-09-15T22:50:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fab0c0b7070 con 0x7fab040039f0 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4806000640 1 -- 172.21.15.31:0/233640916 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47ec003530 con 0x7f48080b5490 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4807e00640 1 -- 172.21.15.31:0/233640916 >> v2:172.21.15.102:3300/0 conn(0x7f480815a5f0 msgr2=0x7f48080b4f50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4807e00640 1 --2- 172.21.15.31:0/233640916 >> v2:172.21.15.102:3300/0 conn(0x7f480815a5f0 0x7f48080b4f50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4807e00640 1 -- 172.21.15.31:0/233640916 >> v1:172.21.15.31:6789/0 conn(0x7f48080b5490 legacy=0x7f4808072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f4807e00640 1 -- 172.21.15.31:0/233640916 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48080b3f90 con 0x7f4808072870 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f306ce00640 1 -- 172.21.15.31:0/1278356941 shutdown_connections 2024-09-15T22:50:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7f306ce00640 1 -- 172.21.15.31:0/1278356941 wait complete. 2024-09-15T22:50:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7ff390c00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 0x7ff374069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff3840857c0 con 0x7ff3940cff80 2024-09-15T22:50:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7ff398c00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 0x7ff374069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7ff398c00640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 0x7ff374069f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff38c003fd0 tx=0x7ff38c009970 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f0046000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 0x7f00400b6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f306ce00640 1 Processor -- start 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 -- 172.21.15.31:0/2861093709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 msgr2=0x7f7e18070a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 --2- 172.21.15.31:0/2861093709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7e080097c0 tx=0x7f7e0801e660 comp rx=0 tx=0).stop 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 -- 172.21.15.31:0/2861093709 shutdown_connections 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 --2- 172.21.15.31:0/2861093709 >> v2:172.21.15.31:3300/0 conn(0x7f7e180b51d0 0x7f7e1815c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 --2- 172.21.15.31:0/2861093709 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e18070a00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 -- 172.21.15.31:0/2861093709 >> 172.21.15.31:0/2861093709 conn(0x7f7e1809aa40 msgr2=0x7f7e180b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0a95f0 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca8c0a9d90 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca8c003860 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca900da710 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca900dacd0 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.649+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca900e68b0 con 0x7fca90006be0 2024-09-15T22:50:41.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7fab1cc00640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 0x7fab00069f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f0046000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00400b6850 con 0x7f0040159cc0 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f0046000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f004006eb10 con 0x7f00400cd860 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f0046000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f004006edf0 con 0x7f00400b5ef0 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003ea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 0x7f00400b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003fe00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f00400cd860 0x7f00400cdd10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52628/0 (socket says 172.21.15.31:52628) 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003fe00640 1 -- 172.21.15.31:0/5798825 learned_addr learned my addr 172.21.15.31:0/5798825 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:41.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fab0c11f040 con 0x7fab040039f0 2024-09-15T22:50:41.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7fab1fe00640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 0x7fab00069f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f306ce00640 1 -- start start 2024-09-15T22:50:41.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003ea00640 1 -- 172.21.15.31:0/5798825 >> v1:172.21.15.102:6789/0 conn(0x7f00400cd860 legacy=0x7f00400cdd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f306ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 0x7f306813f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f306ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f306815a4e0 0x7f30681414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7fab1fe00640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 0x7fab00069f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab20147ea0 tx=0x7fab10007dc0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003ea00640 1 -- 172.21.15.31:0/5798825 >> v1:172.21.15.31:6789/0 conn(0x7f0040159cc0 legacy=0x7f0040070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f003ea00640 1 -- 172.21.15.31:0/5798825 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f004006f0d0 con 0x7f00400b5ef0 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f306ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f306ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30680b11e0 con 0x7f30680b3590 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f306ce00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f30680b0f00 con 0x7f306815a4e0 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f306ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f30680cc620 con 0x7f306815df50 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3065400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f306815a4e0 0x7f30681414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3065e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 0x7f306813f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53886/0 (socket says 172.21.15.31:53886) 2024-09-15T22:50:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 -- 172.21.15.31:0/38109501 learned_addr learned my addr 172.21.15.31:0/38109501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff384021020 con 0x7ff3940cff80 2024-09-15T22:50:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fca8c003a00 con 0x7fca90006be0 2024-09-15T22:50:41.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 -- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f306815a4e0 msgr2=0x7f30681414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f306815a4e0 0x7f30681414a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 -- 172.21.15.31:0/38109501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 msgr2=0x7f306813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 0x7f306813f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 -- 172.21.15.31:0/38109501 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f306814e650 con 0x7f306815df50 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3065e00640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 0x7f306813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.653+0000 7f7e17200640 1 -- 172.21.15.31:0/2861093709 shutdown_connections 2024-09-15T22:50:41.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f7e17200640 1 -- 172.21.15.31:0/2861093709 wait complete. 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f3066800640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f306000c7a0 tx=0x7f306000cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060016020 con 0x7f306815df50 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3060006db0 con 0x7f306815df50 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f306ce00640 1 -- 172.21.15.31:0/38109501 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3068141df0 con 0x7f306815df50 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060003bf0 con 0x7f306815df50 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f306ce00640 1 -- 172.21.15.31:0/38109501 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f30680973e0 con 0x7f306815df50 2024-09-15T22:50:41.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f4807e00640 1 --2- 172.21.15.31:0/233640916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072870 0x7f48080ce400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48080b31f0 tx=0x7f480001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5efb64a219546ca server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f7e17200640 1 Processor -- start 2024-09-15T22:50:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7fca95600640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 0x7fca78069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f7e17200640 1 -- start start 2024-09-15T22:50:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fca8c120c00 con 0x7fca90006be0 2024-09-15T22:50:41.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7fca9d000640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 0x7fca78069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.657+0000 7f4806000640 1 -- 172.21.15.31:0/233640916 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48000b4070 con 0x7f4808072870 2024-09-15T22:50:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f4806000640 1 -- 172.21.15.31:0/233640916 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48000af600 con 0x7f4808072870 2024-09-15T22:50:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f4806000640 1 -- 172.21.15.31:0/233640916 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48000af9b0 con 0x7f4808072870 2024-09-15T22:50:41.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f306ce00640 1 -- 172.21.15.31:0/38109501 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30680b19e0 con 0x7f306815df50 2024-09-15T22:50:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 0x7f7e180b3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f003ea00640 1 --2- 172.21.15.31:0/5798825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 0x7f00400b6310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0038009dc0 tx=0x7f003801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6efd8735517b300f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 0x7f7e180b3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 0x7f7e180b3160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39320/0 (socket says 172.21.15.31:39320) 2024-09-15T22:50:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f003e000640 1 -- 172.21.15.31:0/5798825 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380b2070 con 0x7f00400b5ef0 2024-09-15T22:50:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f003e000640 1 -- 172.21.15.31:0/5798825 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00380a5800 con 0x7f00400b5ef0 2024-09-15T22:50:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f003e000640 1 -- 172.21.15.31:0/5798825 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00380a5bd0 con 0x7f00400b5ef0 2024-09-15T22:50:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 -- 172.21.15.31:0/233640916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072870 msgr2=0x7f48080ce400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 --2- 172.21.15.31:0/233640916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072870 0x7f48080ce400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f48080b31f0 tx=0x7f480001f130 comp rx=0 tx=0).stop 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7fca9d000640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 0x7fca78069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca900e5950 tx=0x7fca84008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57240/0 (socket says 172.21.15.31:57240) 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e1809de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1806be40 con 0x7f7e1806ef80 2024-09-15T22:50:41.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1806bcc0 con 0x7f7e180b51d0 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e17200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1806bfc0 con 0x7f7e18158c90 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15e00640 1 -- 172.21.15.31:0/708150425 learned_addr learned my addr 172.21.15.31:0/708150425 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fab0c0be070 con 0x7fab040039f0 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 -- 172.21.15.31:0/233640916 shutdown_connections 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 --2- 172.21.15.31:0/233640916 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4808072870 0x7f48080ce400 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 --2- 172.21.15.31:0/233640916 >> v2:172.21.15.102:3300/0 conn(0x7f480815a5f0 0x7f48080b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 -- 172.21.15.31:0/233640916 >> 172.21.15.31:0/233640916 conn(0x7f4808067e00 msgr2=0x7f480806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f306000a850 con 0x7f306815df50 2024-09-15T22:50:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e16800640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e1809de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 -- 172.21.15.31:0/5798825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 msgr2=0x7f00400b6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 --2- 172.21.15.31:0/5798825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 0x7f00400b6310 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f0038009dc0 tx=0x7f003801c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 -- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 msgr2=0x7f7e1809de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e1809de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 -- 172.21.15.31:0/708150425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 msgr2=0x7f7e180b3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 0x7f7e180b3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 -- 172.21.15.31:0/708150425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e180cf1b0 con 0x7f7e180b51d0 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 -- 172.21.15.31:0/233640916 shutdown_connections 2024-09-15T22:50:41.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e15400640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c10 tx=0x7f7e0400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 -- 172.21.15.31:0/5798825 shutdown_connections 2024-09-15T22:50:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 --2- 172.21.15.31:0/5798825 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00400b5ef0 0x7f00400b6310 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 -- 172.21.15.31:0/5798825 >> 172.21.15.31:0/5798825 conn(0x7f004006bcc0 msgr2=0x7f004006c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e040074e0 con 0x7f7e180b51d0 2024-09-15T22:50:41.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fca8c0ad020 con 0x7fca90006be0 2024-09-15T22:50:41.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f480e800640 1 -- 172.21.15.31:0/233640916 wait complete. 2024-09-15T22:50:41.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f0046000640 1 -- 172.21.15.31:0/5798825 shutdown_connections 2024-09-15T22:50:41.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f0046000640 1 -- 172.21.15.31:0/5798825 wait complete. 2024-09-15T22:50:41.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04007680 con 0x7f7e180b51d0 2024-09-15T22:50:41.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.661+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04004a30 con 0x7f7e180b51d0 2024-09-15T22:50:41.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f305e000640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 0x7f3048069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3060085bb0 con 0x7f306815df50 2024-09-15T22:50:41.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f3065e00640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 0x7f3048069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e180b3840 con 0x7f7e180b51d0 2024-09-15T22:50:41.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e180cf700 con 0x7f7e180b51d0 2024-09-15T22:50:41.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f480e800640 1 Processor -- start 2024-09-15T22:50:41.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f0046000640 1 Processor -- start 2024-09-15T22:50:41.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f3065e00640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 0x7f3048069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3058009ba0 tx=0x7f3058008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f0046000640 1 -- start start 2024-09-15T22:50:41.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f480e800640 1 -- start start 2024-09-15T22:50:41.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.665+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e180cf900 con 0x7f7e180b51d0 2024-09-15T22:50:41.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00400b5ef0 0x7f004014aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 0x7f00400ac580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f004015a0a0 con 0x7f00400cd860 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f004006e790 con 0x7f00400b5ef0 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f004015a220 con 0x7f0040159cc0 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4808072870 0x7f480814faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53906/0 (socket says 172.21.15.31:53906) 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 -- 172.21.15.31:0/546429377 learned_addr learned my addr 172.21.15.31:0/546429377 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f480815a5f0 0x7f4808144fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f48080b4830 con 0x7f480815a5f0 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f48080b4550 con 0x7f48080b5490 2024-09-15T22:50:41.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f480e800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f48080ccd70 con 0x7f4808072870 2024-09-15T22:50:41.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3060020020 con 0x7f306815df50 2024-09-15T22:50:41.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003ea00640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 0x7f00400ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57258/0 (socket says 172.21.15.31:57258) 2024-09-15T22:50:41.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 -- 172.21.15.31:0/3842392657 learned_addr learned my addr 172.21.15.31:0/3842392657 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 -- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00400b5ef0 msgr2=0x7f004014aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00400b5ef0 0x7f004014aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 -- 172.21.15.31:0/546429377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 msgr2=0x7f00400ac580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 0x7f00400ac580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 -- 172.21.15.31:0/546429377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0040158680 con 0x7f0040159cc0 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003ea00640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 0x7f00400ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:41.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7e04011070 con 0x7f7e180b51d0 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 -- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4808072870 msgr2=0x7f480814faa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4808072870 0x7f480814faa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 -- 172.21.15.31:0/3842392657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f480815a5f0 msgr2=0x7f4808144fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f480815a5f0 0x7f4808144fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 -- 172.21.15.31:0/3842392657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f480814b740 con 0x7f48080b5490 2024-09-15T22:50:41.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f4806a00640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c450 tx=0x7f47f400c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f003fe00640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c3f0 tx=0x7f002c00c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c017070 con 0x7f0040159cc0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f002c005cf0 con 0x7f0040159cc0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f002c007310 con 0x7f0040159cc0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0040157970 con 0x7f0040159cc0 2024-09-15T22:50:41.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0040154fb0 con 0x7f0040159cc0 2024-09-15T22:50:41.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f7e0e000640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 0x7f7df8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.669+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7e04085a30 con 0x7f7e180b51d0 2024-09-15T22:50:41.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.673+0000 7f7e15e00640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 0x7f7df8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.673+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00180052a0 con 0x7f0040159cc0 2024-09-15T22:50:41.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.673+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f002c01a070 con 0x7f0040159cc0 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.673+0000 7f7e15e00640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 0x7f7df8069e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e0801e6a0 tx=0x7f7e080a9000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4017070 con 0x7f48080b5490 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47f4005cf0 con 0x7f48080b5490 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47f4007290 con 0x7f48080b5490 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f480814b1c0 con 0x7f48080b5490 2024-09-15T22:50:41.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7e180cf900 con 0x7f7e180b51d0 2024-09-15T22:50:41.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f480814b460 con 0x7f48080b5490 2024-09-15T22:50:41.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4808070250 con 0x7f48080b5490 2024-09-15T22:50:41.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f0037400640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 0x7f0020069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f002c0851b0 con 0x7f0040159cc0 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.677+0000 7f003f400640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 0x7f0020069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f003f400640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 0x7f0020069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0030009650 tx=0x7f0030006bb0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f47f401a070 con 0x7f48080b5490 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f47ff400640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 0x7f47e8069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f002c0553f0 con 0x7f0040159cc0 2024-09-15T22:50:41.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f47f40538f0 con 0x7f48080b5490 2024-09-15T22:50:41.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f4807400640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 0x7f47e8069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f4807400640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 0x7f47e8069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f47f8006fd0 tx=0x7f47f8006b40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.681+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f47f4036020 con 0x7f48080b5490 2024-09-15T22:50:41.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.705+0000 7f4df1a00640 1 Processor -- start 2024-09-15T22:50:41.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.705+0000 7f4df1a00640 1 -- start start 2024-09-15T22:50:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 0x7f4dec16e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 0x7f4dec072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4dec072ad0 con 0x7f4dec0b4340 2024-09-15T22:50:41.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4dec16e920 con 0x7f4dec06f630 2024-09-15T22:50:41.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4df1a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0b3580 con 0x7f4dec0726a0 2024-09-15T22:50:41.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4deb400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4deb400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53926/0 (socket says 172.21.15.31:53926) 2024-09-15T22:50:41.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4deb400640 1 -- 172.21.15.31:0/285521457 learned_addr learned my addr 172.21.15.31:0/285521457 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4dea000640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 0x7f4dec072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4deaa00640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 0x7f4dec16e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.709+0000 7f4deb400640 1 -- 172.21.15.31:0/285521457 >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 msgr2=0x7f4dec16e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4deb400640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 0x7f4dec16e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4deb400640 1 -- 172.21.15.31:0/285521457 >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 msgr2=0x7f4dec072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4deb400640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 0x7f4dec072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4deb400640 1 -- 172.21.15.31:0/285521457 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec0b3860 con 0x7f4dec0726a0 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4dea000640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 0x7f4dec072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:41.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.713+0000 7f4deaa00640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 0x7f4dec16e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:41.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4deb400640 1 --2- 172.21.15.31:0/285521457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0684a0 tx=0x7f4dd801ebc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a626d3efe5af8959 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4de9600640 1 -- 172.21.15.31:0/285521457 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80b4070 con 0x7f4dec0726a0 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4de9600640 1 -- 172.21.15.31:0/285521457 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd80a7b40 con 0x7f4dec0726a0 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4de9600640 1 -- 172.21.15.31:0/285521457 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd80af440 con 0x7f4dec0726a0 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 -- 172.21.15.31:0/285521457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 msgr2=0x7f4dec0cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 --2- 172.21.15.31:0/285521457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dec0684a0 tx=0x7f4dd801ebc0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 -- 172.21.15.31:0/285521457 shutdown_connections 2024-09-15T22:50:41.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 --2- 172.21.15.31:0/285521457 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0726a0 0x7f4dec0cdf70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.31:3300/0 conn(0x7f4dec0b4340 0x7f4dec072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 --2- 172.21.15.31:0/285521457 >> v2:172.21.15.102:3300/0 conn(0x7f4dec06f630 0x7f4dec16e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 -- 172.21.15.31:0/285521457 >> 172.21.15.31:0/285521457 conn(0x7f4dec067bd0 msgr2=0x7f4dec06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:41.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 -- 172.21.15.31:0/285521457 shutdown_connections 2024-09-15T22:50:41.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.717+0000 7f4df1a00640 1 -- 172.21.15.31:0/285521457 wait complete. 2024-09-15T22:50:41.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.721+0000 7f4df1a00640 1 Processor -- start 2024-09-15T22:50:41.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.721+0000 7f4df1a00640 1 -- start start 2024-09-15T22:50:41.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.721+0000 7f4df1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dec06f630 0x7f4dec15c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.721+0000 7f4df1a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.721+0000 7f4df1a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0b4340 0x7f4dec0b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4df1a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec0b4750 con 0x7f4dec06f630 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4df1a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4dec06fa10 con 0x7f4dec0726a0 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4df1a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dec0b48d0 con 0x7f4dec0b4340 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57284/0 (socket says 172.21.15.31:57284) 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 -- 172.21.15.31:0/2096906964 learned_addr learned my addr 172.21.15.31:0/2096906964 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4deb400640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0b4340 0x7f4dec0b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4deaa00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dec06f630 0x7f4dec15c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 -- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0b4340 msgr2=0x7f4dec0b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0b4340 0x7f4dec0b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 -- 172.21.15.31:0/2096906964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dec06f630 msgr2=0x7f4dec15c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:41.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dec06f630 0x7f4dec15c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 -- 172.21.15.31:0/2096906964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dec1607f0 con 0x7f4dec0726a0 2024-09-15T22:50:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4dea000640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4de400efc0 tx=0x7f4de400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4018020 con 0x7f4dec0726a0 2024-09-15T22:50:41.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dec160ad0 con 0x7f4dec0726a0 2024-09-15T22:50:41.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dec15ec70 con 0x7f4dec0726a0 2024-09-15T22:50:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.725+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4de400ce70 con 0x7f4dec0726a0 2024-09-15T22:50:41.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.729+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de4018020 con 0x7f4dec0726a0 2024-09-15T22:50:41.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.729+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dc40052a0 con 0x7f4dec0726a0 2024-09-15T22:50:41.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.733+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4de401b020 con 0x7f4dec0726a0 2024-09-15T22:50:41.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.733+0000 7f4de2a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:41.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.733+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4de4014480 con 0x7f4dec0726a0 2024-09-15T22:50:41.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.737+0000 7f4deaa00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:41.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.737+0000 7f4deaa00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 0x7f4dcc06a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c880 tx=0x7f4ddc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:41.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:41.737+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4de4022030 con 0x7f4dec0726a0 2024-09-15T22:50:42.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff39406c680 con 0x7ff3940cff80 2024-09-15T22:50:42.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7ff390c00640 1 -- 172.21.15.31:0/2673703937 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff384055e90 con 0x7ff3940cff80 2024-09-15T22:50:42.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7f306ce00640 1 -- 172.21.15.31:0/38109501 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f306806e250 con 0x7f306815df50 2024-09-15T22:50:42.018 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-09-15T22:50:42.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7f305e000640 1 -- 172.21.15.31:0/38109501 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30600563a0 con 0x7f306815df50 2024-09-15T22:50:42.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fab200ae240 con 0x7fab040039f0 2024-09-15T22:50:42.019 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-09-15T22:50:42.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.013+0000 7fab1cc00640 1 -- 172.21.15.31:0/7799382 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab0c016b10 con 0x7fab040039f0 2024-09-15T22:50:42.019 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 msgr2=0x7ff374069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 0x7ff374069f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff38c003fd0 tx=0x7ff38c009970 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 msgr2=0x7ff394165db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 0x7ff394165db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff38400c3e0 tx=0x7ff38400c8a0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 shutdown_connections 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff374067ac0 0x7ff374069f80 secure :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff38c003fd0 tx=0x7ff38c009970 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff39415e550 0x7ff39409ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff3940cff80 0x7ff394165db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 --2- 172.21.15.31:0/2673703937 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff3940af710 0x7ff394153dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 >> 172.21.15.31:0/2673703937 conn(0x7ff39406be90 msgr2=0x7ff39415cf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 msgr2=0x7f3048069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 0x7f3048069db0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f3058009ba0 tx=0x7f3058008040 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 msgr2=0x7f306814a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f306000c7a0 tx=0x7f306000cc60 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 shutdown_connections 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30480678f0 0x7f3048069db0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f306815df50 0x7f306814a190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f306815a4e0 0x7f30681414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 --2- 172.21.15.31:0/38109501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30680b3590 0x7f306813f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 >> 172.21.15.31:0/38109501 conn(0x7f30680b1d50 msgr2=0x7f306814df40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fca900ede20 con 0x7fca90006be0 2024-09-15T22:50:42.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 msgr2=0x7fab00069f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 0x7fab00069f80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab20147ea0 tx=0x7fab10007dc0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 msgr2=0x7fab20147180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab0c0019a0 tx=0x7fab04005840 comp rx=0 tx=0).stop 2024-09-15T22:50:42.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 shutdown_connections 2024-09-15T22:50:42.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7f3053400640 1 -- 172.21.15.31:0/38109501 wait complete. 2024-09-15T22:50:42.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fca95600640 1 -- 172.21.15.31:0/2531355258 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca8c016150 con 0x7fca90006be0 2024-09-15T22:50:42.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 shutdown_connections 2024-09-15T22:50:42.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fab00067ac0 0x7fab00069f80 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fab2015c2e0 0x7fab2015c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fab20147ac0 0x7fab2009dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 --2- 172.21.15.31:0/7799382 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fab040039f0 0x7fab20147180 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.017+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 >> 172.21.15.31:0/7799382 conn(0x7fab2006c2c0 msgr2=0x7fab20160d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.021+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 shutdown_connections 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.021+0000 7ff38a000640 1 -- 172.21.15.31:0/2673703937 wait complete. 2024-09-15T22:50:42.027 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-09-15T22:50:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.021+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 shutdown_connections 2024-09-15T22:50:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.021+0000 7fab26400640 1 -- 172.21.15.31:0/7799382 wait complete. 2024-09-15T22:50:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.021+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 msgr2=0x7fca78069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 0x7fca78069e50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fca900e5950 tx=0x7fca84008040 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 msgr2=0x7fca900d9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fca8c01abe0 tx=0x7fca8c0192d0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 shutdown_connections 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fca78067990 0x7fca78069e50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fca900dcce0 0x7fca90038fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fca9004fcd0 0x7fca90039d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 --2- 172.21.15.31:0/2531355258 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fca90006be0 0x7fca900d9410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 >> 172.21.15.31:0/2531355258 conn(0x7fca900360a0 msgr2=0x7fca900e1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 shutdown_connections 2024-09-15T22:50:42.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.025+0000 7fca9ee00640 1 -- 172.21.15.31:0/2531355258 wait complete. 2024-09-15T22:50:42.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.033+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f7e1815c6f0 con 0x7f7e180b51d0 2024-09-15T22:50:42.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.033+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f0018005860 con 0x7f0040159cc0 2024-09-15T22:50:42.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.033+0000 7f7e0e000640 1 -- 172.21.15.31:0/708150425 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e040562a0 con 0x7f7e180b51d0 2024-09-15T22:50:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.033+0000 7f0037400640 1 -- 172.21.15.31:0/546429377 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f002c0596f0 con 0x7f0040159cc0 2024-09-15T22:50:42.040 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-09-15T22:50:42.044 INFO:teuthology.orchestra.run.smithi031.stdout:60129542152 2024-09-15T22:50:42.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f48080ccb50 con 0x7f48080b5490 2024-09-15T22:50:42.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 msgr2=0x7f7df8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 0x7f7df8069e50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f7e0801e6a0 tx=0x7f7e080a9000 comp rx=0 tx=0).stop 2024-09-15T22:50:42.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 msgr2=0x7f7e18156d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e04000c10 tx=0x7f7e0400c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 shutdown_connections 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7df8067990 0x7f7df8069e50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7e18158c90 0x7f7e1809de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7e180b51d0 0x7f7e18156d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 --2- 172.21.15.31:0/708150425 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7e1806ef80 0x7f7e180b3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 >> 172.21.15.31:0/708150425 conn(0x7f7e1809aa40 msgr2=0x7f7e18159be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 shutdown_connections 2024-09-15T22:50:42.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f7e17200640 1 -- 172.21.15.31:0/708150425 wait complete. 2024-09-15T22:50:42.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 msgr2=0x7f0020069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 0x7f0020069d80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0030009650 tx=0x7f0030006bb0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f47ff400640 1 -- 172.21.15.31:0/3842392657 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f47f4055f50 con 0x7f48080b5490 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 msgr2=0x7f0040156e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f002c00c3f0 tx=0x7f002c00c8b0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 shutdown_connections 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f00200678c0 0x7f0020069d80 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0040159cc0 0x7f0040156e00 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00400cd860 0x7f00400ac580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 --2- 172.21.15.31:0/546429377 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f00400b5ef0 0x7f004014aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 >> 172.21.15.31:0/546429377 conn(0x7f004006bcc0 msgr2=0x7f00400ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 shutdown_connections 2024-09-15T22:50:42.048 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.041+0000 7f0046000640 1 -- 172.21.15.31:0/546429377 wait complete. 2024-09-15T22:50:42.049 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:42.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.053+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 msgr2=0x7f47e8069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.053+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 0x7f47e8069dd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f47f8006fd0 tx=0x7f47f8006b40 comp rx=0 tx=0).stop 2024-09-15T22:50:42.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.053+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 msgr2=0x7f4808150800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.053+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f47f400c450 tx=0x7f47f400c910 comp rx=0 tx=0).stop 2024-09-15T22:50:42.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 shutdown_connections 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f47e8067910 0x7f47e8069dd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f480815a5f0 0x7f4808144fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f48080b5490 0x7f4808150800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 --2- 172.21.15.31:0/3842392657 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4808072870 0x7f480814faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 >> 172.21.15.31:0/3842392657 conn(0x7f4808067e00 msgr2=0x7f48080cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 shutdown_connections 2024-09-15T22:50:42.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.057+0000 7f480e800640 1 -- 172.21.15.31:0/3842392657 wait complete. 2024-09-15T22:50:42.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.3 2024-09-15T22:50:42.064 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.5 2024-09-15T22:50:42.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.0 2024-09-15T22:50:42.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.4 2024-09-15T22:50:42.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.073+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f4dc4005860 con 0x7f4dec0726a0 2024-09-15T22:50:42.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.7 2024-09-15T22:50:42.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.073+0000 7f4de2a00640 1 -- 172.21.15.31:0/2096906964 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4de4010040 con 0x7f4dec0726a0 2024-09-15T22:50:42.080 INFO:teuthology.orchestra.run.smithi031.stdout:60129542151 2024-09-15T22:50:42.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542152 for osd.1 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 msgr2=0x7f4dcc06a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 0x7f4dcc06a180 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc00c880 tx=0x7f4ddc008040 comp rx=0 tx=0).stop 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 msgr2=0x7f4dec20e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f4de400efc0 tx=0x7f4de400c490 comp rx=0 tx=0).stop 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 shutdown_connections 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4dcc067cc0 0x7f4dcc06a180 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dec0b4340 0x7f4dec0b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dec0726a0 0x7f4dec20e2b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 --2- 172.21.15.31:0/2096906964 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dec06f630 0x7f4dec15c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 >> 172.21.15.31:0/2096906964 conn(0x7f4dec067bd0 msgr2=0x7f4dec16d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 shutdown_connections 2024-09-15T22:50:42.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:42.077+0000 7f4df1a00640 1 -- 172.21.15.31:0/2096906964 wait complete. 2024-09-15T22:50:42.087 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542153 for osd.2 2024-09-15T22:50:42.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542151 for osd.6 2024-09-15T22:50:43.063 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-15T22:50:43.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-15T22:50:43.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-15T22:50:43.074 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-15T22:50:43.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-15T22:50:43.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-15T22:50:43.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-15T22:50:43.103 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-15T22:50:43.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.281+0000 7f0ac5800640 1 Processor -- start 2024-09-15T22:50:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.281+0000 7ff3a0e00640 1 Processor -- start 2024-09-15T22:50:43.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.281+0000 7ff3a0e00640 1 -- start start 2024-09-15T22:50:43.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.281+0000 7f0ac5800640 1 -- start start 2024-09-15T22:50:43.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0ac5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff3a0e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff394033870 0x7ff394006f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abe000640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0ac00d1a10 0x7f0ac00b14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52644/0 (socket says 172.21.15.31:52644) 2024-09-15T22:50:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53950/0 (socket says 172.21.15.31:53950) 2024-09-15T22:50:43.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff3a0e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 0x7ff3940de200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abe000640 1 -- 172.21.15.31:0/1990245386 learned_addr learned my addr 172.21.15.31:0/1990245386 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff3a0e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff394033c50 con 0x7ff394039260 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff3a0e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff3940554b0 con 0x7ff394033870 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff3a0e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff394039820 con 0x7ff394036740 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac00b1bb0 con 0x7f0ac00d4440 2024-09-15T22:50:43.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ac00d2200 con 0x7f0ac00d1a10 2024-09-15T22:50:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac00d2b30 con 0x7f0ac01628f0 2024-09-15T22:50:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39be00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 0x7ff3940de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39aa00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7ff394039260 0x7ff394036030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52648/0 (socket says 172.21.15.31:52648) 2024-09-15T22:50:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39aa00640 1 -- 172.21.15.31:0/3629445040 learned_addr learned my addr 172.21.15.31:0/3629445040 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39b400640 1 --2- 172.21.15.31:0/3629445040 >> v2:172.21.15.31:3300/0 conn(0x7ff394033870 0x7ff394006f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39be00640 1 -- 172.21.15.31:0/3629445040 >> v2:172.21.15.31:3300/0 conn(0x7ff394033870 msgr2=0x7ff394006f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39be00640 1 --2- 172.21.15.31:0/3629445040 >> v2:172.21.15.31:3300/0 conn(0x7ff394033870 0x7ff394006f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39be00640 1 -- 172.21.15.31:0/3629445040 >> v1:172.21.15.102:6789/0 conn(0x7ff394039260 legacy=0x7ff394036030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7ff39be00640 1 -- 172.21.15.31:0/3629445040 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff394039b00 con 0x7ff394036740 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abea00640 1 -- 172.21.15.31:0/1990245386 >> v1:172.21.15.102:6789/0 conn(0x7f0ac00d1a10 legacy=0x7f0ac00b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abea00640 1 -- 172.21.15.31:0/1990245386 >> v1:172.21.15.31:6789/0 conn(0x7f0ac00d4440 legacy=0x7f0ac00d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.285+0000 7f0abea00640 1 -- 172.21.15.31:0/1990245386 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac00d24e0 con 0x7f0ac01628f0 2024-09-15T22:50:43.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff39be00640 1 --2- 172.21.15.31:0/3629445040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 0x7ff3940de200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff39c050e10 tx=0x7ff39c098430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=878c0fe95aa32aee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7f0abea00640 1 --2- 172.21.15.31:0/1990245386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009dc0 tx=0x7f0ab801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2661437fdda86c05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff39a000640 1 -- 172.21.15.31:0/3629445040 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c12c070 con 0x7ff394036740 2024-09-15T22:50:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff39a000640 1 -- 172.21.15.31:0/3629445040 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c06de50 con 0x7ff394036740 2024-09-15T22:50:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff39a000640 1 -- 172.21.15.31:0/3629445040 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c1278c0 con 0x7ff394036740 2024-09-15T22:50:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3629445040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 msgr2=0x7ff3940de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3629445040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 0x7ff3940de200 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff39c050e10 tx=0x7ff39c098430 comp rx=0 tx=0).stop 2024-09-15T22:50:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7f0abd600640 1 -- 172.21.15.31:0/1990245386 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80b2070 con 0x7f0ac01628f0 2024-09-15T22:50:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7f0abd600640 1 -- 172.21.15.31:0/1990245386 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ab80a5960 con 0x7f0ac01628f0 2024-09-15T22:50:43.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7f0abd600640 1 -- 172.21.15.31:0/1990245386 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ab80b2070 con 0x7f0ac01628f0 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3629445040 shutdown_connections 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3629445040 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394036740 0x7ff3940de200 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3629445040 >> v2:172.21.15.31:3300/0 conn(0x7ff394033870 0x7ff394006f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3629445040 >> 172.21.15.31:0/3629445040 conn(0x7ff39401d940 msgr2=0x7ff3940545b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3629445040 shutdown_connections 2024-09-15T22:50:43.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.293+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3629445040 wait complete. 2024-09-15T22:50:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 msgr2=0x7f0ac00cf6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 --2- 172.21.15.31:0/1990245386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0ab8009dc0 tx=0x7f0ab801c9b0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 shutdown_connections 2024-09-15T22:50:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 --2- 172.21.15.31:0/1990245386 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac01628f0 0x7f0ac00cf6b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 >> 172.21.15.31:0/1990245386 conn(0x7f0ac009d840 msgr2=0x7f0ac008bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7ff3a0e00640 1 Processor -- start 2024-09-15T22:50:43.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 shutdown_connections 2024-09-15T22:50:43.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7f0ac5800640 1 -- 172.21.15.31:0/1990245386 wait complete. 2024-09-15T22:50:43.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.297+0000 7ff3a0e00640 1 -- start start 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 0x7ff3940e9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff394036740 0x7ff39404a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 0x7ff3940dcf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff394052550 con 0x7ff394033870 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff3940523d0 con 0x7ff394036740 2024-09-15T22:50:43.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff3a0e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff3940526d0 con 0x7ff394039260 2024-09-15T22:50:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 0x7ff3940e9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 0x7ff3940e9e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39366/0 (socket says 172.21.15.31:39366) 2024-09-15T22:50:43.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39b400640 1 -- 172.21.15.31:0/3326727066 learned_addr learned my addr 172.21.15.31:0/3326727066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39aa00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff394036740 0x7ff39404a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 0x7ff3940dcf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 -- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff394036740 msgr2=0x7ff39404a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff394036740 0x7ff39404a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 -- 172.21.15.31:0/3326727066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 msgr2=0x7ff3940e9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 0x7ff3940e9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 -- 172.21.15.31:0/3326727066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39404cb50 con 0x7ff394039260 2024-09-15T22:50:43.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7f0ac5800640 1 Processor -- start 2024-09-15T22:50:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7f0ac5800640 1 -- start start 2024-09-15T22:50:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7ff39be00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 0x7ff3940dcf40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff39c076f60 tx=0x7ff39c096cc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.301+0000 7f0ac5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac00d1a10 0x7f0ac01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 0x7f0ac0165670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac0170fa0 con 0x7f0ac00d1a10 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ac00d4c80 con 0x7f0ac01628f0 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ac0171120 con 0x7f0ac00d4440 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abf400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 0x7f0ac0165670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abf400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 0x7f0ac0165670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57294/0 (socket says 172.21.15.31:57294) 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53974/0 (socket says 172.21.15.31:53974) 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abf400640 1 -- 172.21.15.31:0/171858423 learned_addr learned my addr 172.21.15.31:0/171858423 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abea00640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac00d1a10 0x7f0ac01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c12c050 con 0x7ff394039260 2024-09-15T22:50:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff39c12d040 con 0x7ff394039260 2024-09-15T22:50:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff39c133650 con 0x7ff394039260 2024-09-15T22:50:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 -- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 msgr2=0x7f0ac0165670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 0x7f0ac0165670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 -- 172.21.15.31:0/171858423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac00d1a10 msgr2=0x7f0ac01544c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac00d1a10 0x7f0ac01544c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 -- 172.21.15.31:0/171858423 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ac0163c70 con 0x7f0ac00d4440 2024-09-15T22:50:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39404ce30 con 0x7ff394039260 2024-09-15T22:50:43.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0abe000640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c3c0 tx=0x7f0aac00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39404d3f0 con 0x7ff394039260 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac017070 con 0x7f0ac00d4440 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0aac005d10 con 0x7f0ac00d4440 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ac00b4bd0 con 0x7f0ac00d4440 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0aac007310 con 0x7f0ac00d4440 2024-09-15T22:50:43.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.305+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ac00b5190 con 0x7f0ac00d4440 2024-09-15T22:50:43.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.309+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff394006f50 con 0x7ff394039260 2024-09-15T22:50:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.309+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff39c13a030 con 0x7ff394039260 2024-09-15T22:50:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.309+0000 7ff38f400640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 0x7ff37c069e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0aac01a070 con 0x7f0ac00d4440 2024-09-15T22:50:43.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ac00cf6b0 con 0x7f0ac00d4440 2024-09-15T22:50:43.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff39c13de00 con 0x7ff394039260 2024-09-15T22:50:43.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7ff39b400640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 0x7ff37c069e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7ff39b400640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 0x7ff37c069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff390005fd0 tx=0x7ff390005da0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7f0ab6a00640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 0x7f0aa0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0aac0852e0 con 0x7f0ac00d4440 2024-09-15T22:50:43.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.313+0000 7f0abea00640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 0x7f0aa0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.317+0000 7f0abea00640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 0x7f0aa0069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80af000 tx=0x7f0ab80a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.317+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff39c141020 con 0x7ff394039260 2024-09-15T22:50:43.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.321+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0aac0553f0 con 0x7f0ac00d4440 2024-09-15T22:50:43.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.361+0000 7fb9aa600640 1 Processor -- start 2024-09-15T22:50:43.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.361+0000 7fb9aa600640 1 -- start start 2024-09-15T22:50:43.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 Processor -- start 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 -- start start 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9aa600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9aa600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb99c009b00 0x7fb99c009fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9aa600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb99c01dea0 con 0x7fb99c0338c0 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9aa600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb99c00bac0 con 0x7fb99c009b00 2024-09-15T22:50:43.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9aa600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c01d0e0 con 0x7fb99c04eb70 2024-09-15T22:50:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a3e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fb99c0338c0 0x7fb99c04ef50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52664/0 (socket says 172.21.15.31:52664) 2024-09-15T22:50:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:53980/0 (socket says 172.21.15.31:53980) 2024-09-15T22:50:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a3e00640 1 -- 172.21.15.31:0/791035095 learned_addr learned my addr 172.21.15.31:0/791035095 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9c00640 1 --2- 172.21.15.31:0/791035095 >> v2:172.21.15.102:3300/0 conn(0x7fb99c009b00 0x7fb99c009fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 -- 172.21.15.31:0/791035095 >> v2:172.21.15.102:3300/0 conn(0x7fb99c009b00 msgr2=0x7fb99c009fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 --2- 172.21.15.31:0/791035095 >> v2:172.21.15.102:3300/0 conn(0x7fb99c009b00 0x7fb99c009fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 -- 172.21.15.31:0/791035095 >> v1:172.21.15.102:6789/0 conn(0x7fb99c0338c0 legacy=0x7fb99c04ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a3400640 1 -- 172.21.15.31:0/791035095 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526750257 0 0) 0x7fb99c01dea0 con 0x7fb99c0338c0 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fb9a9200640 1 -- 172.21.15.31:0/791035095 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c01d3c0 con 0x7fb99c04eb70 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 0x7fa4d8163fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa4d80b4270 0x7fa4d8164500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4d8162f60 con 0x7fa4d80b5e00 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d8163b30 con 0x7fa4d809aa40 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4dca00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa4d8166130 con 0x7fa4d80b4270 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4d5e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa4d80b5e00 0x7fa4d80b61e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58552/0 (socket says 172.21.15.31:58552) 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4d5e00640 1 -- 172.21.15.31:0/2306570629 learned_addr learned my addr 172.21.15.31:0/2306570629 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4d5400640 1 --2- 172.21.15.31:0/2306570629 >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 0x7fa4d8163fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.365+0000 7fa4d6800640 1 --2- 172.21.15.31:0/2306570629 >> v2:172.21.15.102:3300/0 conn(0x7fa4d80b4270 0x7fa4d8164500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fa4d6800640 1 -- 172.21.15.31:0/2306570629 >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 msgr2=0x7fa4d8163fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fa4d6800640 1 --2- 172.21.15.31:0/2306570629 >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 0x7fa4d8163fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fa4d6800640 1 -- 172.21.15.31:0/2306570629 >> v1:172.21.15.31:6789/0 conn(0x7fa4d80b5e00 legacy=0x7fa4d80b61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fa4d6800640 1 -- 172.21.15.31:0/2306570629 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d8163200 con 0x7fa4d80b4270 2024-09-15T22:50:43.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fa4d5400640 1 --2- 172.21.15.31:0/2306570629 >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 0x7fa4d8163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fb9a9200640 1 --2- 172.21.15.31:0/791035095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9980097a0 tx=0x7fb99801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bcd97fbde33ff5d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7efe48c00640 1 Processor -- start 2024-09-15T22:50:43.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7efe48c00640 1 -- start start 2024-09-15T22:50:43.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fbd37400640 1 Processor -- start 2024-09-15T22:50:43.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7f426c800640 1 Processor -- start 2024-09-15T22:50:43.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7fbd37400640 1 -- start start 2024-09-15T22:50:43.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.369+0000 7f426c800640 1 -- start start 2024-09-15T22:50:43.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9a3400640 1 -- 172.21.15.31:0/791035095 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980b0070 con 0x7fb99c04eb70 2024-09-15T22:50:43.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9a3400640 1 -- 172.21.15.31:0/791035095 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9980ab600 con 0x7fb99c04eb70 2024-09-15T22:50:43.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9a3400640 1 -- 172.21.15.31:0/791035095 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9980ab9d0 con 0x7fb99c04eb70 2024-09-15T22:50:43.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 -- 172.21.15.31:0/791035095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 msgr2=0x7fb99c047580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 --2- 172.21.15.31:0/791035095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb9980097a0 tx=0x7fb99801c480 comp rx=0 tx=0).stop 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 -- 172.21.15.31:0/791035095 shutdown_connections 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 --2- 172.21.15.31:0/791035095 >> v2:172.21.15.102:3300/0 conn(0x7fb99c009b00 0x7fb99c009fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 --2- 172.21.15.31:0/791035095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c04eb70 0x7fb99c047580 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 -- 172.21.15.31:0/791035095 >> 172.21.15.31:0/791035095 conn(0x7fb99c0360a0 msgr2=0x7fb99c0364b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 -- 172.21.15.31:0/791035095 shutdown_connections 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fb9aa600640 1 -- 172.21.15.31:0/791035095 wait complete. 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd37400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd3006e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd37400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 0x7fbd300b6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd37400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3006d9a0 con 0x7fbd30161b60 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd37400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbd300d2c10 con 0x7fbd300ceb50 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd37400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3006dc80 con 0x7fbd30161f40 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe48c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe440b6480 0x7efe440ca960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe48c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe4406ca40 con 0x7efe44161b60 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe48c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe440b2800 con 0x7efe440b4270 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe48c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efe440b2ae0 con 0x7efe440b6480 2024-09-15T22:50:43.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd35400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 0x7fbd300b6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd2fe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd3006e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd35400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 0x7fbd300b6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57320/0 (socket says 172.21.15.31:57320) 2024-09-15T22:50:43.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe440b6480 0x7efe440ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7f426c800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 0x7f4264072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7f426c800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4264163fb0 con 0x7f42641628d0 2024-09-15T22:50:43.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7f426c800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4264163430 con 0x7f42640726a0 2024-09-15T22:50:43.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7f426c800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f42640cdf70 con 0x7f4264162cb0 2024-09-15T22:50:43.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd35400640 1 -- 172.21.15.31:0/2335108863 learned_addr learned my addr 172.21.15.31:0/2335108863 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe440b6480 0x7efe440ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57326/0 (socket says 172.21.15.31:57326) 2024-09-15T22:50:43.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 -- 172.21.15.31:0/3207561051 learned_addr learned my addr 172.21.15.31:0/3207561051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fa4d6800640 1 --2- 172.21.15.31:0/2306570629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d80b4270 0x7fa4d8164500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80729f0 tx=0x7fa4d001c930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb2671c96591841 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 -- 172.21.15.31:0/3207561051 >> v1:172.21.15.102:6789/0 conn(0x7efe440b4270 legacy=0x7efe440caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd2fe00640 1 -- 172.21.15.31:0/2335108863 >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 msgr2=0x7fbd300b6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd2fe00640 1 --2- 172.21.15.31:0/2335108863 >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 0x7fbd300b6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd2fe00640 1 -- 172.21.15.31:0/2335108863 >> v1:172.21.15.31:6789/0 conn(0x7fbd30161b60 legacy=0x7fbd300b5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 -- 172.21.15.31:0/3207561051 >> v1:172.21.15.31:6789/0 conn(0x7efe44161b60 legacy=0x7efe440b5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7efe41400640 1 -- 172.21.15.31:0/3207561051 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe4406c6d0 con 0x7efe440b6480 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4269e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f42641628d0 0x7f426406f640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58572/0 (socket says 172.21.15.31:58572) 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4269e00640 1 -- 172.21.15.31:0/2265114639 learned_addr learned my addr 172.21.15.31:0/2265114639 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 Processor -- start 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fa4d4a00640 1 -- 172.21.15.31:0/2306570629 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00b2070 con 0x7fa4d80b4270 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fa4d4a00640 1 -- 172.21.15.31:0/2306570629 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4d00a58e0 con 0x7fa4d80b4270 2024-09-15T22:50:43.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fa4d4a00640 1 -- 172.21.15.31:0/2306570629 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4d00a5cb0 con 0x7fa4d80b4270 2024-09-15T22:50:43.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 -- start start 2024-09-15T22:50:43.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4269400640 1 --2- 172.21.15.31:0/2265114639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 0x7f4264072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 0x7fb99c0d6610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 0x7fb99c0de3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 0x7fb99c039b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c0f3b30 con 0x7fb99c04eb70 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb99c0f39b0 con 0x7fb99c009b00 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9aa600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb99c0f3cb0 con 0x7fb99c0338c0 2024-09-15T22:50:43.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.373+0000 7fbd2fe00640 1 -- 172.21.15.31:0/2335108863 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3006df60 con 0x7fbd30161f40 2024-09-15T22:50:43.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9a9200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 0x7fb99c0d6610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9a9200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 0x7fb99c0d6610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57336/0 (socket says 172.21.15.31:57336) 2024-09-15T22:50:43.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fb9a9200640 1 -- 172.21.15.31:0/2773307173 learned_addr learned my addr 172.21.15.31:0/2773307173 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fa4dca00640 1 -- 172.21.15.31:0/2306570629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d80b4270 msgr2=0x7fa4d8164500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7fa4dca00640 1 --2- 172.21.15.31:0/2306570629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d80b4270 0x7fa4d8164500 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80729f0 tx=0x7fa4d001c930 comp rx=0 tx=0).stop 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 -- 172.21.15.31:0/2306570629 shutdown_connections 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 --2- 172.21.15.31:0/2306570629 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d80b4270 0x7fa4d8164500 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 --2- 172.21.15.31:0/2306570629 >> v2:172.21.15.31:3300/0 conn(0x7fa4d809aa40 0x7fa4d8163fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 -- 172.21.15.31:0/2306570629 >> 172.21.15.31:0/2306570629 conn(0x7fa4d8073540 msgr2=0x7fa4d80b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 -- 172.21.15.31:0/2306570629 shutdown_connections 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 0x7fb99c0de3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a9c00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 0x7fb99c039b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 -- 172.21.15.31:0/2306570629 wait complete. 2024-09-15T22:50:43.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 -- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 msgr2=0x7fb99c0d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 0x7fb99c0d6610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 -- 172.21.15.31:0/2773307173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 msgr2=0x7fb99c039b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 0x7fb99c039b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 -- 172.21.15.31:0/2773307173 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99c04b720 con 0x7fb99c0338c0 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a9c00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 0x7fb99c039b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105447770 0 0) 0x7f4264163fb0 con 0x7f42641628d0 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f424c003530 con 0x7f42641628d0 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914406423 0 0) 0x7f4264163430 con 0x7f42640726a0 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.377+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4264163fb0 con 0x7f42640726a0 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f4269400640 1 -- 172.21.15.31:0/2265114639 >> v1:172.21.15.102:6789/0 conn(0x7f42640726a0 legacy=0x7f42640ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f4269400640 1 -- 172.21.15.31:0/2265114639 >> v1:172.21.15.31:6789/0 conn(0x7f42641628d0 legacy=0x7f426406f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f4269400640 1 -- 172.21.15.31:0/2265114639 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4264163710 con 0x7f4264162cb0 2024-09-15T22:50:43.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fbd2fe00640 1 --2- 172.21.15.31:0/2335108863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd3006e240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097c0 tx=0x7fbd2001c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f26fc573c65d3a59 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a3e00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 0x7fb99c0de3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c3e0 tx=0x7fb99000c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9900074e0 con 0x7fb99c0338c0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9900047f0 con 0x7fb99c0338c0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb990007680 con 0x7fb99c0338c0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb99c04ba00 con 0x7fb99c0338c0 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea9400640 1 Processor -- start 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea9400640 1 -- start start 2024-09-15T22:50:43.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea9400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb99c04bfc0 con 0x7fb99c0338c0 2024-09-15T22:50:43.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:54032/0 (socket says 172.21.15.31:54032) 2024-09-15T22:50:43.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea3400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2ea415b140 0x7f2ea406e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58600/0 (socket says 172.21.15.31:58600) 2024-09-15T22:50:43.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea3e00640 1 -- 172.21.15.31:0/148310384 learned_addr learned my addr 172.21.15.31:0/148310384 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb99c009fb0 con 0x7fb99c0338c0 2024-09-15T22:50:43.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fbd2f400640 1 -- 172.21.15.31:0/2335108863 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200b1070 con 0x7fbd30161f40 2024-09-15T22:50:43.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fbd2f400640 1 -- 172.21.15.31:0/2335108863 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200ac410 con 0x7fbd30161f40 2024-09-15T22:50:43.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fbd2f400640 1 -- 172.21.15.31:0/2335108863 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200ac7e0 con 0x7fbd30161f40 2024-09-15T22:50:43.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7fa4dca00640 1 Processor -- start 2024-09-15T22:50:43.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.381+0000 7f2ea9400640 1 --2- 172.21.15.31:0/148310384 >> v2:172.21.15.31:3300/0 conn(0x7f2ea406fe20 0x7f2ea406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 -- 172.21.15.31:0/2335108863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 msgr2=0x7fbd3006e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 --2- 172.21.15.31:0/2335108863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd3006e240 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fbd200097c0 tx=0x7fbd2001c3d0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea8a00640 1 --2- 172.21.15.31:0/148310384 >> v2:172.21.15.31:3300/0 conn(0x7f2ea406fe20 0x7f2ea406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 -- 172.21.15.31:0/2335108863 shutdown_connections 2024-09-15T22:50:43.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 --2- 172.21.15.31:0/2335108863 >> v2:172.21.15.102:3300/0 conn(0x7fbd300ceb50 0x7fbd300b6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 --2- 172.21.15.31:0/2335108863 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd3006e240 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 -- 172.21.15.31:0/2335108863 >> 172.21.15.31:0/2335108863 conn(0x7fbd300d4500 msgr2=0x7fbd300d4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ea406f6e0 con 0x7f2ea415b140 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2ea415baa0 con 0x7f2ea406fe20 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea415bd40 con 0x7f2ea415a820 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2518211040 0 0) 0x7f2ea406f6e0 con 0x7f2ea415b140 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e88003530 con 0x7f2ea415b140 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea3e00640 1 -- 172.21.15.31:0/148310384 >> v2:172.21.15.31:3300/0 conn(0x7f2ea406fe20 msgr2=0x7f2ea406f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea3e00640 1 --2- 172.21.15.31:0/148310384 >> v2:172.21.15.31:3300/0 conn(0x7f2ea406fe20 0x7f2ea406f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea3e00640 1 -- 172.21.15.31:0/148310384 >> v1:172.21.15.31:6789/0 conn(0x7f2ea415b140 legacy=0x7f2ea406e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1599123067 0 0) 0x7f2e88003530 con 0x7f2ea415b140 2024-09-15T22:50:43.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f2ea3e00640 1 -- 172.21.15.31:0/148310384 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea415c020 con 0x7f2ea415a820 2024-09-15T22:50:43.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 -- 172.21.15.31:0/2335108863 shutdown_connections 2024-09-15T22:50:43.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7fbd37400640 1 -- 172.21.15.31:0/2335108863 wait complete. 2024-09-15T22:50:43.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7efe41400640 1 --2- 172.21.15.31:0/3207561051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe440ca960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe440cbdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=613fac0fb17556fa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.385+0000 7f4269400640 1 --2- 172.21.15.31:0/2265114639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 0x7f4264072160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42580097f0 tx=0x7f425801c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47208a9036510d2e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe40a00640 1 -- 172.21.15.31:0/3207561051 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300b1070 con 0x7efe440b6480 2024-09-15T22:50:43.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe40a00640 1 -- 172.21.15.31:0/3207561051 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe300a8050 con 0x7efe440b6480 2024-09-15T22:50:43.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe40a00640 1 -- 172.21.15.31:0/3207561051 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe300ac860 con 0x7efe440b6480 2024-09-15T22:50:43.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 -- start start 2024-09-15T22:50:43.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb990011070 con 0x7fb99c0338c0 2024-09-15T22:50:43.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 Processor -- start 2024-09-15T22:50:43.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea3e00640 1 --2- 172.21.15.31:0/148310384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c008c80 tx=0x7f2e9c020fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32560d6215b9bb42 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 -- start start 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90001680 con 0x7f2ea415a820 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e9c0a9cf0 con 0x7f2ea415a820 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea2a00640 1 -- 172.21.15.31:0/148310384 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e9c00a2d0 con 0x7f2ea415a820 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 -- 172.21.15.31:0/3207561051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 msgr2=0x7efe440ca960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 --2- 172.21.15.31:0/3207561051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe440ca960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7efe30009870 tx=0x7efe440cbdc0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a0c00640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 0x7fb984069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580b0070 con 0x7f4264162cb0 2024-09-15T22:50:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42580ab600 con 0x7f4264162cb0 2024-09-15T22:50:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f4268a00640 1 -- 172.21.15.31:0/2265114639 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42580ab9d0 con 0x7f4264162cb0 2024-09-15T22:50:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb990085c20 con 0x7fb99c0338c0 2024-09-15T22:50:43.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 -- 172.21.15.31:0/3207561051 shutdown_connections 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 0x7fa4d8156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 0x7fa4d815cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 msgr2=0x7f2ea415ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7f2ea9400640 1 --2- 172.21.15.31:0/148310384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c008c80 tx=0x7f2e9c020fd0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d816f410 con 0x7fa4d80b4270 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4d80b2db0 con 0x7fa4d809aa40 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4dca00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4d816f590 con 0x7fa4d80b5e00 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39424/0 (socket says 172.21.15.31:39424) 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 -- 172.21.15.31:0/3822380894 learned_addr learned my addr 172.21.15.31:0/3822380894 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d6800640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 0x7fa4d815cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5e00640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 0x7fa4d8156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 --2- 172.21.15.31:0/3207561051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe440ca960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a9200640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 0x7fb984069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 -- 172.21.15.31:0/3207561051 >> 172.21.15.31:0/3207561051 conn(0x7efe44073540 msgr2=0x7efe440b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb990056490 con 0x7fb99c0338c0 2024-09-15T22:50:43.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 -- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 msgr2=0x7fa4d815cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 -- 172.21.15.31:0/3207561051 shutdown_connections 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 0x7fa4d815cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 -- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 msgr2=0x7fa4d8156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 0x7fa4d8156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5400640 1 -- 172.21.15.31:0/3822380894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4d81574f0 con 0x7fa4d80b4270 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d5e00640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 0x7fa4d8156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fa4d6800640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 0x7fa4d815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:43.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7efe48c00640 1 -- 172.21.15.31:0/3207561051 wait complete. 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fb9a9200640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 0x7fb984069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c10 tx=0x7fb9980a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 shutdown_connections 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 --2- 172.21.15.31:0/148310384 >> v2:172.21.15.31:3300/0 conn(0x7f2ea406fe20 0x7f2ea406f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 --2- 172.21.15.31:0/148310384 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea415a820 0x7f2ea415ac00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 >> 172.21.15.31:0/148310384 conn(0x7f2ea406c2c0 msgr2=0x7f2ea40b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 shutdown_connections 2024-09-15T22:50:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4d5400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400ebe0 tx=0x7fa4c400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f426c800640 1 -- 172.21.15.31:0/2265114639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 msgr2=0x7f4264072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f426c800640 1 --2- 172.21.15.31:0/2265114639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 0x7f4264072160 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f42580097f0 tx=0x7f425801c4e0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4017070 con 0x7fa4d80b4270 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4c400cc30 con 0x7fa4d80b4270 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4dca00640 1 -- 172.21.15.31:0/3822380894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4d815d990 con 0x7fa4d80b4270 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4dca00640 1 -- 172.21.15.31:0/3822380894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4d815df50 con 0x7fa4d80b4270 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4c4013470 con 0x7fa4d80b4270 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7efe48c00640 1 Processor -- start 2024-09-15T22:50:43.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 -- 172.21.15.31:0/148310384 wait complete. 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30161b60 0x7fbd30152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd300b7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300d38b0 con 0x7fbd30161b60 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd300d3a30 con 0x7fbd300ceb50 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.389+0000 7fbd37400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd300d3bb0 con 0x7fbd30161f40 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57358/0 (socket says 172.21.15.31:57358) 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 -- 172.21.15.31:0/3217693837 learned_addr learned my addr 172.21.15.31:0/3217693837 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd2fe00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30161b60 0x7fbd30152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 -- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 msgr2=0x7fbd300b7330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd300b7330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 -- 172.21.15.31:0/3217693837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30161b60 msgr2=0x7fbd30152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30161b60 0x7fbd30152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 -- 172.21.15.31:0/3217693837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd30154a50 con 0x7fbd300ceb50 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd34a00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c4c0 tx=0x7fbd1c001e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c017070 con 0x7fbd300ceb50 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd1c003600 con 0x7fbd300ceb50 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1c0039f0 con 0x7fbd300ceb50 2024-09-15T22:50:43.412 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 Processor -- start 2024-09-15T22:50:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7efe48c00640 1 -- start start 2024-09-15T22:50:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7f2ea9400640 1 -- start start 2024-09-15T22:50:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd30158740 con 0x7fbd300ceb50 2024-09-15T22:50:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.393+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4ac0052a0 con 0x7fa4d80b4270 2024-09-15T22:50:43.413 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd30158d00 con 0x7fbd300ceb50 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 0x7f2ea4158fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 0x7f2ea41527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ea415b140 0x7f2ea4152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4166980 con 0x7f2ea415b140 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2ea4166800 con 0x7f2ea415a820 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea9400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2ea4166b00 con 0x7f2ea406fe20 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 0x7f2ea4158fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 0x7f2ea4158fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:54058/0 (socket says 172.21.15.31:54058) 2024-09-15T22:50:43.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3e00640 1 -- 172.21.15.31:0/2047748438 learned_addr learned my addr 172.21.15.31:0/2047748438 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe4414de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 0x7f2ea41527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea8a00640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ea415b140 0x7f2ea4152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 -- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 msgr2=0x7f2ea4158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 0x7f2ea4158fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.415 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 -- 172.21.15.31:0/2047748438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ea415b140 msgr2=0x7f2ea4152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ea415b140 0x7f2ea4152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 -- 172.21.15.31:0/2047748438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ea409b8a0 con 0x7f2ea415a820 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:54070/0 (socket says 172.21.15.31:54070) 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 -- 172.21.15.31:0/2864379273 learned_addr learned my addr 172.21.15.31:0/2864379273 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe440cf110 0x7efe440cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41400640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe4414de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe4416c4d0 con 0x7efe440cf110 2024-09-15T22:50:43.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efe4416c350 con 0x7efe440b6480 2024-09-15T22:50:43.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe4416c650 con 0x7efe440b4270 2024-09-15T22:50:43.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2ea3400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 0x7f2ea41527f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e90001ec0 tx=0x7f2e9000c9b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.417 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 -- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 msgr2=0x7efe4414de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe4414de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 -- 172.21.15.31:0/2864379273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe440cf110 msgr2=0x7efe440cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe440cf110 0x7efe440cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe44157170 con 0x7efe440b4270 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe41e00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c440 tx=0x7efe3400c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007480 con 0x7f2ea415a820 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2e90007620 con 0x7f2ea415a820 2024-09-15T22:50:43.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e90005a60 con 0x7f2ea415a820 2024-09-15T22:50:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f426c800640 1 -- 172.21.15.31:0/2265114639 shutdown_connections 2024-09-15T22:50:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f426c800640 1 --2- 172.21.15.31:0/2265114639 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4264162cb0 0x7f4264072160 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f426c800640 1 -- 172.21.15.31:0/2265114639 >> 172.21.15.31:0/2265114639 conn(0x7f4264067e00 msgr2=0x7f426406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd3006e240 con 0x7fbd300ceb50 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34017070 con 0x7efe440b4270 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340052f0 con 0x7efe440b4270 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe34003840 con 0x7efe440b4270 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe44160080 con 0x7efe440b4270 2024-09-15T22:50:43.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efe44160640 con 0x7efe440b4270 2024-09-15T22:50:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ea40ae920 con 0x7f2ea415a820 2024-09-15T22:50:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ea40aeee0 con 0x7f2ea415a820 2024-09-15T22:50:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd1c01a070 con 0x7fbd300ceb50 2024-09-15T22:50:43.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ea415ac00 con 0x7f2ea415a820 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe3401a070 con 0x7efe440b4270 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c0052a0 con 0x7efe440b4270 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f426c800640 1 -- 172.21.15.31:0/2265114639 shutdown_connections 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.397+0000 7f426c800640 1 -- 172.21.15.31:0/2265114639 wait complete. 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7f426c800640 1 Processor -- start 2024-09-15T22:50:43.422 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7f426c800640 1 -- start start 2024-09-15T22:50:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7efe3a000640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 0x7efe24069e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.401+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4c401a070 con 0x7fa4d80b4270 2024-09-15T22:50:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fa4ce000640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 0x7fa4b8069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fbd2cc00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 0x7fbd1007ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbd1c0853e0 con 0x7fbd300ceb50 2024-09-15T22:50:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa4c4086730 con 0x7fa4d80b4270 2024-09-15T22:50:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efe34085200 con 0x7efe440b4270 2024-09-15T22:50:43.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fa4d5e00640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 0x7fa4b8069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fbd2fe00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 0x7fbd1007ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7efe41400640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 0x7efe24069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 0x7f4264151720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42641628d0 0x7f42641fc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 0x7f426415bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f42640cf480 con 0x7f4264162cb0 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42640cf300 con 0x7f42640726a0 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426c800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4264170420 con 0x7f42641628d0 2024-09-15T22:50:43.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7efe41400640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 0x7efe24069e80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe300ae000 tx=0x7efe30004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fa4d5e00640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 0x7fa4b8069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f4269e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 0x7f4264151720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f4269e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 0x7f4264151720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57370/0 (socket says 172.21.15.31:57370) 2024-09-15T22:50:43.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f4269e00640 1 -- 172.21.15.31:0/689437014 learned_addr learned my addr 172.21.15.31:0/689437014 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 0x7f426415bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 -- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42641628d0 msgr2=0x7f42641fc110 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f4269400640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42641628d0 0x7f42641fc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42641628d0 0x7f42641fc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 -- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 msgr2=0x7f4264151720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 0x7f4264151720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.428 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7f426a800640 1 -- 172.21.15.31:0/689437014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426415c260 con 0x7f4264162cb0 2024-09-15T22:50:43.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.405+0000 7fbd2fe00640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 0x7fbd1007ae60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ae000 tx=0x7fbd200a6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f426a800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 0x7f426415bd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f426000c700 tx=0x7f426000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4c40568c0 con 0x7fa4d80b4270 2024-09-15T22:50:43.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4260003b80 con 0x7f4264162cb0 2024-09-15T22:50:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd1c055570 con 0x7fbd300ceb50 2024-09-15T22:50:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2e90005c00 con 0x7f2ea415a820 2024-09-15T22:50:43.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe34055390 con 0x7efe440b4270 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4260003d20 con 0x7f4264162cb0 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42641522c0 con 0x7f4264162cb0 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4264152880 con 0x7f4264162cb0 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42600052f0 con 0x7f4264162cb0 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f2e9be00640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 0x7f2e84069e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.409+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2e900867d0 con 0x7f2ea415a820 2024-09-15T22:50:43.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4264072160 con 0x7f4264162cb0 2024-09-15T22:50:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f2ea3e00640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 0x7f2e84069e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2e90056fb0 con 0x7f2ea415a820 2024-09-15T22:50:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f2ea3e00640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 0x7f2e84069e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c021010 tx=0x7f2e9c004ac0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.413+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4260005490 con 0x7f4264162cb0 2024-09-15T22:50:43.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.417+0000 7f425e000640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 0x7f4248069dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.417+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4260054aa0 con 0x7f4264162cb0 2024-09-15T22:50:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.417+0000 7f4269e00640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 0x7f4248069dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.417+0000 7f4269e00640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 0x7f4248069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4254000f70 tx=0x7f4254009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:43.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.421+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4260057100 con 0x7f4264162cb0 2024-09-15T22:50:43.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.677+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff39404e7b0 con 0x7ff394039260 2024-09-15T22:50:43.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.677+0000 7ff38f400640 1 -- 172.21.15.31:0/3326727066 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff39c0922f0 con 0x7ff394039260 2024-09-15T22:50:43.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0ac00ba430 con 0x7f0ac00d4440 2024-09-15T22:50:43.684 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:43.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7f0ab6a00640 1 -- 172.21.15.31:0/171858423 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0aac0596f0 con 0x7f0ac00d4440 2024-09-15T22:50:43.686 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:43.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 msgr2=0x7ff37c069e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 0x7ff37c069e00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff390005fd0 tx=0x7ff390005da0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 msgr2=0x7ff3940dcf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 0x7ff3940dcf40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff39c076f60 tx=0x7ff39c096cc0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 shutdown_connections 2024-09-15T22:50:43.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff37c067940 0x7ff37c069e00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff394039260 0x7ff3940dcf40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff394036740 0x7ff39404a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 --2- 172.21.15.31:0/3326727066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff394033870 0x7ff3940e9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 >> 172.21.15.31:0/3326727066 conn(0x7ff39401d940 msgr2=0x7ff394031860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 shutdown_connections 2024-09-15T22:50:43.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.681+0000 7ff3a0e00640 1 -- 172.21.15.31:0/3326727066 wait complete. 2024-09-15T22:50:43.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 msgr2=0x7f0aa0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 0x7f0aa0069d80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0ab80af000 tx=0x7f0ab80a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 msgr2=0x7f0ac0165130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0aac00c3c0 tx=0x7f0aac00c880 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 shutdown_connections 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0aa00678c0 0x7f0aa0069d80 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ac01628f0 0x7f0ac0165670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ac00d4440 0x7f0ac0165130 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 --2- 172.21.15.31:0/171858423 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ac00d1a10 0x7f0ac01544c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 >> 172.21.15.31:0/171858423 conn(0x7f0ac009d840 msgr2=0x7f0ac015ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 shutdown_connections 2024-09-15T22:50:43.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.685+0000 7f0ac5800640 1 -- 172.21.15.31:0/171858423 wait complete. 2024-09-15T22:50:43.722 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.3 2024-09-15T22:50:43.722 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.725 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-09-15T22:50:43.725 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb99c032fd0 con 0x7fb99c0338c0 2024-09-15T22:50:43.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9a0c00640 1 -- 172.21.15.31:0/2773307173 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb990055d90 con 0x7fb99c0338c0 2024-09-15T22:50:43.742 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 msgr2=0x7fb984069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 0x7fb984069d80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb998000c10 tx=0x7fb9980a6000 comp rx=0 tx=0).stop 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 msgr2=0x7fb99c0de3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 0x7fb99c0de3e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb99000c3e0 tx=0x7fb99000c8a0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 shutdown_connections 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9840678c0 0x7fb984069d80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb99c04eb70 0x7fb99c039b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb99c0338c0 0x7fb99c0de3e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 --2- 172.21.15.31:0/2773307173 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb99c009b00 0x7fb99c0d6610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.737+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 >> 172.21.15.31:0/2773307173 conn(0x7fb99c0360a0 msgr2=0x7fb99c0520f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.741+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 shutdown_connections 2024-09-15T22:50:43.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.741+0000 7fb9aa600640 1 -- 172.21.15.31:0/2773307173 wait complete. 2024-09-15T22:50:43.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.753+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f426415daf0 con 0x7f4264162cb0 2024-09-15T22:50:43.757 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.753+0000 7f425e000640 1 -- 172.21.15.31:0/689437014 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4260056a00 con 0x7f4264162cb0 2024-09-15T22:50:43.757 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:43.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 msgr2=0x7f4248069dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 0x7f4248069dd0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4254000f70 tx=0x7f4254009040 comp rx=0 tx=0).stop 2024-09-15T22:50:43.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 msgr2=0x7f426415bd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 0x7f426415bd20 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f426000c700 tx=0x7f426000cbc0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 shutdown_connections 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4248067910 0x7f4248069dd0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4264162cb0 0x7f426415bd20 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42641628d0 0x7f42641fc110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 --2- 172.21.15.31:0/689437014 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42640726a0 0x7f4264151720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 >> 172.21.15.31:0/689437014 conn(0x7f4264067e00 msgr2=0x7f42640ce3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 shutdown_connections 2024-09-15T22:50:43.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.757+0000 7f426c800640 1 -- 172.21.15.31:0/689437014 wait complete. 2024-09-15T22:50:43.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.761+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa4ac005860 con 0x7fa4d80b4270 2024-09-15T22:50:43.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.761+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efe1c005590 con 0x7efe440b4270 2024-09-15T22:50:43.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.761+0000 7fa4ce000640 1 -- 172.21.15.31:0/3822380894 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa4c405abc0 con 0x7fa4d80b4270 2024-09-15T22:50:43.767 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:43.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.761+0000 7efe3a000640 1 -- 172.21.15.31:0/2864379273 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efe34059690 con 0x7efe440b4270 2024-09-15T22:50:43.768 INFO:teuthology.orchestra.run.smithi031.stdout:60129542155 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f2ea406e1e0 con 0x7f2ea415a820 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 msgr2=0x7fa4b8069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 0x7fa4b8069e50 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8007fd0 tx=0x7fa4c8009040 comp rx=0 tx=0).stop 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 msgr2=0x7fa4d815c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa4c400ebe0 tx=0x7fa4c400c520 comp rx=0 tx=0).stop 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 shutdown_connections 2024-09-15T22:50:43.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4b8067990 0x7fa4b8069e50 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4d80b5e00 0x7fa4d815cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4d80b4270 0x7fa4d815c610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 --2- 172.21.15.31:0/3822380894 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4d809aa40 0x7fa4d8156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 >> 172.21.15.31:0/3822380894 conn(0x7fa4d8073540 msgr2=0x7fa4d80cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.772 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.0 2024-09-15T22:50:43.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fbd300ba480 con 0x7fbd300ceb50 2024-09-15T22:50:43.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 shutdown_connections 2024-09-15T22:50:43.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fa4c3400640 1 -- 172.21.15.31:0/3822380894 wait complete. 2024-09-15T22:50:43.772 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7f2e9be00640 1 -- 172.21.15.31:0/2047748438 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e900568b0 con 0x7f2ea415a820 2024-09-15T22:50:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 msgr2=0x7efe24069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 0x7efe24069e80 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efe300ae000 tx=0x7efe30004740 comp rx=0 tx=0).stop 2024-09-15T22:50:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 msgr2=0x7efe44160e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7efe3400c440 tx=0x7efe3400c900 comp rx=0 tx=0).stop 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stdout:60129542154 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 shutdown_connections 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efe240679c0 0x7efe24069e80 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe440cf110 0x7efe440cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe440b6480 0x7efe4414de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7fbd2cc00640 1 -- 172.21.15.31:0/3217693837 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fbd1c059870 con 0x7fbd300ceb50 2024-09-15T22:50:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 --2- 172.21.15.31:0/2864379273 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe440b4270 0x7efe44160e40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 >> 172.21.15.31:0/2864379273 conn(0x7efe44073540 msgr2=0x7efe4406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 shutdown_connections 2024-09-15T22:50:43.775 INFO:teuthology.orchestra.run.smithi031.stdout:60129542153 2024-09-15T22:50:43.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.765+0000 7efe48c00640 1 -- 172.21.15.31:0/2864379273 wait complete. 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 msgr2=0x7f2e84069e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 0x7f2e84069e50 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c021010 tx=0x7f2e9c004ac0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 msgr2=0x7f2ea41527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 0x7f2ea41527f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2e90001ec0 tx=0x7f2e9000c9b0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 shutdown_connections 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2e84067990 0x7f2e84069e50 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2ea415b140 0x7f2ea4152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2ea415a820 0x7f2ea41527f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 --2- 172.21.15.31:0/2047748438 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2ea406fe20 0x7f2ea4158fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 >> 172.21.15.31:0/2047748438 conn(0x7f2ea406c2c0 msgr2=0x7f2ea4071d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 shutdown_connections 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7f2ea9400640 1 -- 172.21.15.31:0/2047748438 wait complete. 2024-09-15T22:50:43.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 msgr2=0x7fbd1007ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 0x7fbd1007ae60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ae000 tx=0x7fbd200a6040 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 msgr2=0x7fbd300c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c4c0 tx=0x7fbd1c001e80 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 shutdown_connections 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd100789a0 0x7fbd1007ae60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd30161f40 0x7fbd300b7330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd30161b60 0x7fbd30152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 --2- 172.21.15.31:0/3217693837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd300ceb50 0x7fbd300c8030 secure :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c00c4c0 tx=0x7fbd1c001e80 comp rx=0 tx=0).stop 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.769+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 >> 172.21.15.31:0/3217693837 conn(0x7fbd300d4500 msgr2=0x7fbd300cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.773+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 shutdown_connections 2024-09-15T22:50:43.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.773+0000 7fbd37400640 1 -- 172.21.15.31:0/3217693837 wait complete. 2024-09-15T22:50:43.794 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.6 2024-09-15T22:50:43.794 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.799 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2024-09-15T22:50:43.799 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542153 for osd.4 2024-09-15T22:50:43.806 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.810 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.7 2024-09-15T22:50:43.810 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.811 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.2 2024-09-15T22:50:43.811 DEBUG:teuthology.parallel:result is None 2024-09-15T22:50:43.811 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:50:43.812 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:50:43.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.989+0000 7f9e8d400640 1 Processor -- start 2024-09-15T22:50:43.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.989+0000 7f9e8d400640 1 -- start start 2024-09-15T22:50:43.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e8d400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9e8809b7a0 0x7f9e8815d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e8d400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e880d0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:43.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e8d400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e880ce2b0 con 0x7f9e8809aa40 2024-09-15T22:50:43.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e8d400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9e880cde20 con 0x7f9e8809b7a0 2024-09-15T22:50:43.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e8d400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e880cd210 con 0x7f9e880cff80 2024-09-15T22:50:43.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e86800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f9e8809aa40 0x7f9e8809ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52704/0 (socket says 172.21.15.31:52704) 2024-09-15T22:50:43.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e86800640 1 -- 172.21.15.31:0/3401628653 learned_addr learned my addr 172.21.15.31:0/3401628653 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:43.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e87200640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e880d0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e7de00640 1 --2- 172.21.15.31:0/3401628653 >> v2:172.21.15.102:3300/0 conn(0x7f9e8809b7a0 0x7f9e8815d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:43.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e85e00640 1 -- 172.21.15.31:0/3401628653 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461546482 0 0) 0x7f9e78001120 con 0x7f9e8809aa40 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e85e00640 1 -- 172.21.15.31:0/3401628653 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e6c003530 con 0x7f9e8809aa40 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e7de00640 1 -- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 msgr2=0x7f9e880d0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e7de00640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e880d0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e7de00640 1 -- 172.21.15.31:0/3401628653 >> v1:172.21.15.102:6789/0 conn(0x7f9e8809aa40 legacy=0x7f9e8809ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e7de00640 1 -- 172.21.15.31:0/3401628653 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e880cd4f0 con 0x7f9e8809b7a0 2024-09-15T22:50:43.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.993+0000 7f9e87200640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e880d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:50:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e7de00640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e8815d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e700097c0 tx=0x7f9e7001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=595053c2ec166194 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e85e00640 1 -- 172.21.15.31:0/3401628653 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700b0070 con 0x7f9e8809b7a0 2024-09-15T22:50:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e85e00640 1 -- 172.21.15.31:0/3401628653 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e700ab600 con 0x7f9e8809b7a0 2024-09-15T22:50:44.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e85e00640 1 -- 172.21.15.31:0/3401628653 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e700ab9d0 con 0x7f9e8809b7a0 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 msgr2=0x7f9e8815d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e8815d490 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e700097c0 tx=0x7f9e7001c410 comp rx=0 tx=0).stop 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- 172.21.15.31:0/3401628653 shutdown_connections 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e880d0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 --2- 172.21.15.31:0/3401628653 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e8815d490 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- 172.21.15.31:0/3401628653 >> 172.21.15.31:0/3401628653 conn(0x7f9e880d23b0 msgr2=0x7f9e880d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- 172.21.15.31:0/3401628653 shutdown_connections 2024-09-15T22:50:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- 172.21.15.31:0/3401628653 wait complete. 2024-09-15T22:50:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 Processor -- start 2024-09-15T22:50:44.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:43.997+0000 7f9e8d400640 1 -- start start 2024-09-15T22:50:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e880b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e8815b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9e881692c0 con 0x7f9e8809aa40 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9e8815c7b0 con 0x7f9e8809b7a0 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9e88169440 con 0x7f9e880cff80 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39470/0 (socket says 172.21.15.31:39470) 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 -- 172.21.15.31:0/2155734390 learned_addr learned my addr 172.21.15.31:0/2155734390 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e87200640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e8815b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e7de00640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e880b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 -- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 msgr2=0x7f9e8815b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e8815b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 -- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 msgr2=0x7f9e880b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e880b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 -- 172.21.15.31:0/2155734390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e8806cf70 con 0x7f9e8809aa40 2024-09-15T22:50:44.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e86800640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c3c0 tx=0x7f9e7800c7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78017070 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e78005db0 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78007310 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e8806d250 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e8806d810 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e8815d490 con 0x7f9e8809aa40 2024-09-15T22:50:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.001+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9e7801a070 con 0x7f9e8809aa40 2024-09-15T22:50:44.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.005+0000 7f9e7f400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 0x7f9e64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.005+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9e78085420 con 0x7f9e8809aa40 2024-09-15T22:50:44.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.005+0000 7f9e7de00640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 0x7f9e64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.005+0000 7f9e7de00640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 0x7f9e64069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e700ad000 tx=0x7f9e70008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.009+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9e880ce2b0 con 0x7f9e8809aa40 2024-09-15T22:50:44.029 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:50:44.032 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:50:44.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.173+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9e8809b350 con 0x7f9e640678c0 2024-09-15T22:50:44.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.181+0000 7f9e7f400640 1 -- 172.21.15.31:0/2155734390 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f9e8809b350 con 0x7f9e640678c0 2024-09-15T22:50:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:44.192 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 msgr2=0x7f9e64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 0x7f9e64069d80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e700ad000 tx=0x7f9e70008040 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 msgr2=0x7f9e8806e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c3c0 tx=0x7f9e7800c7c0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 shutdown_connections 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9e640678c0 0x7f9e64069d80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9e880cff80 0x7f9e8815b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9e8809b7a0 0x7f9e880b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 --2- 172.21.15.31:0/2155734390 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9e8809aa40 0x7f9e8806e010 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 >> 172.21.15.31:0/2155734390 conn(0x7f9e880d23b0 msgr2=0x7f9e881578c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:44.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 shutdown_connections 2024-09-15T22:50:44.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.185+0000 7f9e8d400640 1 -- 172.21.15.31:0/2155734390 wait complete. 2024-09-15T22:50:44.209 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-15T22:50:43.560725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3350528,"data_stored":2018492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486560+0000","last_change":"2024-09-15T22:50:16.071034+0000","last_active":"2024-09-15T22:50:22.486560+0000","last_peered":"2024-09-15T22:50:22.486560+0000","last_clean":"2024-09-15T22:50:22.486560+0000","last_became_active":"2024-09-15T22:50:16.070808+0000","last_became_peered":"2024-09-15T22:50:16.070808+0000","last_unstale":"2024-09-15T22:50:22.486560+0000","last_undegraded":"2024-09-15T22:50:22.486560+0000","last_fullsized":"2024-09-15T22:50:22.486560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:07.036126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485037+0000","last_change":"2024-09-15T22:50:17.064575+0000","last_active":"2024-09-15T22:50:22.485037+0000","last_peered":"2024-09-15T22:50:22.485037+0000","last_clean":"2024-09-15T22:50:22.485037+0000","last_became_active":"2024-09-15T22:50:17.064271+0000","last_became_peered":"2024-09-15T22:50:17.064271+0000","last_unstale":"2024-09-15T22:50:22.485037+0000","last_undegraded":"2024-09-15T22:50:22.485037+0000","last_fullsized":"2024-09-15T22:50:22.485037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484032+0000","last_change":"2024-09-15T22:50:21.391770+0000","last_active":"2024-09-15T22:50:22.484032+0000","last_peered":"2024-09-15T22:50:22.484032+0000","last_clean":"2024-09-15T22:50:22.484032+0000","last_became_active":"2024-09-15T22:50:21.387296+0000","last_became_peered":"2024-09-15T22:50:21.387296+0000","last_unstale":"2024-09-15T22:50:22.484032+0000","last_undegraded":"2024-09-15T22:50:22.484032+0000","last_fullsized":"2024-09-15T22:50:22.484032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.401656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485239+0000","last_change":"2024-09-15T22:50:16.059723+0000","last_active":"2024-09-15T22:50:22.485239+0000","last_peered":"2024-09-15T22:50:22.485239+0000","last_clean":"2024-09-15T22:50:22.485239+0000","last_became_active":"2024-09-15T22:50:16.059365+0000","last_became_peered":"2024-09-15T22:50:16.059365+0000","last_unstale":"2024-09-15T22:50:22.485239+0000","last_undegraded":"2024-09-15T22:50:22.485239+0000","last_fullsized":"2024-09-15T22:50:22.485239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486397+0000","last_change":"2024-09-15T22:50:17.049966+0000","last_active":"2024-09-15T22:50:22.486397+0000","last_peered":"2024-09-15T22:50:22.486397+0000","last_clean":"2024-09-15T22:50:22.486397+0000","last_became_active":"2024-09-15T22:50:17.049585+0000","last_became_peered":"2024-09-15T22:50:17.049585+0000","last_unstale":"2024-09-15T22:50:22.486397+0000","last_undegraded":"2024-09-15T22:50:22.486397+0000","last_fullsized":"2024-09-15T22:50:22.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304395+0000","last_change":"2024-09-15T22:50:21.332999+0000","last_active":"2024-09-15T22:50:22.304395+0000","last_peered":"2024-09-15T22:50:22.304395+0000","last_clean":"2024-09-15T22:50:22.304395+0000","last_became_active":"2024-09-15T22:50:21.332489+0000","last_became_peered":"2024-09-15T22:50:21.332489+0000","last_unstale":"2024-09-15T22:50:22.304395+0000","last_undegraded":"2024-09-15T22:50:22.304395+0000","last_fullsized":"2024-09-15T22:50:22.304395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:14.476887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486836+0000","last_change":"2024-09-15T22:50:16.074061+0000","last_active":"2024-09-15T22:50:22.486836+0000","last_peered":"2024-09-15T22:50:22.486836+0000","last_clean":"2024-09-15T22:50:22.486836+0000","last_became_active":"2024-09-15T22:50:16.073371+0000","last_became_peered":"2024-09-15T22:50:16.073371+0000","last_unstale":"2024-09-15T22:50:22.486836+0000","last_undegraded":"2024-09-15T22:50:22.486836+0000","last_fullsized":"2024-09-15T22:50:22.486836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304993+0000","last_change":"2024-09-15T22:50:17.049531+0000","last_active":"2024-09-15T22:50:22.304993+0000","last_peered":"2024-09-15T22:50:22.304993+0000","last_clean":"2024-09-15T22:50:22.304993+0000","last_became_active":"2024-09-15T22:50:17.048655+0000","last_became_peered":"2024-09-15T22:50:17.048655+0000","last_unstale":"2024-09-15T22:50:22.304993+0000","last_undegraded":"2024-09-15T22:50:22.304993+0000","last_fullsized":"2024-09-15T22:50:22.304993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:35.848734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305466+0000","last_change":"2024-09-15T22:50:21.331612+0000","last_active":"2024-09-15T22:50:22.305466+0000","last_peered":"2024-09-15T22:50:22.305466+0000","last_clean":"2024-09-15T22:50:22.305466+0000","last_became_active":"2024-09-15T22:50:21.331183+0000","last_became_peered":"2024-09-15T22:50:21.331183+0000","last_unstale":"2024-09-15T22:50:22.305466+0000","last_undegraded":"2024-09-15T22:50:22.305466+0000","last_fullsized":"2024-09-15T22:50:22.305466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487042+0000","last_change":"2024-09-15T22:50:16.074167+0000","last_active":"2024-09-15T22:50:22.487042+0000","last_peered":"2024-09-15T22:50:22.487042+0000","last_clean":"2024-09-15T22:50:22.487042+0000","last_became_active":"2024-09-15T22:50:16.073667+0000","last_became_peered":"2024-09-15T22:50:16.073667+0000","last_unstale":"2024-09-15T22:50:22.487042+0000","last_undegraded":"2024-09-15T22:50:22.487042+0000","last_fullsized":"2024-09-15T22:50:22.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305928+0000","last_change":"2024-09-15T22:50:17.049937+0000","last_active":"2024-09-15T22:50:22.305928+0000","last_peered":"2024-09-15T22:50:22.305928+0000","last_clean":"2024-09-15T22:50:22.305928+0000","last_became_active":"2024-09-15T22:50:17.049500+0000","last_became_peered":"2024-09-15T22:50:17.049500+0000","last_unstale":"2024-09-15T22:50:22.305928+0000","last_undegraded":"2024-09-15T22:50:22.305928+0000","last_fullsized":"2024-09-15T22:50:22.305928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:59.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305411+0000","last_change":"2024-09-15T22:50:21.322140+0000","last_active":"2024-09-15T22:50:22.305411+0000","last_peered":"2024-09-15T22:50:22.305411+0000","last_clean":"2024-09-15T22:50:22.305411+0000","last_became_active":"2024-09-15T22:50:21.321613+0000","last_became_peered":"2024-09-15T22:50:21.321613+0000","last_unstale":"2024-09-15T22:50:22.305411+0000","last_undegraded":"2024-09-15T22:50:22.305411+0000","last_fullsized":"2024-09-15T22:50:22.305411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:25.347025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486025+0000","last_change":"2024-09-15T22:50:17.066161+0000","last_active":"2024-09-15T22:50:22.486025+0000","last_peered":"2024-09-15T22:50:22.486025+0000","last_clean":"2024-09-15T22:50:22.486025+0000","last_became_active":"2024-09-15T22:50:17.064352+0000","last_became_peered":"2024-09-15T22:50:17.064352+0000","last_unstale":"2024-09-15T22:50:22.486025+0000","last_undegraded":"2024-09-15T22:50:22.486025+0000","last_fullsized":"2024-09-15T22:50:22.486025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486824+0000","last_change":"2024-09-15T22:50:16.073863+0000","last_active":"2024-09-15T22:50:22.486824+0000","last_peered":"2024-09-15T22:50:22.486824+0000","last_clean":"2024-09-15T22:50:22.486824+0000","last_became_active":"2024-09-15T22:50:16.073568+0000","last_became_peered":"2024-09-15T22:50:16.073568+0000","last_unstale":"2024-09-15T22:50:22.486824+0000","last_undegraded":"2024-09-15T22:50:22.486824+0000","last_fullsized":"2024-09-15T22:50:22.486824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:50.833315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305147+0000","last_change":"2024-09-15T22:50:21.329220+0000","last_active":"2024-09-15T22:50:22.305147+0000","last_peered":"2024-09-15T22:50:22.305147+0000","last_clean":"2024-09-15T22:50:22.305147+0000","last_became_active":"2024-09-15T22:50:21.328859+0000","last_became_peered":"2024-09-15T22:50:21.328859+0000","last_unstale":"2024-09-15T22:50:22.305147+0000","last_undegraded":"2024-09-15T22:50:22.305147+0000","last_fullsized":"2024-09-15T22:50:22.305147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:53.380745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484221+0000","last_change":"2024-09-15T22:50:17.081686+0000","last_active":"2024-09-15T22:50:22.484221+0000","last_peered":"2024-09-15T22:50:22.484221+0000","last_clean":"2024-09-15T22:50:22.484221+0000","last_became_active":"2024-09-15T22:50:17.081267+0000","last_became_peered":"2024-09-15T22:50:17.081267+0000","last_unstale":"2024-09-15T22:50:22.484221+0000","last_undegraded":"2024-09-15T22:50:22.484221+0000","last_fullsized":"2024-09-15T22:50:22.484221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485397+0000","last_change":"2024-09-15T22:50:16.065960+0000","last_active":"2024-09-15T22:50:22.485397+0000","last_peered":"2024-09-15T22:50:22.485397+0000","last_clean":"2024-09-15T22:50:22.485397+0000","last_became_active":"2024-09-15T22:50:16.065603+0000","last_became_peered":"2024-09-15T22:50:16.065603+0000","last_unstale":"2024-09-15T22:50:22.485397+0000","last_undegraded":"2024-09-15T22:50:22.485397+0000","last_fullsized":"2024-09-15T22:50:22.485397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305841+0000","last_change":"2024-09-15T22:50:21.331723+0000","last_active":"2024-09-15T22:50:22.305841+0000","last_peered":"2024-09-15T22:50:22.305841+0000","last_clean":"2024-09-15T22:50:22.305841+0000","last_became_active":"2024-09-15T22:50:21.331153+0000","last_became_peered":"2024-09-15T22:50:21.331153+0000","last_unstale":"2024-09-15T22:50:22.305841+0000","last_undegraded":"2024-09-15T22:50:22.305841+0000","last_fullsized":"2024-09-15T22:50:22.305841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484852+0000","last_change":"2024-09-15T22:50:17.063766+0000","last_active":"2024-09-15T22:50:22.484852+0000","last_peered":"2024-09-15T22:50:22.484852+0000","last_clean":"2024-09-15T22:50:22.484852+0000","last_became_active":"2024-09-15T22:50:17.063505+0000","last_became_peered":"2024-09-15T22:50:17.063505+0000","last_unstale":"2024-09-15T22:50:22.484852+0000","last_undegraded":"2024-09-15T22:50:22.484852+0000","last_fullsized":"2024-09-15T22:50:22.484852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486133+0000","last_change":"2024-09-15T22:50:16.058862+0000","last_active":"2024-09-15T22:50:22.486133+0000","last_peered":"2024-09-15T22:50:22.486133+0000","last_clean":"2024-09-15T22:50:22.486133+0000","last_became_active":"2024-09-15T22:50:16.058559+0000","last_became_peered":"2024-09-15T22:50:16.058559+0000","last_unstale":"2024-09-15T22:50:22.486133+0000","last_undegraded":"2024-09-15T22:50:22.486133+0000","last_fullsized":"2024-09-15T22:50:22.486133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488018+0000","last_change":"2024-09-15T22:50:21.388463+0000","last_active":"2024-09-15T22:50:22.488018+0000","last_peered":"2024-09-15T22:50:22.488018+0000","last_clean":"2024-09-15T22:50:22.488018+0000","last_became_active":"2024-09-15T22:50:21.387965+0000","last_became_peered":"2024-09-15T22:50:21.387965+0000","last_unstale":"2024-09-15T22:50:22.488018+0000","last_undegraded":"2024-09-15T22:50:22.488018+0000","last_fullsized":"2024-09-15T22:50:22.488018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304813+0000","last_change":"2024-09-15T22:50:17.056742+0000","last_active":"2024-09-15T22:50:22.304813+0000","last_peered":"2024-09-15T22:50:22.304813+0000","last_clean":"2024-09-15T22:50:22.304813+0000","last_became_active":"2024-09-15T22:50:17.056447+0000","last_became_peered":"2024-09-15T22:50:17.056447+0000","last_unstale":"2024-09-15T22:50:22.304813+0000","last_undegraded":"2024-09-15T22:50:22.304813+0000","last_fullsized":"2024-09-15T22:50:22.304813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486107+0000","last_change":"2024-09-15T22:50:16.072521+0000","last_active":"2024-09-15T22:50:22.486107+0000","last_peered":"2024-09-15T22:50:22.486107+0000","last_clean":"2024-09-15T22:50:22.486107+0000","last_became_active":"2024-09-15T22:50:16.071920+0000","last_became_peered":"2024-09-15T22:50:16.071920+0000","last_unstale":"2024-09-15T22:50:22.486107+0000","last_undegraded":"2024-09-15T22:50:22.486107+0000","last_fullsized":"2024-09-15T22:50:22.486107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305040+0000","last_change":"2024-09-15T22:50:21.333094+0000","last_active":"2024-09-15T22:50:22.305040+0000","last_peered":"2024-09-15T22:50:22.305040+0000","last_clean":"2024-09-15T22:50:22.305040+0000","last_became_active":"2024-09-15T22:50:21.332195+0000","last_became_peered":"2024-09-15T22:50:21.332195+0000","last_unstale":"2024-09-15T22:50:22.305040+0000","last_undegraded":"2024-09-15T22:50:22.305040+0000","last_fullsized":"2024-09-15T22:50:22.305040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:51.604505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486855+0000","last_change":"2024-09-15T22:50:17.068190+0000","last_active":"2024-09-15T22:50:22.486855+0000","last_peered":"2024-09-15T22:50:22.486855+0000","last_clean":"2024-09-15T22:50:22.486855+0000","last_became_active":"2024-09-15T22:50:17.067975+0000","last_became_peered":"2024-09-15T22:50:17.067975+0000","last_unstale":"2024-09-15T22:50:22.486855+0000","last_undegraded":"2024-09-15T22:50:22.486855+0000","last_fullsized":"2024-09-15T22:50:22.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487083+0000","last_change":"2024-09-15T22:50:16.076299+0000","last_active":"2024-09-15T22:50:22.487083+0000","last_peered":"2024-09-15T22:50:22.487083+0000","last_clean":"2024-09-15T22:50:22.487083+0000","last_became_active":"2024-09-15T22:50:16.075995+0000","last_became_peered":"2024-09-15T22:50:16.075995+0000","last_unstale":"2024-09-15T22:50:22.487083+0000","last_undegraded":"2024-09-15T22:50:22.487083+0000","last_fullsized":"2024-09-15T22:50:22.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304527+0000","last_change":"2024-09-15T22:50:21.387662+0000","last_active":"2024-09-15T22:50:22.304527+0000","last_peered":"2024-09-15T22:50:22.304527+0000","last_clean":"2024-09-15T22:50:22.304527+0000","last_became_active":"2024-09-15T22:50:21.387238+0000","last_became_peered":"2024-09-15T22:50:21.387238+0000","last_unstale":"2024-09-15T22:50:22.304527+0000","last_undegraded":"2024-09-15T22:50:22.304527+0000","last_fullsized":"2024-09-15T22:50:22.304527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:29.299907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484756+0000","last_change":"2024-09-15T22:50:17.065264+0000","last_active":"2024-09-15T22:50:22.484756+0000","last_peered":"2024-09-15T22:50:22.484756+0000","last_clean":"2024-09-15T22:50:22.484756+0000","last_became_active":"2024-09-15T22:50:17.064957+0000","last_became_peered":"2024-09-15T22:50:17.064957+0000","last_unstale":"2024-09-15T22:50:22.484756+0000","last_undegraded":"2024-09-15T22:50:22.484756+0000","last_fullsized":"2024-09-15T22:50:22.484756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488183+0000","last_change":"2024-09-15T22:50:16.065838+0000","last_active":"2024-09-15T22:50:22.488183+0000","last_peered":"2024-09-15T22:50:22.488183+0000","last_clean":"2024-09-15T22:50:22.488183+0000","last_became_active":"2024-09-15T22:50:16.065431+0000","last_became_peered":"2024-09-15T22:50:16.065431+0000","last_unstale":"2024-09-15T22:50:22.488183+0000","last_undegraded":"2024-09-15T22:50:22.488183+0000","last_fullsized":"2024-09-15T22:50:22.488183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484368+0000","last_change":"2024-09-15T22:50:21.386971+0000","last_active":"2024-09-15T22:50:22.484368+0000","last_peered":"2024-09-15T22:50:22.484368+0000","last_clean":"2024-09-15T22:50:22.484368+0000","last_became_active":"2024-09-15T22:50:21.386649+0000","last_became_peered":"2024-09-15T22:50:21.386649+0000","last_unstale":"2024-09-15T22:50:22.484368+0000","last_undegraded":"2024-09-15T22:50:22.484368+0000","last_fullsized":"2024-09-15T22:50:22.484368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.952001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487665+0000","last_change":"2024-09-15T22:50:17.061858+0000","last_active":"2024-09-15T22:50:22.487665+0000","last_peered":"2024-09-15T22:50:22.487665+0000","last_clean":"2024-09-15T22:50:22.487665+0000","last_became_active":"2024-09-15T22:50:17.061576+0000","last_became_peered":"2024-09-15T22:50:17.061576+0000","last_unstale":"2024-09-15T22:50:22.487665+0000","last_undegraded":"2024-09-15T22:50:22.487665+0000","last_fullsized":"2024-09-15T22:50:22.487665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487045+0000","last_change":"2024-09-15T22:50:16.074301+0000","last_active":"2024-09-15T22:50:22.487045+0000","last_peered":"2024-09-15T22:50:22.487045+0000","last_clean":"2024-09-15T22:50:22.487045+0000","last_became_active":"2024-09-15T22:50:16.073757+0000","last_became_peered":"2024-09-15T22:50:16.073757+0000","last_unstale":"2024-09-15T22:50:22.487045+0000","last_undegraded":"2024-09-15T22:50:22.487045+0000","last_fullsized":"2024-09-15T22:50:22.487045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485694+0000","last_change":"2024-09-15T22:50:21.387039+0000","last_active":"2024-09-15T22:50:22.485694+0000","last_peered":"2024-09-15T22:50:22.485694+0000","last_clean":"2024-09-15T22:50:22.485694+0000","last_became_active":"2024-09-15T22:50:21.386588+0000","last_became_peered":"2024-09-15T22:50:21.386588+0000","last_unstale":"2024-09-15T22:50:22.485694+0000","last_undegraded":"2024-09-15T22:50:22.485694+0000","last_fullsized":"2024-09-15T22:50:22.485694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306041+0000","last_change":"2024-09-15T22:50:17.073775+0000","last_active":"2024-09-15T22:50:22.306041+0000","last_peered":"2024-09-15T22:50:22.306041+0000","last_clean":"2024-09-15T22:50:22.306041+0000","last_became_active":"2024-09-15T22:50:17.073501+0000","last_became_peered":"2024-09-15T22:50:17.073501+0000","last_unstale":"2024-09-15T22:50:22.306041+0000","last_undegraded":"2024-09-15T22:50:22.306041+0000","last_fullsized":"2024-09-15T22:50:22.306041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.114390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487762+0000","last_change":"2024-09-15T22:50:16.062735+0000","last_active":"2024-09-15T22:50:22.487762+0000","last_peered":"2024-09-15T22:50:22.487762+0000","last_clean":"2024-09-15T22:50:22.487762+0000","last_became_active":"2024-09-15T22:50:16.062407+0000","last_became_peered":"2024-09-15T22:50:16.062407+0000","last_unstale":"2024-09-15T22:50:22.487762+0000","last_undegraded":"2024-09-15T22:50:22.487762+0000","last_fullsized":"2024-09-15T22:50:22.487762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485248+0000","last_change":"2024-09-15T22:50:21.334715+0000","last_active":"2024-09-15T22:50:22.485248+0000","last_peered":"2024-09-15T22:50:22.485248+0000","last_clean":"2024-09-15T22:50:22.485248+0000","last_became_active":"2024-09-15T22:50:21.334378+0000","last_became_peered":"2024-09-15T22:50:21.334378+0000","last_unstale":"2024-09-15T22:50:22.485248+0000","last_undegraded":"2024-09-15T22:50:22.485248+0000","last_fullsized":"2024-09-15T22:50:22.485248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305984+0000","last_change":"2024-09-15T22:50:17.059567+0000","last_active":"2024-09-15T22:50:22.305984+0000","last_peered":"2024-09-15T22:50:22.305984+0000","last_clean":"2024-09-15T22:50:22.305984+0000","last_became_active":"2024-09-15T22:50:17.059236+0000","last_became_peered":"2024-09-15T22:50:17.059236+0000","last_unstale":"2024-09-15T22:50:22.305984+0000","last_undegraded":"2024-09-15T22:50:22.305984+0000","last_fullsized":"2024-09-15T22:50:22.305984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305510+0000","last_change":"2024-09-15T22:50:16.064966+0000","last_active":"2024-09-15T22:50:22.305510+0000","last_peered":"2024-09-15T22:50:22.305510+0000","last_clean":"2024-09-15T22:50:22.305510+0000","last_became_active":"2024-09-15T22:50:16.063647+0000","last_became_peered":"2024-09-15T22:50:16.063647+0000","last_unstale":"2024-09-15T22:50:22.305510+0000","last_undegraded":"2024-09-15T22:50:22.305510+0000","last_fullsized":"2024-09-15T22:50:22.305510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:05.094689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487711+0000","last_change":"2024-09-15T22:50:21.324683+0000","last_active":"2024-09-15T22:50:22.487711+0000","last_peered":"2024-09-15T22:50:22.487711+0000","last_clean":"2024-09-15T22:50:22.487711+0000","last_became_active":"2024-09-15T22:50:21.324107+0000","last_became_peered":"2024-09-15T22:50:21.324107+0000","last_unstale":"2024-09-15T22:50:22.487711+0000","last_undegraded":"2024-09-15T22:50:22.487711+0000","last_fullsized":"2024-09-15T22:50:22.487711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484084+0000","last_change":"2024-09-15T22:50:17.076106+0000","last_active":"2024-09-15T22:50:22.484084+0000","last_peered":"2024-09-15T22:50:22.484084+0000","last_clean":"2024-09-15T22:50:22.484084+0000","last_became_active":"2024-09-15T22:50:17.075941+0000","last_became_peered":"2024-09-15T22:50:17.075941+0000","last_unstale":"2024-09-15T22:50:22.484084+0000","last_undegraded":"2024-09-15T22:50:22.484084+0000","last_fullsized":"2024-09-15T22:50:22.484084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301938+0000","last_change":"2024-09-15T22:50:16.058921+0000","last_active":"2024-09-15T22:50:22.301938+0000","last_peered":"2024-09-15T22:50:22.301938+0000","last_clean":"2024-09-15T22:50:22.301938+0000","last_became_active":"2024-09-15T22:50:16.056403+0000","last_became_peered":"2024-09-15T22:50:16.056403+0000","last_unstale":"2024-09-15T22:50:22.301938+0000","last_undegraded":"2024-09-15T22:50:22.301938+0000","last_fullsized":"2024-09-15T22:50:22.301938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488128+0000","last_change":"2024-09-15T22:50:21.328492+0000","last_active":"2024-09-15T22:50:22.488128+0000","last_peered":"2024-09-15T22:50:22.488128+0000","last_clean":"2024-09-15T22:50:22.488128+0000","last_became_active":"2024-09-15T22:50:21.327821+0000","last_became_peered":"2024-09-15T22:50:21.327821+0000","last_unstale":"2024-09-15T22:50:22.488128+0000","last_undegraded":"2024-09-15T22:50:22.488128+0000","last_fullsized":"2024-09-15T22:50:22.488128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485106+0000","last_change":"2024-09-15T22:50:17.048995+0000","last_active":"2024-09-15T22:50:22.485106+0000","last_peered":"2024-09-15T22:50:22.485106+0000","last_clean":"2024-09-15T22:50:22.485106+0000","last_became_active":"2024-09-15T22:50:17.048715+0000","last_became_peered":"2024-09-15T22:50:17.048715+0000","last_unstale":"2024-09-15T22:50:22.485106+0000","last_undegraded":"2024-09-15T22:50:22.485106+0000","last_fullsized":"2024-09-15T22:50:22.485106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:53.664696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486222+0000","last_change":"2024-09-15T22:50:16.072709+0000","last_active":"2024-09-15T22:50:22.486222+0000","last_peered":"2024-09-15T22:50:22.486222+0000","last_clean":"2024-09-15T22:50:22.486222+0000","last_became_active":"2024-09-15T22:50:16.072241+0000","last_became_peered":"2024-09-15T22:50:16.072241+0000","last_unstale":"2024-09-15T22:50:22.486222+0000","last_undegraded":"2024-09-15T22:50:22.486222+0000","last_fullsized":"2024-09-15T22:50:22.486222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486771+0000","last_change":"2024-09-15T22:50:21.386663+0000","last_active":"2024-09-15T22:50:22.486771+0000","last_peered":"2024-09-15T22:50:22.486771+0000","last_clean":"2024-09-15T22:50:22.486771+0000","last_became_active":"2024-09-15T22:50:21.386297+0000","last_became_peered":"2024-09-15T22:50:21.386297+0000","last_unstale":"2024-09-15T22:50:22.486771+0000","last_undegraded":"2024-09-15T22:50:22.486771+0000","last_fullsized":"2024-09-15T22:50:22.486771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:39.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485330+0000","last_change":"2024-09-15T22:50:17.059375+0000","last_active":"2024-09-15T22:50:22.485330+0000","last_peered":"2024-09-15T22:50:22.485330+0000","last_clean":"2024-09-15T22:50:22.485330+0000","last_became_active":"2024-09-15T22:50:17.059132+0000","last_became_peered":"2024-09-15T22:50:17.059132+0000","last_unstale":"2024-09-15T22:50:22.485330+0000","last_undegraded":"2024-09-15T22:50:22.485330+0000","last_fullsized":"2024-09-15T22:50:22.485330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:16.056464+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:16.055773+0000","last_became_peered":"2024-09-15T22:50:16.055773+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:58.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486332+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:50:22.486332+0000","last_peered":"2024-09-15T22:50:22.486332+0000","last_clean":"2024-09-15T22:50:22.486332+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:50:22.486332+0000","last_undegraded":"2024-09-15T22:50:22.486332+0000","last_fullsized":"2024-09-15T22:50:22.486332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486472+0000","last_change":"2024-09-15T22:50:21.392217+0000","last_active":"2024-09-15T22:50:22.486472+0000","last_peered":"2024-09-15T22:50:22.486472+0000","last_clean":"2024-09-15T22:50:22.486472+0000","last_became_active":"2024-09-15T22:50:21.387886+0000","last_became_peered":"2024-09-15T22:50:21.387886+0000","last_unstale":"2024-09-15T22:50:22.486472+0000","last_undegraded":"2024-09-15T22:50:22.486472+0000","last_fullsized":"2024-09-15T22:50:22.486472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486289+0000","last_change":"2024-09-15T22:50:17.072970+0000","last_active":"2024-09-15T22:50:22.486289+0000","last_peered":"2024-09-15T22:50:22.486289+0000","last_clean":"2024-09-15T22:50:22.486289+0000","last_became_active":"2024-09-15T22:50:17.072660+0000","last_became_peered":"2024-09-15T22:50:17.072660+0000","last_unstale":"2024-09-15T22:50:22.486289+0000","last_undegraded":"2024-09-15T22:50:22.486289+0000","last_fullsized":"2024-09-15T22:50:22.486289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302167+0000","last_change":"2024-09-15T22:50:16.069049+0000","last_active":"2024-09-15T22:50:22.302167+0000","last_peered":"2024-09-15T22:50:22.302167+0000","last_clean":"2024-09-15T22:50:22.302167+0000","last_became_active":"2024-09-15T22:50:16.068684+0000","last_became_peered":"2024-09-15T22:50:16.068684+0000","last_unstale":"2024-09-15T22:50:22.302167+0000","last_undegraded":"2024-09-15T22:50:22.302167+0000","last_fullsized":"2024-09-15T22:50:22.302167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486339+0000","last_change":"2024-09-15T22:50:21.385944+0000","last_active":"2024-09-15T22:50:22.486339+0000","last_peered":"2024-09-15T22:50:22.486339+0000","last_clean":"2024-09-15T22:50:22.486339+0000","last_became_active":"2024-09-15T22:50:21.385537+0000","last_became_peered":"2024-09-15T22:50:21.385537+0000","last_unstale":"2024-09-15T22:50:22.486339+0000","last_undegraded":"2024-09-15T22:50:22.486339+0000","last_fullsized":"2024-09-15T22:50:22.486339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305085+0000","last_change":"2024-09-15T22:50:17.067273+0000","last_active":"2024-09-15T22:50:22.305085+0000","last_peered":"2024-09-15T22:50:22.305085+0000","last_clean":"2024-09-15T22:50:22.305085+0000","last_became_active":"2024-09-15T22:50:17.066944+0000","last_became_peered":"2024-09-15T22:50:17.066944+0000","last_unstale":"2024-09-15T22:50:22.305085+0000","last_undegraded":"2024-09-15T22:50:22.305085+0000","last_fullsized":"2024-09-15T22:50:22.305085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:59.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487904+0000","last_change":"2024-09-15T22:50:16.059543+0000","last_active":"2024-09-15T22:50:22.487904+0000","last_peered":"2024-09-15T22:50:22.487904+0000","last_clean":"2024-09-15T22:50:22.487904+0000","last_became_active":"2024-09-15T22:50:16.056601+0000","last_became_peered":"2024-09-15T22:50:16.056601+0000","last_unstale":"2024-09-15T22:50:22.487904+0000","last_undegraded":"2024-09-15T22:50:22.487904+0000","last_fullsized":"2024-09-15T22:50:22.487904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485917+0000","last_change":"2024-09-15T22:50:21.330038+0000","last_active":"2024-09-15T22:50:22.485917+0000","last_peered":"2024-09-15T22:50:22.485917+0000","last_clean":"2024-09-15T22:50:22.485917+0000","last_became_active":"2024-09-15T22:50:21.329579+0000","last_became_peered":"2024-09-15T22:50:21.329579+0000","last_unstale":"2024-09-15T22:50:22.485917+0000","last_undegraded":"2024-09-15T22:50:22.485917+0000","last_fullsized":"2024-09-15T22:50:22.485917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487400+0000","last_change":"2024-09-15T22:50:17.066201+0000","last_active":"2024-09-15T22:50:22.487400+0000","last_peered":"2024-09-15T22:50:22.487400+0000","last_clean":"2024-09-15T22:50:22.487400+0000","last_became_active":"2024-09-15T22:50:17.065922+0000","last_became_peered":"2024-09-15T22:50:17.065922+0000","last_unstale":"2024-09-15T22:50:22.487400+0000","last_undegraded":"2024-09-15T22:50:22.487400+0000","last_fullsized":"2024-09-15T22:50:22.487400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:13.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302362+0000","last_change":"2024-09-15T22:50:16.059590+0000","last_active":"2024-09-15T22:50:22.302362+0000","last_peered":"2024-09-15T22:50:22.302362+0000","last_clean":"2024-09-15T22:50:22.302362+0000","last_became_active":"2024-09-15T22:50:16.059168+0000","last_became_peered":"2024-09-15T22:50:16.059168+0000","last_unstale":"2024-09-15T22:50:22.302362+0000","last_undegraded":"2024-09-15T22:50:22.302362+0000","last_fullsized":"2024-09-15T22:50:22.302362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304215+0000","last_change":"2024-09-15T22:50:21.387467+0000","last_active":"2024-09-15T22:50:22.304215+0000","last_peered":"2024-09-15T22:50:22.304215+0000","last_clean":"2024-09-15T22:50:22.304215+0000","last_became_active":"2024-09-15T22:50:21.387053+0000","last_became_peered":"2024-09-15T22:50:21.387053+0000","last_unstale":"2024-09-15T22:50:22.304215+0000","last_undegraded":"2024-09-15T22:50:22.304215+0000","last_fullsized":"2024-09-15T22:50:22.304215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:55.525858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487044+0000","last_change":"2024-09-15T22:50:17.073751+0000","last_active":"2024-09-15T22:50:22.487044+0000","last_peered":"2024-09-15T22:50:22.487044+0000","last_clean":"2024-09-15T22:50:22.487044+0000","last_became_active":"2024-09-15T22:50:17.065140+0000","last_became_peered":"2024-09-15T22:50:17.065140+0000","last_unstale":"2024-09-15T22:50:22.487044+0000","last_undegraded":"2024-09-15T22:50:22.487044+0000","last_fullsized":"2024-09-15T22:50:22.487044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:19.682526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305439+0000","last_change":"2024-09-15T22:50:16.065101+0000","last_active":"2024-09-15T22:50:22.305439+0000","last_peered":"2024-09-15T22:50:22.305439+0000","last_clean":"2024-09-15T22:50:22.305439+0000","last_became_active":"2024-09-15T22:50:16.064796+0000","last_became_peered":"2024-09-15T22:50:16.064796+0000","last_unstale":"2024-09-15T22:50:22.305439+0000","last_undegraded":"2024-09-15T22:50:22.305439+0000","last_fullsized":"2024-09-15T22:50:22.305439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:16.223077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304254+0000","last_change":"2024-09-15T22:50:21.331825+0000","last_active":"2024-09-15T22:50:22.304254+0000","last_peered":"2024-09-15T22:50:22.304254+0000","last_clean":"2024-09-15T22:50:22.304254+0000","last_became_active":"2024-09-15T22:50:21.331115+0000","last_became_peered":"2024-09-15T22:50:21.331115+0000","last_unstale":"2024-09-15T22:50:22.304254+0000","last_undegraded":"2024-09-15T22:50:22.304254+0000","last_fullsized":"2024-09-15T22:50:22.304254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:22.486441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486479+0000","last_change":"2024-09-15T22:50:17.069472+0000","last_active":"2024-09-15T22:50:22.486479+0000","last_peered":"2024-09-15T22:50:22.486479+0000","last_clean":"2024-09-15T22:50:22.486479+0000","last_became_active":"2024-09-15T22:50:17.066357+0000","last_became_peered":"2024-09-15T22:50:17.066357+0000","last_unstale":"2024-09-15T22:50:22.486479+0000","last_undegraded":"2024-09-15T22:50:22.486479+0000","last_fullsized":"2024-09-15T22:50:22.486479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301701+0000","last_change":"2024-09-15T22:50:16.054885+0000","last_active":"2024-09-15T22:50:22.301701+0000","last_peered":"2024-09-15T22:50:22.301701+0000","last_clean":"2024-09-15T22:50:22.301701+0000","last_became_active":"2024-09-15T22:50:16.054595+0000","last_became_peered":"2024-09-15T22:50:16.054595+0000","last_unstale":"2024-09-15T22:50:22.301701+0000","last_undegraded":"2024-09-15T22:50:22.301701+0000","last_fullsized":"2024-09-15T22:50:22.301701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486700+0000","last_change":"2024-09-15T22:50:21.326386+0000","last_active":"2024-09-15T22:50:22.486700+0000","last_peered":"2024-09-15T22:50:22.486700+0000","last_clean":"2024-09-15T22:50:22.486700+0000","last_became_active":"2024-09-15T22:50:21.323287+0000","last_became_peered":"2024-09-15T22:50:21.323287+0000","last_unstale":"2024-09-15T22:50:22.486700+0000","last_undegraded":"2024-09-15T22:50:22.486700+0000","last_fullsized":"2024-09-15T22:50:22.486700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485918+0000","last_change":"2024-09-15T22:50:17.075345+0000","last_active":"2024-09-15T22:50:22.485918+0000","last_peered":"2024-09-15T22:50:22.485918+0000","last_clean":"2024-09-15T22:50:22.485918+0000","last_became_active":"2024-09-15T22:50:17.071860+0000","last_became_peered":"2024-09-15T22:50:17.071860+0000","last_unstale":"2024-09-15T22:50:22.485918+0000","last_undegraded":"2024-09-15T22:50:22.485918+0000","last_fullsized":"2024-09-15T22:50:22.485918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486616+0000","last_change":"2024-09-15T22:50:16.066823+0000","last_active":"2024-09-15T22:50:22.486616+0000","last_peered":"2024-09-15T22:50:22.486616+0000","last_clean":"2024-09-15T22:50:22.486616+0000","last_became_active":"2024-09-15T22:50:16.066066+0000","last_became_peered":"2024-09-15T22:50:16.066066+0000","last_unstale":"2024-09-15T22:50:22.486616+0000","last_undegraded":"2024-09-15T22:50:22.486616+0000","last_fullsized":"2024-09-15T22:50:22.486616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484534+0000","last_change":"2024-09-15T22:50:21.387848+0000","last_active":"2024-09-15T22:50:22.484534+0000","last_peered":"2024-09-15T22:50:22.484534+0000","last_clean":"2024-09-15T22:50:22.484534+0000","last_became_active":"2024-09-15T22:50:21.387224+0000","last_became_peered":"2024-09-15T22:50:21.387224+0000","last_unstale":"2024-09-15T22:50:22.484534+0000","last_undegraded":"2024-09-15T22:50:22.484534+0000","last_fullsized":"2024-09-15T22:50:22.484534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.174091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486681+0000","last_change":"2024-09-15T22:50:17.071304+0000","last_active":"2024-09-15T22:50:22.486681+0000","last_peered":"2024-09-15T22:50:22.486681+0000","last_clean":"2024-09-15T22:50:22.486681+0000","last_became_active":"2024-09-15T22:50:17.070613+0000","last_became_peered":"2024-09-15T22:50:17.070613+0000","last_unstale":"2024-09-15T22:50:22.486681+0000","last_undegraded":"2024-09-15T22:50:22.486681+0000","last_fullsized":"2024-09-15T22:50:22.486681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:02.870943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305454+0000","last_change":"2024-09-15T22:50:16.069513+0000","last_active":"2024-09-15T22:50:22.305454+0000","last_peered":"2024-09-15T22:50:22.305454+0000","last_clean":"2024-09-15T22:50:22.305454+0000","last_became_active":"2024-09-15T22:50:16.069194+0000","last_became_peered":"2024-09-15T22:50:16.069194+0000","last_unstale":"2024-09-15T22:50:22.305454+0000","last_undegraded":"2024-09-15T22:50:22.305454+0000","last_fullsized":"2024-09-15T22:50:22.305454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:32.487332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484440+0000","last_change":"2024-09-15T22:50:21.385231+0000","last_active":"2024-09-15T22:50:22.484440+0000","last_peered":"2024-09-15T22:50:22.484440+0000","last_clean":"2024-09-15T22:50:22.484440+0000","last_became_active":"2024-09-15T22:50:21.384687+0000","last_became_peered":"2024-09-15T22:50:21.384687+0000","last_unstale":"2024-09-15T22:50:22.484440+0000","last_undegraded":"2024-09-15T22:50:22.484440+0000","last_fullsized":"2024-09-15T22:50:22.484440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:58.714208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485419+0000","last_change":"2024-09-15T22:50:17.062760+0000","last_active":"2024-09-15T22:50:22.485419+0000","last_peered":"2024-09-15T22:50:22.485419+0000","last_clean":"2024-09-15T22:50:22.485419+0000","last_became_active":"2024-09-15T22:50:17.062472+0000","last_became_peered":"2024-09-15T22:50:17.062472+0000","last_unstale":"2024-09-15T22:50:22.485419+0000","last_undegraded":"2024-09-15T22:50:22.485419+0000","last_fullsized":"2024-09-15T22:50:22.485419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:55.399729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486167+0000","last_change":"2024-09-15T22:50:16.060509+0000","last_active":"2024-09-15T22:50:22.486167+0000","last_peered":"2024-09-15T22:50:22.486167+0000","last_clean":"2024-09-15T22:50:22.486167+0000","last_became_active":"2024-09-15T22:50:16.060218+0000","last_became_peered":"2024-09-15T22:50:16.060218+0000","last_unstale":"2024-09-15T22:50:22.486167+0000","last_undegraded":"2024-09-15T22:50:22.486167+0000","last_fullsized":"2024-09-15T22:50:22.486167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305780+0000","last_change":"2024-09-15T22:50:21.389097+0000","last_active":"2024-09-15T22:50:22.305780+0000","last_peered":"2024-09-15T22:50:22.305780+0000","last_clean":"2024-09-15T22:50:22.305780+0000","last_became_active":"2024-09-15T22:50:21.388634+0000","last_became_peered":"2024-09-15T22:50:21.388634+0000","last_unstale":"2024-09-15T22:50:22.305780+0000","last_undegraded":"2024-09-15T22:50:22.305780+0000","last_fullsized":"2024-09-15T22:50:22.305780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.326409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486187+0000","last_change":"2024-09-15T22:50:17.077973+0000","last_active":"2024-09-15T22:50:22.486187+0000","last_peered":"2024-09-15T22:50:22.486187+0000","last_clean":"2024-09-15T22:50:22.486187+0000","last_became_active":"2024-09-15T22:50:17.077686+0000","last_became_peered":"2024-09-15T22:50:17.077686+0000","last_unstale":"2024-09-15T22:50:22.486187+0000","last_undegraded":"2024-09-15T22:50:22.486187+0000","last_fullsized":"2024-09-15T22:50:22.486187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:28.191364+0000","last_change":"2024-09-15T22:50:16.062195+0000","last_active":"2024-09-15T22:50:28.191364+0000","last_peered":"2024-09-15T22:50:28.191364+0000","last_clean":"2024-09-15T22:50:28.191364+0000","last_became_active":"2024-09-15T22:50:16.061907+0000","last_became_peered":"2024-09-15T22:50:16.061907+0000","last_unstale":"2024-09-15T22:50:28.191364+0000","last_undegraded":"2024-09-15T22:50:28.191364+0000","last_fullsized":"2024-09-15T22:50:28.191364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485394+0000","last_change":"2024-09-15T22:50:21.332064+0000","last_active":"2024-09-15T22:50:22.485394+0000","last_peered":"2024-09-15T22:50:22.485394+0000","last_clean":"2024-09-15T22:50:22.485394+0000","last_became_active":"2024-09-15T22:50:21.331679+0000","last_became_peered":"2024-09-15T22:50:21.331679+0000","last_unstale":"2024-09-15T22:50:22.485394+0000","last_undegraded":"2024-09-15T22:50:22.485394+0000","last_fullsized":"2024-09-15T22:50:22.485394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306155+0000","last_change":"2024-09-15T22:50:17.066523+0000","last_active":"2024-09-15T22:50:22.306155+0000","last_peered":"2024-09-15T22:50:22.306155+0000","last_clean":"2024-09-15T22:50:22.306155+0000","last_became_active":"2024-09-15T22:50:17.066271+0000","last_became_peered":"2024-09-15T22:50:17.066271+0000","last_unstale":"2024-09-15T22:50:22.306155+0000","last_undegraded":"2024-09-15T22:50:22.306155+0000","last_fullsized":"2024-09-15T22:50:22.306155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487798+0000","last_change":"2024-09-15T22:50:16.072533+0000","last_active":"2024-09-15T22:50:22.487798+0000","last_peered":"2024-09-15T22:50:22.487798+0000","last_clean":"2024-09-15T22:50:22.487798+0000","last_became_active":"2024-09-15T22:50:16.072230+0000","last_became_peered":"2024-09-15T22:50:16.072230+0000","last_unstale":"2024-09-15T22:50:22.487798+0000","last_undegraded":"2024-09-15T22:50:22.487798+0000","last_fullsized":"2024-09-15T22:50:22.487798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305802+0000","last_change":"2024-09-15T22:50:21.333434+0000","last_active":"2024-09-15T22:50:22.305802+0000","last_peered":"2024-09-15T22:50:22.305802+0000","last_clean":"2024-09-15T22:50:22.305802+0000","last_became_active":"2024-09-15T22:50:21.332505+0000","last_became_peered":"2024-09-15T22:50:21.332505+0000","last_unstale":"2024-09-15T22:50:22.305802+0000","last_undegraded":"2024-09-15T22:50:22.305802+0000","last_fullsized":"2024-09-15T22:50:22.305802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486491+0000","last_change":"2024-09-15T22:50:17.052446+0000","last_active":"2024-09-15T22:50:22.486491+0000","last_peered":"2024-09-15T22:50:22.486491+0000","last_clean":"2024-09-15T22:50:22.486491+0000","last_became_active":"2024-09-15T22:50:17.052187+0000","last_became_peered":"2024-09-15T22:50:17.052187+0000","last_unstale":"2024-09-15T22:50:22.486491+0000","last_undegraded":"2024-09-15T22:50:22.486491+0000","last_fullsized":"2024-09-15T22:50:22.486491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306067+0000","last_change":"2024-09-15T22:50:16.067884+0000","last_active":"2024-09-15T22:50:22.306067+0000","last_peered":"2024-09-15T22:50:22.306067+0000","last_clean":"2024-09-15T22:50:22.306067+0000","last_became_active":"2024-09-15T22:50:16.067613+0000","last_became_peered":"2024-09-15T22:50:16.067613+0000","last_unstale":"2024-09-15T22:50:22.306067+0000","last_undegraded":"2024-09-15T22:50:22.306067+0000","last_fullsized":"2024-09-15T22:50:22.306067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:02.473555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484670+0000","last_change":"2024-09-15T22:50:21.329190+0000","last_active":"2024-09-15T22:50:22.484670+0000","last_peered":"2024-09-15T22:50:22.484670+0000","last_clean":"2024-09-15T22:50:22.484670+0000","last_became_active":"2024-09-15T22:50:21.328672+0000","last_became_peered":"2024-09-15T22:50:21.328672+0000","last_unstale":"2024-09-15T22:50:22.484670+0000","last_undegraded":"2024-09-15T22:50:22.484670+0000","last_fullsized":"2024-09-15T22:50:22.484670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:10.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306101+0000","last_change":"2024-09-15T22:50:17.065691+0000","last_active":"2024-09-15T22:50:22.306101+0000","last_peered":"2024-09-15T22:50:22.306101+0000","last_clean":"2024-09-15T22:50:22.306101+0000","last_became_active":"2024-09-15T22:50:17.065428+0000","last_became_peered":"2024-09-15T22:50:17.065428+0000","last_unstale":"2024-09-15T22:50:22.306101+0000","last_undegraded":"2024-09-15T22:50:22.306101+0000","last_fullsized":"2024-09-15T22:50:22.306101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:42.029371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486901+0000","last_change":"2024-09-15T22:50:16.071238+0000","last_active":"2024-09-15T22:50:22.486901+0000","last_peered":"2024-09-15T22:50:22.486901+0000","last_clean":"2024-09-15T22:50:22.486901+0000","last_became_active":"2024-09-15T22:50:16.070890+0000","last_became_peered":"2024-09-15T22:50:16.070890+0000","last_unstale":"2024-09-15T22:50:22.486901+0000","last_undegraded":"2024-09-15T22:50:22.486901+0000","last_fullsized":"2024-09-15T22:50:22.486901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484106+0000","last_change":"2024-09-15T22:50:21.387626+0000","last_active":"2024-09-15T22:50:22.484106+0000","last_peered":"2024-09-15T22:50:22.484106+0000","last_clean":"2024-09-15T22:50:22.484106+0000","last_became_active":"2024-09-15T22:50:21.386716+0000","last_became_peered":"2024-09-15T22:50:21.386716+0000","last_unstale":"2024-09-15T22:50:22.484106+0000","last_undegraded":"2024-09-15T22:50:22.484106+0000","last_fullsized":"2024-09-15T22:50:22.484106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:12.968147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486614+0000","last_change":"2024-09-15T22:50:21.386695+0000","last_active":"2024-09-15T22:50:22.486614+0000","last_peered":"2024-09-15T22:50:22.486614+0000","last_clean":"2024-09-15T22:50:22.486614+0000","last_became_active":"2024-09-15T22:50:21.386288+0000","last_became_peered":"2024-09-15T22:50:21.386288+0000","last_unstale":"2024-09-15T22:50:22.486614+0000","last_undegraded":"2024-09-15T22:50:22.486614+0000","last_fullsized":"2024-09-15T22:50:22.486614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486042+0000","last_change":"2024-09-15T22:50:17.071310+0000","last_active":"2024-09-15T22:50:22.486042+0000","last_peered":"2024-09-15T22:50:22.486042+0000","last_clean":"2024-09-15T22:50:22.486042+0000","last_became_active":"2024-09-15T22:50:17.070951+0000","last_became_peered":"2024-09-15T22:50:17.070951+0000","last_unstale":"2024-09-15T22:50:22.486042+0000","last_undegraded":"2024-09-15T22:50:22.486042+0000","last_fullsized":"2024-09-15T22:50:22.486042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304617+0000","last_change":"2024-09-15T22:50:16.062316+0000","last_active":"2024-09-15T22:50:22.304617+0000","last_peered":"2024-09-15T22:50:22.304617+0000","last_clean":"2024-09-15T22:50:22.304617+0000","last_became_active":"2024-09-15T22:50:16.062018+0000","last_became_peered":"2024-09-15T22:50:16.062018+0000","last_unstale":"2024-09-15T22:50:22.304617+0000","last_undegraded":"2024-09-15T22:50:22.304617+0000","last_fullsized":"2024-09-15T22:50:22.304617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:18.421004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486740+0000","last_change":"2024-09-15T22:50:21.334779+0000","last_active":"2024-09-15T22:50:22.486740+0000","last_peered":"2024-09-15T22:50:22.486740+0000","last_clean":"2024-09-15T22:50:22.486740+0000","last_became_active":"2024-09-15T22:50:21.334375+0000","last_became_peered":"2024-09-15T22:50:21.334375+0000","last_unstale":"2024-09-15T22:50:22.486740+0000","last_undegraded":"2024-09-15T22:50:22.486740+0000","last_fullsized":"2024-09-15T22:50:22.486740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484755+0000","last_change":"2024-09-15T22:50:17.068912+0000","last_active":"2024-09-15T22:50:22.484755+0000","last_peered":"2024-09-15T22:50:22.484755+0000","last_clean":"2024-09-15T22:50:22.484755+0000","last_became_active":"2024-09-15T22:50:17.068633+0000","last_became_peered":"2024-09-15T22:50:17.068633+0000","last_unstale":"2024-09-15T22:50:22.484755+0000","last_undegraded":"2024-09-15T22:50:22.484755+0000","last_fullsized":"2024-09-15T22:50:22.484755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484365+0000","last_change":"2024-09-15T22:50:16.063180+0000","last_active":"2024-09-15T22:50:22.484365+0000","last_peered":"2024-09-15T22:50:22.484365+0000","last_clean":"2024-09-15T22:50:22.484365+0000","last_became_active":"2024-09-15T22:50:16.062573+0000","last_became_peered":"2024-09-15T22:50:16.062573+0000","last_unstale":"2024-09-15T22:50:22.484365+0000","last_undegraded":"2024-09-15T22:50:22.484365+0000","last_fullsized":"2024-09-15T22:50:22.484365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486218+0000","last_change":"2024-09-15T22:50:16.061455+0000","last_active":"2024-09-15T22:50:22.486218+0000","last_peered":"2024-09-15T22:50:22.486218+0000","last_clean":"2024-09-15T22:50:22.486218+0000","last_became_active":"2024-09-15T22:50:16.061101+0000","last_became_peered":"2024-09-15T22:50:16.061101+0000","last_unstale":"2024-09-15T22:50:22.486218+0000","last_undegraded":"2024-09-15T22:50:22.486218+0000","last_fullsized":"2024-09-15T22:50:22.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486076+0000","last_change":"2024-09-15T22:50:17.051703+0000","last_active":"2024-09-15T22:50:22.486076+0000","last_peered":"2024-09-15T22:50:22.486076+0000","last_clean":"2024-09-15T22:50:22.486076+0000","last_became_active":"2024-09-15T22:50:17.051442+0000","last_became_peered":"2024-09-15T22:50:17.051442+0000","last_unstale":"2024-09-15T22:50:22.486076+0000","last_undegraded":"2024-09-15T22:50:22.486076+0000","last_fullsized":"2024-09-15T22:50:22.486076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302396+0000","last_change":"2024-09-15T22:50:21.330393+0000","last_active":"2024-09-15T22:50:22.302396+0000","last_peered":"2024-09-15T22:50:22.302396+0000","last_clean":"2024-09-15T22:50:22.302396+0000","last_became_active":"2024-09-15T22:50:21.329923+0000","last_became_peered":"2024-09-15T22:50:21.329923+0000","last_unstale":"2024-09-15T22:50:22.302396+0000","last_undegraded":"2024-09-15T22:50:22.302396+0000","last_fullsized":"2024-09-15T22:50:22.302396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.927144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484326+0000","last_change":"2024-09-15T22:50:16.062501+0000","last_active":"2024-09-15T22:50:22.484326+0000","last_peered":"2024-09-15T22:50:22.484326+0000","last_clean":"2024-09-15T22:50:22.484326+0000","last_became_active":"2024-09-15T22:50:16.061957+0000","last_became_peered":"2024-09-15T22:50:16.061957+0000","last_unstale":"2024-09-15T22:50:22.484326+0000","last_undegraded":"2024-09-15T22:50:22.484326+0000","last_fullsized":"2024-09-15T22:50:22.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305592+0000","last_change":"2024-09-15T22:50:17.057565+0000","last_active":"2024-09-15T22:50:22.305592+0000","last_peered":"2024-09-15T22:50:22.305592+0000","last_clean":"2024-09-15T22:50:22.305592+0000","last_became_active":"2024-09-15T22:50:17.057276+0000","last_became_peered":"2024-09-15T22:50:17.057276+0000","last_unstale":"2024-09-15T22:50:22.305592+0000","last_undegraded":"2024-09-15T22:50:22.305592+0000","last_fullsized":"2024-09-15T22:50:22.305592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:03.054052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484704+0000","last_change":"2024-09-15T22:50:21.330952+0000","last_active":"2024-09-15T22:50:22.484704+0000","last_peered":"2024-09-15T22:50:22.484704+0000","last_clean":"2024-09-15T22:50:22.484704+0000","last_became_active":"2024-09-15T22:50:21.330543+0000","last_became_peered":"2024-09-15T22:50:21.330543+0000","last_unstale":"2024-09-15T22:50:22.484704+0000","last_undegraded":"2024-09-15T22:50:22.484704+0000","last_fullsized":"2024-09-15T22:50:22.484704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:57.065313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485812+0000","last_change":"2024-09-15T22:50:17.075360+0000","last_active":"2024-09-15T22:50:22.485812+0000","last_peered":"2024-09-15T22:50:22.485812+0000","last_clean":"2024-09-15T22:50:22.485812+0000","last_became_active":"2024-09-15T22:50:17.072943+0000","last_became_peered":"2024-09-15T22:50:17.072943+0000","last_unstale":"2024-09-15T22:50:22.485812+0000","last_undegraded":"2024-09-15T22:50:22.485812+0000","last_fullsized":"2024-09-15T22:50:22.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301837+0000","last_change":"2024-09-15T22:50:17.062719+0000","last_active":"2024-09-15T22:50:22.301837+0000","last_peered":"2024-09-15T22:50:22.301837+0000","last_clean":"2024-09-15T22:50:22.301837+0000","last_became_active":"2024-09-15T22:50:17.060683+0000","last_became_peered":"2024-09-15T22:50:17.060683+0000","last_unstale":"2024-09-15T22:50:22.301837+0000","last_undegraded":"2024-09-15T22:50:22.301837+0000","last_fullsized":"2024-09-15T22:50:22.301837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305406+0000","last_change":"2024-09-15T22:50:17.067025+0000","last_active":"2024-09-15T22:50:22.305406+0000","last_peered":"2024-09-15T22:50:22.305406+0000","last_clean":"2024-09-15T22:50:22.305406+0000","last_became_active":"2024-09-15T22:50:17.066744+0000","last_became_peered":"2024-09-15T22:50:17.066744+0000","last_unstale":"2024-09-15T22:50:22.305406+0000","last_undegraded":"2024-09-15T22:50:22.305406+0000","last_fullsized":"2024-09-15T22:50:22.305406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:50.397722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485996+0000","last_change":"2024-09-15T22:50:17.080748+0000","last_active":"2024-09-15T22:50:22.485996+0000","last_peered":"2024-09-15T22:50:22.485996+0000","last_clean":"2024-09-15T22:50:22.485996+0000","last_became_active":"2024-09-15T22:50:17.080432+0000","last_became_peered":"2024-09-15T22:50:17.080432+0000","last_unstale":"2024-09-15T22:50:22.485996+0000","last_undegraded":"2024-09-15T22:50:22.485996+0000","last_fullsized":"2024-09-15T22:50:22.485996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484735+0000","last_change":"2024-09-15T22:50:17.057480+0000","last_active":"2024-09-15T22:50:22.484735+0000","last_peered":"2024-09-15T22:50:22.484735+0000","last_clean":"2024-09-15T22:50:22.484735+0000","last_became_active":"2024-09-15T22:50:17.056801+0000","last_became_peered":"2024-09-15T22:50:17.056801+0000","last_unstale":"2024-09-15T22:50:22.484735+0000","last_undegraded":"2024-09-15T22:50:22.484735+0000","last_fullsized":"2024-09-15T22:50:22.484735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487677+0000","last_change":"2024-09-15T22:50:17.070941+0000","last_active":"2024-09-15T22:50:22.487677+0000","last_peered":"2024-09-15T22:50:22.487677+0000","last_clean":"2024-09-15T22:50:22.487677+0000","last_became_active":"2024-09-15T22:50:17.070675+0000","last_became_peered":"2024-09-15T22:50:17.070675+0000","last_unstale":"2024-09-15T22:50:22.487677+0000","last_undegraded":"2024-09-15T22:50:22.487677+0000","last_fullsized":"2024-09-15T22:50:22.487677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487164+0000","last_change":"2024-09-15T22:50:17.069743+0000","last_active":"2024-09-15T22:50:22.487164+0000","last_peered":"2024-09-15T22:50:22.487164+0000","last_clean":"2024-09-15T22:50:22.487164+0000","last_became_active":"2024-09-15T22:50:17.069457+0000","last_became_peered":"2024-09-15T22:50:17.069457+0000","last_unstale":"2024-09-15T22:50:22.487164+0000","last_undegraded":"2024-09-15T22:50:22.487164+0000","last_fullsized":"2024-09-15T22:50:22.487164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484640+0000","last_change":"2024-09-15T22:50:17.061920+0000","last_active":"2024-09-15T22:50:22.484640+0000","last_peered":"2024-09-15T22:50:22.484640+0000","last_clean":"2024-09-15T22:50:22.484640+0000","last_became_active":"2024-09-15T22:50:17.061519+0000","last_became_peered":"2024-09-15T22:50:17.061519+0000","last_unstale":"2024-09-15T22:50:22.484640+0000","last_undegraded":"2024-09-15T22:50:22.484640+0000","last_fullsized":"2024-09-15T22:50:22.484640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304510+0000","last_change":"2024-09-15T22:50:17.073525+0000","last_active":"2024-09-15T22:50:22.304510+0000","last_peered":"2024-09-15T22:50:22.304510+0000","last_clean":"2024-09-15T22:50:22.304510+0000","last_became_active":"2024-09-15T22:50:17.073252+0000","last_became_peered":"2024-09-15T22:50:17.073252+0000","last_unstale":"2024-09-15T22:50:22.304510+0000","last_undegraded":"2024-09-15T22:50:22.304510+0000","last_fullsized":"2024-09-15T22:50:22.304510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:26.300782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484201+0000","last_change":"2024-09-15T22:50:17.062213+0000","last_active":"2024-09-15T22:50:22.484201+0000","last_peered":"2024-09-15T22:50:22.484201+0000","last_clean":"2024-09-15T22:50:22.484201+0000","last_became_active":"2024-09-15T22:50:17.061935+0000","last_became_peered":"2024-09-15T22:50:17.061935+0000","last_unstale":"2024-09-15T22:50:22.484201+0000","last_undegraded":"2024-09-15T22:50:22.484201+0000","last_fullsized":"2024-09-15T22:50:22.484201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305356+0000","last_change":"2024-09-15T22:50:17.065311+0000","last_active":"2024-09-15T22:50:22.305356+0000","last_peered":"2024-09-15T22:50:22.305356+0000","last_clean":"2024-09-15T22:50:22.305356+0000","last_became_active":"2024-09-15T22:50:17.064941+0000","last_became_peered":"2024-09-15T22:50:17.064941+0000","last_unstale":"2024-09-15T22:50:22.305356+0000","last_undegraded":"2024-09-15T22:50:22.305356+0000","last_fullsized":"2024-09-15T22:50:22.305356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:10.798798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485778+0000","last_change":"2024-09-15T22:50:17.066892+0000","last_active":"2024-09-15T22:50:22.485778+0000","last_peered":"2024-09-15T22:50:22.485778+0000","last_clean":"2024-09-15T22:50:22.485778+0000","last_became_active":"2024-09-15T22:50:17.066604+0000","last_became_peered":"2024-09-15T22:50:17.066604+0000","last_unstale":"2024-09-15T22:50:22.485778+0000","last_undegraded":"2024-09-15T22:50:22.485778+0000","last_fullsized":"2024-09-15T22:50:22.485778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486617+0000","last_change":"2024-09-15T22:50:17.063913+0000","last_active":"2024-09-15T22:50:22.486617+0000","last_peered":"2024-09-15T22:50:22.486617+0000","last_clean":"2024-09-15T22:50:22.486617+0000","last_became_active":"2024-09-15T22:50:17.063640+0000","last_became_peered":"2024-09-15T22:50:17.063640+0000","last_unstale":"2024-09-15T22:50:22.486617+0000","last_undegraded":"2024-09-15T22:50:22.486617+0000","last_fullsized":"2024-09-15T22:50:22.486617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486943+0000","last_change":"2024-09-15T22:50:17.065821+0000","last_active":"2024-09-15T22:50:22.486943+0000","last_peered":"2024-09-15T22:50:22.486943+0000","last_clean":"2024-09-15T22:50:22.486943+0000","last_became_active":"2024-09-15T22:50:17.065504+0000","last_became_peered":"2024-09-15T22:50:17.065504+0000","last_unstale":"2024-09-15T22:50:22.486943+0000","last_undegraded":"2024-09-15T22:50:22.486943+0000","last_fullsized":"2024-09-15T22:50:22.486943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:48.700096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302260+0000","last_change":"2024-09-15T22:50:17.059784+0000","last_active":"2024-09-15T22:50:22.302260+0000","last_peered":"2024-09-15T22:50:22.302260+0000","last_clean":"2024-09-15T22:50:22.302260+0000","last_became_active":"2024-09-15T22:50:17.059381+0000","last_became_peered":"2024-09-15T22:50:17.059381+0000","last_unstale":"2024-09-15T22:50:22.302260+0000","last_undegraded":"2024-09-15T22:50:22.302260+0000","last_fullsized":"2024-09-15T22:50:22.302260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306503+0000","last_change":"2024-09-15T22:50:17.069837+0000","last_active":"2024-09-15T22:50:22.306503+0000","last_peered":"2024-09-15T22:50:22.306503+0000","last_clean":"2024-09-15T22:50:22.306503+0000","last_became_active":"2024-09-15T22:50:17.068275+0000","last_became_peered":"2024-09-15T22:50:17.068275+0000","last_unstale":"2024-09-15T22:50:22.306503+0000","last_undegraded":"2024-09-15T22:50:22.306503+0000","last_fullsized":"2024-09-15T22:50:22.306503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.202716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304393+0000","last_change":"2024-09-15T22:50:17.047980+0000","last_active":"2024-09-15T22:50:22.304393+0000","last_peered":"2024-09-15T22:50:22.304393+0000","last_clean":"2024-09-15T22:50:22.304393+0000","last_became_active":"2024-09-15T22:50:17.047534+0000","last_became_peered":"2024-09-15T22:50:17.047534+0000","last_unstale":"2024-09-15T22:50:22.304393+0000","last_undegraded":"2024-09-15T22:50:22.304393+0000","last_fullsized":"2024-09-15T22:50:22.304393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:25.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486065+0000","last_change":"2024-09-15T22:50:17.064022+0000","last_active":"2024-09-15T22:50:22.486065+0000","last_peered":"2024-09-15T22:50:22.486065+0000","last_clean":"2024-09-15T22:50:22.486065+0000","last_became_active":"2024-09-15T22:50:17.063674+0000","last_became_peered":"2024-09-15T22:50:17.063674+0000","last_unstale":"2024-09-15T22:50:22.486065+0000","last_undegraded":"2024-09-15T22:50:22.486065+0000","last_fullsized":"2024-09-15T22:50:22.486065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485117+0000","last_change":"2024-09-15T22:50:17.068410+0000","last_active":"2024-09-15T22:50:22.485117+0000","last_peered":"2024-09-15T22:50:22.485117+0000","last_clean":"2024-09-15T22:50:22.485117+0000","last_became_active":"2024-09-15T22:50:17.068107+0000","last_became_peered":"2024-09-15T22:50:17.068107+0000","last_unstale":"2024-09-15T22:50:22.485117+0000","last_undegraded":"2024-09-15T22:50:22.485117+0000","last_fullsized":"2024-09-15T22:50:22.485117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:30.669334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484956+0000","last_change":"2024-09-15T22:50:17.065023+0000","last_active":"2024-09-15T22:50:22.484956+0000","last_peered":"2024-09-15T22:50:22.484956+0000","last_clean":"2024-09-15T22:50:22.484956+0000","last_became_active":"2024-09-15T22:50:17.062070+0000","last_became_peered":"2024-09-15T22:50:17.062070+0000","last_unstale":"2024-09-15T22:50:22.484956+0000","last_undegraded":"2024-09-15T22:50:22.484956+0000","last_fullsized":"2024-09-15T22:50:22.484956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306061+0000","last_change":"2024-09-15T22:50:17.057591+0000","last_active":"2024-09-15T22:50:22.306061+0000","last_peered":"2024-09-15T22:50:22.306061+0000","last_clean":"2024-09-15T22:50:22.306061+0000","last_became_active":"2024-09-15T22:50:17.057197+0000","last_became_peered":"2024-09-15T22:50:17.057197+0000","last_unstale":"2024-09-15T22:50:22.306061+0000","last_undegraded":"2024-09-15T22:50:22.306061+0000","last_fullsized":"2024-09-15T22:50:22.306061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:44.340627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486588+0000","last_change":"2024-09-15T22:50:17.068923+0000","last_active":"2024-09-15T22:50:22.486588+0000","last_peered":"2024-09-15T22:50:22.486588+0000","last_clean":"2024-09-15T22:50:22.486588+0000","last_became_active":"2024-09-15T22:50:17.068660+0000","last_became_peered":"2024-09-15T22:50:17.068660+0000","last_unstale":"2024-09-15T22:50:22.486588+0000","last_undegraded":"2024-09-15T22:50:22.486588+0000","last_fullsized":"2024-09-15T22:50:22.486588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487061+0000","last_change":"2024-09-15T22:50:17.061612+0000","last_active":"2024-09-15T22:50:22.487061+0000","last_peered":"2024-09-15T22:50:22.487061+0000","last_clean":"2024-09-15T22:50:22.487061+0000","last_became_active":"2024-09-15T22:50:17.061326+0000","last_became_peered":"2024-09-15T22:50:17.061326+0000","last_unstale":"2024-09-15T22:50:22.487061+0000","last_undegraded":"2024-09-15T22:50:22.487061+0000","last_fullsized":"2024-09-15T22:50:22.487061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487332+0000","last_change":"2024-09-15T22:50:17.069598+0000","last_active":"2024-09-15T22:50:22.487332+0000","last_peered":"2024-09-15T22:50:22.487332+0000","last_clean":"2024-09-15T22:50:22.487332+0000","last_became_active":"2024-09-15T22:50:17.069306+0000","last_became_peered":"2024-09-15T22:50:17.069306+0000","last_unstale":"2024-09-15T22:50:22.487332+0000","last_undegraded":"2024-09-15T22:50:22.487332+0000","last_fullsized":"2024-09-15T22:50:22.487332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.715006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484518+0000","last_change":"2024-09-15T22:50:17.065548+0000","last_active":"2024-09-15T22:50:22.484518+0000","last_peered":"2024-09-15T22:50:22.484518+0000","last_clean":"2024-09-15T22:50:22.484518+0000","last_became_active":"2024-09-15T22:50:17.065190+0000","last_became_peered":"2024-09-15T22:50:17.065190+0000","last_unstale":"2024-09-15T22:50:22.484518+0000","last_undegraded":"2024-09-15T22:50:22.484518+0000","last_fullsized":"2024-09-15T22:50:22.484518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486349+0000","last_change":"2024-09-15T22:50:17.076002+0000","last_active":"2024-09-15T22:50:22.486349+0000","last_peered":"2024-09-15T22:50:22.486349+0000","last_clean":"2024-09-15T22:50:22.486349+0000","last_became_active":"2024-09-15T22:50:17.075622+0000","last_became_peered":"2024-09-15T22:50:17.075622+0000","last_unstale":"2024-09-15T22:50:22.486349+0000","last_undegraded":"2024-09-15T22:50:22.486349+0000","last_fullsized":"2024-09-15T22:50:22.486349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305301+0000","last_change":"2024-09-15T22:50:17.047855+0000","last_active":"2024-09-15T22:50:22.305301+0000","last_peered":"2024-09-15T22:50:22.305301+0000","last_clean":"2024-09-15T22:50:22.305301+0000","last_became_active":"2024-09-15T22:50:17.047575+0000","last_became_peered":"2024-09-15T22:50:17.047575+0000","last_unstale":"2024-09-15T22:50:22.305301+0000","last_undegraded":"2024-09-15T22:50:22.305301+0000","last_fullsized":"2024-09-15T22:50:22.305301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:54.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486484+0000","last_change":"2024-09-15T22:50:17.065385+0000","last_active":"2024-09-15T22:50:22.486484+0000","last_peered":"2024-09-15T22:50:22.486484+0000","last_clean":"2024-09-15T22:50:22.486484+0000","last_became_active":"2024-09-15T22:50:17.065082+0000","last_became_peered":"2024-09-15T22:50:17.065082+0000","last_unstale":"2024-09-15T22:50:22.486484+0000","last_undegraded":"2024-09-15T22:50:22.486484+0000","last_fullsized":"2024-09-15T22:50:22.486484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:39.831313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:17.069029+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:17.068353+0000","last_became_peered":"2024-09-15T22:50:17.068353+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:10.316118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486448+0000","last_change":"2024-09-15T22:50:17.066254+0000","last_active":"2024-09-15T22:50:22.486448+0000","last_peered":"2024-09-15T22:50:22.486448+0000","last_clean":"2024-09-15T22:50:22.486448+0000","last_became_active":"2024-09-15T22:50:17.065906+0000","last_became_peered":"2024-09-15T22:50:17.065906+0000","last_unstale":"2024-09-15T22:50:22.486448+0000","last_undegraded":"2024-09-15T22:50:22.486448+0000","last_fullsized":"2024-09-15T22:50:22.486448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488087+0000","last_change":"2024-09-15T22:50:17.075262+0000","last_active":"2024-09-15T22:50:22.488087+0000","last_peered":"2024-09-15T22:50:22.488087+0000","last_clean":"2024-09-15T22:50:22.488087+0000","last_became_active":"2024-09-15T22:50:17.074935+0000","last_became_peered":"2024-09-15T22:50:17.074935+0000","last_unstale":"2024-09-15T22:50:22.488087+0000","last_undegraded":"2024-09-15T22:50:22.488087+0000","last_fullsized":"2024-09-15T22:50:22.488087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487272+0000","last_change":"2024-09-15T22:50:17.065618+0000","last_active":"2024-09-15T22:50:22.487272+0000","last_peered":"2024-09-15T22:50:22.487272+0000","last_clean":"2024-09-15T22:50:22.487272+0000","last_became_active":"2024-09-15T22:50:17.065380+0000","last_became_peered":"2024-09-15T22:50:17.065380+0000","last_unstale":"2024-09-15T22:50:22.487272+0000","last_undegraded":"2024-09-15T22:50:22.487272+0000","last_fullsized":"2024-09-15T22:50:22.487272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:41.033194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":860160,"data_stored":694509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:50:44.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:50:44.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 Processor -- start 2024-09-15T22:50:44.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 -- start start 2024-09-15T22:50:44.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0813fa40 0x7f1e0813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1e0806e160 0x7f1e0806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e081407b0 con 0x7f1e08072160 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1e0813f640 con 0x7f1e0806e160 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e10200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e081413c0 con 0x7f1e0813fa40 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0d800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1e08072160 0x7f1e08072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58616/0 (socket says 172.21.15.31:58616) 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0d800640 1 -- 172.21.15.31:0/2416512776 learned_addr learned my addr 172.21.15.31:0/2416512776 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2416512776 >> v2:172.21.15.31:3300/0 conn(0x7f1e0806e160 0x7f1e0806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0ce00640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0813fa40 0x7f1e0813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e07e00640 1 -- 172.21.15.31:0/2416512776 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886901686 0 0) 0x7f1e081407b0 con 0x7f1e08072160 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e07e00640 1 -- 172.21.15.31:0/2416512776 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1df0003530 con 0x7f1e08072160 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0e200640 1 -- 172.21.15.31:0/2416512776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0813fa40 msgr2=0x7f1e0813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0813fa40 0x7f1e0813fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0e200640 1 -- 172.21.15.31:0/2416512776 >> v1:172.21.15.31:6789/0 conn(0x7f1e08072160 legacy=0x7f1e08072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.389+0000 7f1e0e200640 1 -- 172.21.15.31:0/2416512776 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e08140a90 con 0x7f1e0806e160 2024-09-15T22:50:44.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0806e160 0x7f1e0806e610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009d90 tx=0x7f1e0001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b74ecebc50bab39 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e07e00640 1 -- 172.21.15.31:0/2416512776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000b2070 con 0x7f1e0806e160 2024-09-15T22:50:44.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e07e00640 1 -- 172.21.15.31:0/2416512776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e000a5890 con 0x7f1e0806e160 2024-09-15T22:50:44.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e07e00640 1 -- 172.21.15.31:0/2416512776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000a5c60 con 0x7f1e0806e160 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 -- 172.21.15.31:0/2416512776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0806e160 msgr2=0x7f1e0806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0806e160 0x7f1e0806e610 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f1e00009d90 tx=0x7f1e0001c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 -- 172.21.15.31:0/2416512776 shutdown_connections 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0806e160 0x7f1e0806e610 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 --2- 172.21.15.31:0/2416512776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0813fa40 0x7f1e0813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 -- 172.21.15.31:0/2416512776 >> 172.21.15.31:0/2416512776 conn(0x7f1e08067e00 msgr2=0x7f1e0806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:44.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 -- 172.21.15.31:0/2416512776 shutdown_connections 2024-09-15T22:50:44.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.393+0000 7f1e10200640 1 -- 172.21.15.31:0/2416512776 wait complete. 2024-09-15T22:50:44.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 Processor -- start 2024-09-15T22:50:44.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- start start 2024-09-15T22:50:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 0x7f1e0815aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e08072160 0x7f1e0813ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08168ee0 con 0x7f1e0813fa40 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1e08168d60 con 0x7f1e08072160 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1e08169060 con 0x7f1e0806e160 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39480/0 (socket says 172.21.15.31:39480) 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 -- 172.21.15.31:0/2928768963 learned_addr learned my addr 172.21.15.31:0/2928768963 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0d800640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 0x7f1e0815aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0ce00640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e08072160 0x7f1e0813ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 -- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 msgr2=0x7f1e0815aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.403 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 0x7f1e0815aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 -- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e08072160 msgr2=0x7f1e0813ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e08072160 0x7f1e0813ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 -- 172.21.15.31:0/2928768963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e0815af90 con 0x7f1e0813fa40 2024-09-15T22:50:44.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0d800640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 0x7f1e0815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:44.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e0e200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e0001af90 tx=0x7f1e00019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000b2050 con 0x7f1e0813fa40 2024-09-15T22:50:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e000be070 con 0x7f1e0813fa40 2024-09-15T22:50:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e000b9870 con 0x7f1e0813fa40 2024-09-15T22:50:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e0815b210 con 0x7f1e0813fa40 2024-09-15T22:50:44.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.397+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e0815b7d0 con 0x7f1e0813fa40 2024-09-15T22:50:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0806e610 con 0x7f1e0813fa40 2024-09-15T22:50:44.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1e000a5710 con 0x7f1e0813fa40 2024-09-15T22:50:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e05600640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 0x7f1de8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1e00120f10 con 0x7f1e0813fa40 2024-09-15T22:50:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e0d800640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 0x7f1de8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.401+0000 7f1e0d800640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 0x7f1de8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005890 tx=0x7f1dfc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.405+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1e0815af90 con 0x7f1e0813fa40 2024-09-15T22:50:44.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.569+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e081385c0 con 0x7f1de80678c0 2024-09-15T22:50:44.583 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.577+0000 7f1e05600640 1 -- 172.21.15.31:0/2928768963 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332531 (secure 0 0 0) 0x7f1e081385c0 con 0x7f1de80678c0 2024-09-15T22:50:44.587 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:44.589 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:50:44.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 msgr2=0x7f1de8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 0x7f1de8069d80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005890 tx=0x7f1dfc009040 comp rx=0 tx=0).stop 2024-09-15T22:50:44.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 msgr2=0x7f1e0813b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1e0001af90 tx=0x7f1e00019680 comp rx=0 tx=0).stop 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 shutdown_connections 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1de80678c0 0x7f1de8069d80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1e0813fa40 0x7f1e0813b190 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1e08072160 0x7f1e0813ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 --2- 172.21.15.31:0/2928768963 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1e0806e160 0x7f1e0815aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 >> 172.21.15.31:0/2928768963 conn(0x7f1e08067e00 msgr2=0x7f1e080b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 shutdown_connections 2024-09-15T22:50:44.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.581+0000 7f1e10200640 1 -- 172.21.15.31:0/2928768963 wait complete. 2024-09-15T22:50:44.608 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-09-15T22:50:43.560725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595010,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219512,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755208,"statfs":{"total":773094113280,"available":772869332992,"internally_reserved":0,"allocated":3350528,"data_stored":2018492,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003489"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486560+0000","last_change":"2024-09-15T22:50:16.071034+0000","last_active":"2024-09-15T22:50:22.486560+0000","last_peered":"2024-09-15T22:50:22.486560+0000","last_clean":"2024-09-15T22:50:22.486560+0000","last_became_active":"2024-09-15T22:50:16.070808+0000","last_became_peered":"2024-09-15T22:50:16.070808+0000","last_unstale":"2024-09-15T22:50:22.486560+0000","last_undegraded":"2024-09-15T22:50:22.486560+0000","last_fullsized":"2024-09-15T22:50:22.486560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:56:07.036126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485037+0000","last_change":"2024-09-15T22:50:17.064575+0000","last_active":"2024-09-15T22:50:22.485037+0000","last_peered":"2024-09-15T22:50:22.485037+0000","last_clean":"2024-09-15T22:50:22.485037+0000","last_became_active":"2024-09-15T22:50:17.064271+0000","last_became_peered":"2024-09-15T22:50:17.064271+0000","last_unstale":"2024-09-15T22:50:22.485037+0000","last_undegraded":"2024-09-15T22:50:22.485037+0000","last_fullsized":"2024-09-15T22:50:22.485037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484032+0000","last_change":"2024-09-15T22:50:21.391770+0000","last_active":"2024-09-15T22:50:22.484032+0000","last_peered":"2024-09-15T22:50:22.484032+0000","last_clean":"2024-09-15T22:50:22.484032+0000","last_became_active":"2024-09-15T22:50:21.387296+0000","last_became_peered":"2024-09-15T22:50:21.387296+0000","last_unstale":"2024-09-15T22:50:22.484032+0000","last_undegraded":"2024-09-15T22:50:22.484032+0000","last_fullsized":"2024-09-15T22:50:22.484032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:51:30.401656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485239+0000","last_change":"2024-09-15T22:50:16.059723+0000","last_active":"2024-09-15T22:50:22.485239+0000","last_peered":"2024-09-15T22:50:22.485239+0000","last_clean":"2024-09-15T22:50:22.485239+0000","last_became_active":"2024-09-15T22:50:16.059365+0000","last_became_peered":"2024-09-15T22:50:16.059365+0000","last_unstale":"2024-09-15T22:50:22.485239+0000","last_undegraded":"2024-09-15T22:50:22.485239+0000","last_fullsized":"2024-09-15T22:50:22.485239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486397+0000","last_change":"2024-09-15T22:50:17.049966+0000","last_active":"2024-09-15T22:50:22.486397+0000","last_peered":"2024-09-15T22:50:22.486397+0000","last_clean":"2024-09-15T22:50:22.486397+0000","last_became_active":"2024-09-15T22:50:17.049585+0000","last_became_peered":"2024-09-15T22:50:17.049585+0000","last_unstale":"2024-09-15T22:50:22.486397+0000","last_undegraded":"2024-09-15T22:50:22.486397+0000","last_fullsized":"2024-09-15T22:50:22.486397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304395+0000","last_change":"2024-09-15T22:50:21.332999+0000","last_active":"2024-09-15T22:50:22.304395+0000","last_peered":"2024-09-15T22:50:22.304395+0000","last_clean":"2024-09-15T22:50:22.304395+0000","last_became_active":"2024-09-15T22:50:21.332489+0000","last_became_peered":"2024-09-15T22:50:21.332489+0000","last_unstale":"2024-09-15T22:50:22.304395+0000","last_undegraded":"2024-09-15T22:50:22.304395+0000","last_fullsized":"2024-09-15T22:50:22.304395+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:14.476887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486836+0000","last_change":"2024-09-15T22:50:16.074061+0000","last_active":"2024-09-15T22:50:22.486836+0000","last_peered":"2024-09-15T22:50:22.486836+0000","last_clean":"2024-09-15T22:50:22.486836+0000","last_became_active":"2024-09-15T22:50:16.073371+0000","last_became_peered":"2024-09-15T22:50:16.073371+0000","last_unstale":"2024-09-15T22:50:22.486836+0000","last_undegraded":"2024-09-15T22:50:22.486836+0000","last_fullsized":"2024-09-15T22:50:22.486836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304993+0000","last_change":"2024-09-15T22:50:17.049531+0000","last_active":"2024-09-15T22:50:22.304993+0000","last_peered":"2024-09-15T22:50:22.304993+0000","last_clean":"2024-09-15T22:50:22.304993+0000","last_became_active":"2024-09-15T22:50:17.048655+0000","last_became_peered":"2024-09-15T22:50:17.048655+0000","last_unstale":"2024-09-15T22:50:22.304993+0000","last_undegraded":"2024-09-15T22:50:22.304993+0000","last_fullsized":"2024-09-15T22:50:22.304993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:05:35.848734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305466+0000","last_change":"2024-09-15T22:50:21.331612+0000","last_active":"2024-09-15T22:50:22.305466+0000","last_peered":"2024-09-15T22:50:22.305466+0000","last_clean":"2024-09-15T22:50:22.305466+0000","last_became_active":"2024-09-15T22:50:21.331183+0000","last_became_peered":"2024-09-15T22:50:21.331183+0000","last_unstale":"2024-09-15T22:50:22.305466+0000","last_undegraded":"2024-09-15T22:50:22.305466+0000","last_fullsized":"2024-09-15T22:50:22.305466+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487042+0000","last_change":"2024-09-15T22:50:16.074167+0000","last_active":"2024-09-15T22:50:22.487042+0000","last_peered":"2024-09-15T22:50:22.487042+0000","last_clean":"2024-09-15T22:50:22.487042+0000","last_became_active":"2024-09-15T22:50:16.073667+0000","last_became_peered":"2024-09-15T22:50:16.073667+0000","last_unstale":"2024-09-15T22:50:22.487042+0000","last_undegraded":"2024-09-15T22:50:22.487042+0000","last_fullsized":"2024-09-15T22:50:22.487042+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305928+0000","last_change":"2024-09-15T22:50:17.049937+0000","last_active":"2024-09-15T22:50:22.305928+0000","last_peered":"2024-09-15T22:50:22.305928+0000","last_clean":"2024-09-15T22:50:22.305928+0000","last_became_active":"2024-09-15T22:50:17.049500+0000","last_became_peered":"2024-09-15T22:50:17.049500+0000","last_unstale":"2024-09-15T22:50:22.305928+0000","last_undegraded":"2024-09-15T22:50:22.305928+0000","last_fullsized":"2024-09-15T22:50:22.305928+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:00:59.767628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305411+0000","last_change":"2024-09-15T22:50:21.322140+0000","last_active":"2024-09-15T22:50:22.305411+0000","last_peered":"2024-09-15T22:50:22.305411+0000","last_clean":"2024-09-15T22:50:22.305411+0000","last_became_active":"2024-09-15T22:50:21.321613+0000","last_became_peered":"2024-09-15T22:50:21.321613+0000","last_unstale":"2024-09-15T22:50:22.305411+0000","last_undegraded":"2024-09-15T22:50:22.305411+0000","last_fullsized":"2024-09-15T22:50:22.305411+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:25.347025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486025+0000","last_change":"2024-09-15T22:50:17.066161+0000","last_active":"2024-09-15T22:50:22.486025+0000","last_peered":"2024-09-15T22:50:22.486025+0000","last_clean":"2024-09-15T22:50:22.486025+0000","last_became_active":"2024-09-15T22:50:17.064352+0000","last_became_peered":"2024-09-15T22:50:17.064352+0000","last_unstale":"2024-09-15T22:50:22.486025+0000","last_undegraded":"2024-09-15T22:50:22.486025+0000","last_fullsized":"2024-09-15T22:50:22.486025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486824+0000","last_change":"2024-09-15T22:50:16.073863+0000","last_active":"2024-09-15T22:50:22.486824+0000","last_peered":"2024-09-15T22:50:22.486824+0000","last_clean":"2024-09-15T22:50:22.486824+0000","last_became_active":"2024-09-15T22:50:16.073568+0000","last_became_peered":"2024-09-15T22:50:16.073568+0000","last_unstale":"2024-09-15T22:50:22.486824+0000","last_undegraded":"2024-09-15T22:50:22.486824+0000","last_fullsized":"2024-09-15T22:50:22.486824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:09:50.833315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305147+0000","last_change":"2024-09-15T22:50:21.329220+0000","last_active":"2024-09-15T22:50:22.305147+0000","last_peered":"2024-09-15T22:50:22.305147+0000","last_clean":"2024-09-15T22:50:22.305147+0000","last_became_active":"2024-09-15T22:50:21.328859+0000","last_became_peered":"2024-09-15T22:50:21.328859+0000","last_unstale":"2024-09-15T22:50:22.305147+0000","last_undegraded":"2024-09-15T22:50:22.305147+0000","last_fullsized":"2024-09-15T22:50:22.305147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:53.380745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484221+0000","last_change":"2024-09-15T22:50:17.081686+0000","last_active":"2024-09-15T22:50:22.484221+0000","last_peered":"2024-09-15T22:50:22.484221+0000","last_clean":"2024-09-15T22:50:22.484221+0000","last_became_active":"2024-09-15T22:50:17.081267+0000","last_became_peered":"2024-09-15T22:50:17.081267+0000","last_unstale":"2024-09-15T22:50:22.484221+0000","last_undegraded":"2024-09-15T22:50:22.484221+0000","last_fullsized":"2024-09-15T22:50:22.484221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485397+0000","last_change":"2024-09-15T22:50:16.065960+0000","last_active":"2024-09-15T22:50:22.485397+0000","last_peered":"2024-09-15T22:50:22.485397+0000","last_clean":"2024-09-15T22:50:22.485397+0000","last_became_active":"2024-09-15T22:50:16.065603+0000","last_became_peered":"2024-09-15T22:50:16.065603+0000","last_unstale":"2024-09-15T22:50:22.485397+0000","last_undegraded":"2024-09-15T22:50:22.485397+0000","last_fullsized":"2024-09-15T22:50:22.485397+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:58.700848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305841+0000","last_change":"2024-09-15T22:50:21.331723+0000","last_active":"2024-09-15T22:50:22.305841+0000","last_peered":"2024-09-15T22:50:22.305841+0000","last_clean":"2024-09-15T22:50:22.305841+0000","last_became_active":"2024-09-15T22:50:21.331153+0000","last_became_peered":"2024-09-15T22:50:21.331153+0000","last_unstale":"2024-09-15T22:50:22.305841+0000","last_undegraded":"2024-09-15T22:50:22.305841+0000","last_fullsized":"2024-09-15T22:50:22.305841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484852+0000","last_change":"2024-09-15T22:50:17.063766+0000","last_active":"2024-09-15T22:50:22.484852+0000","last_peered":"2024-09-15T22:50:22.484852+0000","last_clean":"2024-09-15T22:50:22.484852+0000","last_became_active":"2024-09-15T22:50:17.063505+0000","last_became_peered":"2024-09-15T22:50:17.063505+0000","last_unstale":"2024-09-15T22:50:22.484852+0000","last_undegraded":"2024-09-15T22:50:22.484852+0000","last_fullsized":"2024-09-15T22:50:22.484852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486133+0000","last_change":"2024-09-15T22:50:16.058862+0000","last_active":"2024-09-15T22:50:22.486133+0000","last_peered":"2024-09-15T22:50:22.486133+0000","last_clean":"2024-09-15T22:50:22.486133+0000","last_became_active":"2024-09-15T22:50:16.058559+0000","last_became_peered":"2024-09-15T22:50:16.058559+0000","last_unstale":"2024-09-15T22:50:22.486133+0000","last_undegraded":"2024-09-15T22:50:22.486133+0000","last_fullsized":"2024-09-15T22:50:22.486133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488018+0000","last_change":"2024-09-15T22:50:21.388463+0000","last_active":"2024-09-15T22:50:22.488018+0000","last_peered":"2024-09-15T22:50:22.488018+0000","last_clean":"2024-09-15T22:50:22.488018+0000","last_became_active":"2024-09-15T22:50:21.387965+0000","last_became_peered":"2024-09-15T22:50:21.387965+0000","last_unstale":"2024-09-15T22:50:22.488018+0000","last_undegraded":"2024-09-15T22:50:22.488018+0000","last_fullsized":"2024-09-15T22:50:22.488018+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304813+0000","last_change":"2024-09-15T22:50:17.056742+0000","last_active":"2024-09-15T22:50:22.304813+0000","last_peered":"2024-09-15T22:50:22.304813+0000","last_clean":"2024-09-15T22:50:22.304813+0000","last_became_active":"2024-09-15T22:50:17.056447+0000","last_became_peered":"2024-09-15T22:50:17.056447+0000","last_unstale":"2024-09-15T22:50:22.304813+0000","last_undegraded":"2024-09-15T22:50:22.304813+0000","last_fullsized":"2024-09-15T22:50:22.304813+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486107+0000","last_change":"2024-09-15T22:50:16.072521+0000","last_active":"2024-09-15T22:50:22.486107+0000","last_peered":"2024-09-15T22:50:22.486107+0000","last_clean":"2024-09-15T22:50:22.486107+0000","last_became_active":"2024-09-15T22:50:16.071920+0000","last_became_peered":"2024-09-15T22:50:16.071920+0000","last_unstale":"2024-09-15T22:50:22.486107+0000","last_undegraded":"2024-09-15T22:50:22.486107+0000","last_fullsized":"2024-09-15T22:50:22.486107+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305040+0000","last_change":"2024-09-15T22:50:21.333094+0000","last_active":"2024-09-15T22:50:22.305040+0000","last_peered":"2024-09-15T22:50:22.305040+0000","last_clean":"2024-09-15T22:50:22.305040+0000","last_became_active":"2024-09-15T22:50:21.332195+0000","last_became_peered":"2024-09-15T22:50:21.332195+0000","last_unstale":"2024-09-15T22:50:22.305040+0000","last_undegraded":"2024-09-15T22:50:22.305040+0000","last_fullsized":"2024-09-15T22:50:22.305040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:51.604505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486855+0000","last_change":"2024-09-15T22:50:17.068190+0000","last_active":"2024-09-15T22:50:22.486855+0000","last_peered":"2024-09-15T22:50:22.486855+0000","last_clean":"2024-09-15T22:50:22.486855+0000","last_became_active":"2024-09-15T22:50:17.067975+0000","last_became_peered":"2024-09-15T22:50:17.067975+0000","last_unstale":"2024-09-15T22:50:22.486855+0000","last_undegraded":"2024-09-15T22:50:22.486855+0000","last_fullsized":"2024-09-15T22:50:22.486855+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487083+0000","last_change":"2024-09-15T22:50:16.076299+0000","last_active":"2024-09-15T22:50:22.487083+0000","last_peered":"2024-09-15T22:50:22.487083+0000","last_clean":"2024-09-15T22:50:22.487083+0000","last_became_active":"2024-09-15T22:50:16.075995+0000","last_became_peered":"2024-09-15T22:50:16.075995+0000","last_unstale":"2024-09-15T22:50:22.487083+0000","last_undegraded":"2024-09-15T22:50:22.487083+0000","last_fullsized":"2024-09-15T22:50:22.487083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304527+0000","last_change":"2024-09-15T22:50:21.387662+0000","last_active":"2024-09-15T22:50:22.304527+0000","last_peered":"2024-09-15T22:50:22.304527+0000","last_clean":"2024-09-15T22:50:22.304527+0000","last_became_active":"2024-09-15T22:50:21.387238+0000","last_became_peered":"2024-09-15T22:50:21.387238+0000","last_unstale":"2024-09-15T22:50:22.304527+0000","last_undegraded":"2024-09-15T22:50:22.304527+0000","last_fullsized":"2024-09-15T22:50:22.304527+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:29.299907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484756+0000","last_change":"2024-09-15T22:50:17.065264+0000","last_active":"2024-09-15T22:50:22.484756+0000","last_peered":"2024-09-15T22:50:22.484756+0000","last_clean":"2024-09-15T22:50:22.484756+0000","last_became_active":"2024-09-15T22:50:17.064957+0000","last_became_peered":"2024-09-15T22:50:17.064957+0000","last_unstale":"2024-09-15T22:50:22.484756+0000","last_undegraded":"2024-09-15T22:50:22.484756+0000","last_fullsized":"2024-09-15T22:50:22.484756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488183+0000","last_change":"2024-09-15T22:50:16.065838+0000","last_active":"2024-09-15T22:50:22.488183+0000","last_peered":"2024-09-15T22:50:22.488183+0000","last_clean":"2024-09-15T22:50:22.488183+0000","last_became_active":"2024-09-15T22:50:16.065431+0000","last_became_peered":"2024-09-15T22:50:16.065431+0000","last_unstale":"2024-09-15T22:50:22.488183+0000","last_undegraded":"2024-09-15T22:50:22.488183+0000","last_fullsized":"2024-09-15T22:50:22.488183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484368+0000","last_change":"2024-09-15T22:50:21.386971+0000","last_active":"2024-09-15T22:50:22.484368+0000","last_peered":"2024-09-15T22:50:22.484368+0000","last_clean":"2024-09-15T22:50:22.484368+0000","last_became_active":"2024-09-15T22:50:21.386649+0000","last_became_peered":"2024-09-15T22:50:21.386649+0000","last_unstale":"2024-09-15T22:50:22.484368+0000","last_undegraded":"2024-09-15T22:50:22.484368+0000","last_fullsized":"2024-09-15T22:50:22.484368+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:03:26.952001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487665+0000","last_change":"2024-09-15T22:50:17.061858+0000","last_active":"2024-09-15T22:50:22.487665+0000","last_peered":"2024-09-15T22:50:22.487665+0000","last_clean":"2024-09-15T22:50:22.487665+0000","last_became_active":"2024-09-15T22:50:17.061576+0000","last_became_peered":"2024-09-15T22:50:17.061576+0000","last_unstale":"2024-09-15T22:50:22.487665+0000","last_undegraded":"2024-09-15T22:50:22.487665+0000","last_fullsized":"2024-09-15T22:50:22.487665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487045+0000","last_change":"2024-09-15T22:50:16.074301+0000","last_active":"2024-09-15T22:50:22.487045+0000","last_peered":"2024-09-15T22:50:22.487045+0000","last_clean":"2024-09-15T22:50:22.487045+0000","last_became_active":"2024-09-15T22:50:16.073757+0000","last_became_peered":"2024-09-15T22:50:16.073757+0000","last_unstale":"2024-09-15T22:50:22.487045+0000","last_undegraded":"2024-09-15T22:50:22.487045+0000","last_fullsized":"2024-09-15T22:50:22.487045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:13.372342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485694+0000","last_change":"2024-09-15T22:50:21.387039+0000","last_active":"2024-09-15T22:50:22.485694+0000","last_peered":"2024-09-15T22:50:22.485694+0000","last_clean":"2024-09-15T22:50:22.485694+0000","last_became_active":"2024-09-15T22:50:21.386588+0000","last_became_peered":"2024-09-15T22:50:21.386588+0000","last_unstale":"2024-09-15T22:50:22.485694+0000","last_undegraded":"2024-09-15T22:50:22.485694+0000","last_fullsized":"2024-09-15T22:50:22.485694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306041+0000","last_change":"2024-09-15T22:50:17.073775+0000","last_active":"2024-09-15T22:50:22.306041+0000","last_peered":"2024-09-15T22:50:22.306041+0000","last_clean":"2024-09-15T22:50:22.306041+0000","last_became_active":"2024-09-15T22:50:17.073501+0000","last_became_peered":"2024-09-15T22:50:17.073501+0000","last_unstale":"2024-09-15T22:50:22.306041+0000","last_undegraded":"2024-09-15T22:50:22.306041+0000","last_fullsized":"2024-09-15T22:50:22.306041+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:45.114390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487762+0000","last_change":"2024-09-15T22:50:16.062735+0000","last_active":"2024-09-15T22:50:22.487762+0000","last_peered":"2024-09-15T22:50:22.487762+0000","last_clean":"2024-09-15T22:50:22.487762+0000","last_became_active":"2024-09-15T22:50:16.062407+0000","last_became_peered":"2024-09-15T22:50:16.062407+0000","last_unstale":"2024-09-15T22:50:22.487762+0000","last_undegraded":"2024-09-15T22:50:22.487762+0000","last_fullsized":"2024-09-15T22:50:22.487762+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485248+0000","last_change":"2024-09-15T22:50:21.334715+0000","last_active":"2024-09-15T22:50:22.485248+0000","last_peered":"2024-09-15T22:50:22.485248+0000","last_clean":"2024-09-15T22:50:22.485248+0000","last_became_active":"2024-09-15T22:50:21.334378+0000","last_became_peered":"2024-09-15T22:50:21.334378+0000","last_unstale":"2024-09-15T22:50:22.485248+0000","last_undegraded":"2024-09-15T22:50:22.485248+0000","last_fullsized":"2024-09-15T22:50:22.485248+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305984+0000","last_change":"2024-09-15T22:50:17.059567+0000","last_active":"2024-09-15T22:50:22.305984+0000","last_peered":"2024-09-15T22:50:22.305984+0000","last_clean":"2024-09-15T22:50:22.305984+0000","last_became_active":"2024-09-15T22:50:17.059236+0000","last_became_peered":"2024-09-15T22:50:17.059236+0000","last_unstale":"2024-09-15T22:50:22.305984+0000","last_undegraded":"2024-09-15T22:50:22.305984+0000","last_fullsized":"2024-09-15T22:50:22.305984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305510+0000","last_change":"2024-09-15T22:50:16.064966+0000","last_active":"2024-09-15T22:50:22.305510+0000","last_peered":"2024-09-15T22:50:22.305510+0000","last_clean":"2024-09-15T22:50:22.305510+0000","last_became_active":"2024-09-15T22:50:16.063647+0000","last_became_peered":"2024-09-15T22:50:16.063647+0000","last_unstale":"2024-09-15T22:50:22.305510+0000","last_undegraded":"2024-09-15T22:50:22.305510+0000","last_fullsized":"2024-09-15T22:50:22.305510+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:05.094689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487711+0000","last_change":"2024-09-15T22:50:21.324683+0000","last_active":"2024-09-15T22:50:22.487711+0000","last_peered":"2024-09-15T22:50:22.487711+0000","last_clean":"2024-09-15T22:50:22.487711+0000","last_became_active":"2024-09-15T22:50:21.324107+0000","last_became_peered":"2024-09-15T22:50:21.324107+0000","last_unstale":"2024-09-15T22:50:22.487711+0000","last_undegraded":"2024-09-15T22:50:22.487711+0000","last_fullsized":"2024-09-15T22:50:22.487711+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484084+0000","last_change":"2024-09-15T22:50:17.076106+0000","last_active":"2024-09-15T22:50:22.484084+0000","last_peered":"2024-09-15T22:50:22.484084+0000","last_clean":"2024-09-15T22:50:22.484084+0000","last_became_active":"2024-09-15T22:50:17.075941+0000","last_became_peered":"2024-09-15T22:50:17.075941+0000","last_unstale":"2024-09-15T22:50:22.484084+0000","last_undegraded":"2024-09-15T22:50:22.484084+0000","last_fullsized":"2024-09-15T22:50:22.484084+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301938+0000","last_change":"2024-09-15T22:50:16.058921+0000","last_active":"2024-09-15T22:50:22.301938+0000","last_peered":"2024-09-15T22:50:22.301938+0000","last_clean":"2024-09-15T22:50:22.301938+0000","last_became_active":"2024-09-15T22:50:16.056403+0000","last_became_peered":"2024-09-15T22:50:16.056403+0000","last_unstale":"2024-09-15T22:50:22.301938+0000","last_undegraded":"2024-09-15T22:50:22.301938+0000","last_fullsized":"2024-09-15T22:50:22.301938+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488128+0000","last_change":"2024-09-15T22:50:21.328492+0000","last_active":"2024-09-15T22:50:22.488128+0000","last_peered":"2024-09-15T22:50:22.488128+0000","last_clean":"2024-09-15T22:50:22.488128+0000","last_became_active":"2024-09-15T22:50:21.327821+0000","last_became_peered":"2024-09-15T22:50:21.327821+0000","last_unstale":"2024-09-15T22:50:22.488128+0000","last_undegraded":"2024-09-15T22:50:22.488128+0000","last_fullsized":"2024-09-15T22:50:22.488128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485106+0000","last_change":"2024-09-15T22:50:17.048995+0000","last_active":"2024-09-15T22:50:22.485106+0000","last_peered":"2024-09-15T22:50:22.485106+0000","last_clean":"2024-09-15T22:50:22.485106+0000","last_became_active":"2024-09-15T22:50:17.048715+0000","last_became_peered":"2024-09-15T22:50:17.048715+0000","last_unstale":"2024-09-15T22:50:22.485106+0000","last_undegraded":"2024-09-15T22:50:22.485106+0000","last_fullsized":"2024-09-15T22:50:22.485106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:46:53.664696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486222+0000","last_change":"2024-09-15T22:50:16.072709+0000","last_active":"2024-09-15T22:50:22.486222+0000","last_peered":"2024-09-15T22:50:22.486222+0000","last_clean":"2024-09-15T22:50:22.486222+0000","last_became_active":"2024-09-15T22:50:16.072241+0000","last_became_peered":"2024-09-15T22:50:16.072241+0000","last_unstale":"2024-09-15T22:50:22.486222+0000","last_undegraded":"2024-09-15T22:50:22.486222+0000","last_fullsized":"2024-09-15T22:50:22.486222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486771+0000","last_change":"2024-09-15T22:50:21.386663+0000","last_active":"2024-09-15T22:50:22.486771+0000","last_peered":"2024-09-15T22:50:22.486771+0000","last_clean":"2024-09-15T22:50:22.486771+0000","last_became_active":"2024-09-15T22:50:21.386297+0000","last_became_peered":"2024-09-15T22:50:21.386297+0000","last_unstale":"2024-09-15T22:50:22.486771+0000","last_undegraded":"2024-09-15T22:50:22.486771+0000","last_fullsized":"2024-09-15T22:50:22.486771+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:48:39.926003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485330+0000","last_change":"2024-09-15T22:50:17.059375+0000","last_active":"2024-09-15T22:50:22.485330+0000","last_peered":"2024-09-15T22:50:22.485330+0000","last_clean":"2024-09-15T22:50:22.485330+0000","last_became_active":"2024-09-15T22:50:17.059132+0000","last_became_peered":"2024-09-15T22:50:17.059132+0000","last_unstale":"2024-09-15T22:50:22.485330+0000","last_undegraded":"2024-09-15T22:50:22.485330+0000","last_fullsized":"2024-09-15T22:50:22.485330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:16.056464+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:16.055773+0000","last_became_peered":"2024-09-15T22:50:16.055773+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:15:58.306570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486332+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:50:22.486332+0000","last_peered":"2024-09-15T22:50:22.486332+0000","last_clean":"2024-09-15T22:50:22.486332+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:50:22.486332+0000","last_undegraded":"2024-09-15T22:50:22.486332+0000","last_fullsized":"2024-09-15T22:50:22.486332+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486472+0000","last_change":"2024-09-15T22:50:21.392217+0000","last_active":"2024-09-15T22:50:22.486472+0000","last_peered":"2024-09-15T22:50:22.486472+0000","last_clean":"2024-09-15T22:50:22.486472+0000","last_became_active":"2024-09-15T22:50:21.387886+0000","last_became_peered":"2024-09-15T22:50:21.387886+0000","last_unstale":"2024-09-15T22:50:22.486472+0000","last_undegraded":"2024-09-15T22:50:22.486472+0000","last_fullsized":"2024-09-15T22:50:22.486472+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486289+0000","last_change":"2024-09-15T22:50:17.072970+0000","last_active":"2024-09-15T22:50:22.486289+0000","last_peered":"2024-09-15T22:50:22.486289+0000","last_clean":"2024-09-15T22:50:22.486289+0000","last_became_active":"2024-09-15T22:50:17.072660+0000","last_became_peered":"2024-09-15T22:50:17.072660+0000","last_unstale":"2024-09-15T22:50:22.486289+0000","last_undegraded":"2024-09-15T22:50:22.486289+0000","last_fullsized":"2024-09-15T22:50:22.486289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302167+0000","last_change":"2024-09-15T22:50:16.069049+0000","last_active":"2024-09-15T22:50:22.302167+0000","last_peered":"2024-09-15T22:50:22.302167+0000","last_clean":"2024-09-15T22:50:22.302167+0000","last_became_active":"2024-09-15T22:50:16.068684+0000","last_became_peered":"2024-09-15T22:50:16.068684+0000","last_unstale":"2024-09-15T22:50:22.302167+0000","last_undegraded":"2024-09-15T22:50:22.302167+0000","last_fullsized":"2024-09-15T22:50:22.302167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486339+0000","last_change":"2024-09-15T22:50:21.385944+0000","last_active":"2024-09-15T22:50:22.486339+0000","last_peered":"2024-09-15T22:50:22.486339+0000","last_clean":"2024-09-15T22:50:22.486339+0000","last_became_active":"2024-09-15T22:50:21.385537+0000","last_became_peered":"2024-09-15T22:50:21.385537+0000","last_unstale":"2024-09-15T22:50:22.486339+0000","last_undegraded":"2024-09-15T22:50:22.486339+0000","last_fullsized":"2024-09-15T22:50:22.486339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:07.128752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305085+0000","last_change":"2024-09-15T22:50:17.067273+0000","last_active":"2024-09-15T22:50:22.305085+0000","last_peered":"2024-09-15T22:50:22.305085+0000","last_clean":"2024-09-15T22:50:22.305085+0000","last_became_active":"2024-09-15T22:50:17.066944+0000","last_became_peered":"2024-09-15T22:50:17.066944+0000","last_unstale":"2024-09-15T22:50:22.305085+0000","last_undegraded":"2024-09-15T22:50:22.305085+0000","last_fullsized":"2024-09-15T22:50:22.305085+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:55:59.293012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487904+0000","last_change":"2024-09-15T22:50:16.059543+0000","last_active":"2024-09-15T22:50:22.487904+0000","last_peered":"2024-09-15T22:50:22.487904+0000","last_clean":"2024-09-15T22:50:22.487904+0000","last_became_active":"2024-09-15T22:50:16.056601+0000","last_became_peered":"2024-09-15T22:50:16.056601+0000","last_unstale":"2024-09-15T22:50:22.487904+0000","last_undegraded":"2024-09-15T22:50:22.487904+0000","last_fullsized":"2024-09-15T22:50:22.487904+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:51.227180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485917+0000","last_change":"2024-09-15T22:50:21.330038+0000","last_active":"2024-09-15T22:50:22.485917+0000","last_peered":"2024-09-15T22:50:22.485917+0000","last_clean":"2024-09-15T22:50:22.485917+0000","last_became_active":"2024-09-15T22:50:21.329579+0000","last_became_peered":"2024-09-15T22:50:21.329579+0000","last_unstale":"2024-09-15T22:50:22.485917+0000","last_undegraded":"2024-09-15T22:50:22.485917+0000","last_fullsized":"2024-09-15T22:50:22.485917+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:45.291003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487400+0000","last_change":"2024-09-15T22:50:17.066201+0000","last_active":"2024-09-15T22:50:22.487400+0000","last_peered":"2024-09-15T22:50:22.487400+0000","last_clean":"2024-09-15T22:50:22.487400+0000","last_became_active":"2024-09-15T22:50:17.065922+0000","last_became_peered":"2024-09-15T22:50:17.065922+0000","last_unstale":"2024-09-15T22:50:22.487400+0000","last_undegraded":"2024-09-15T22:50:22.487400+0000","last_fullsized":"2024-09-15T22:50:22.487400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:13.059027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302362+0000","last_change":"2024-09-15T22:50:16.059590+0000","last_active":"2024-09-15T22:50:22.302362+0000","last_peered":"2024-09-15T22:50:22.302362+0000","last_clean":"2024-09-15T22:50:22.302362+0000","last_became_active":"2024-09-15T22:50:16.059168+0000","last_became_peered":"2024-09-15T22:50:16.059168+0000","last_unstale":"2024-09-15T22:50:22.302362+0000","last_undegraded":"2024-09-15T22:50:22.302362+0000","last_fullsized":"2024-09-15T22:50:22.302362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304215+0000","last_change":"2024-09-15T22:50:21.387467+0000","last_active":"2024-09-15T22:50:22.304215+0000","last_peered":"2024-09-15T22:50:22.304215+0000","last_clean":"2024-09-15T22:50:22.304215+0000","last_became_active":"2024-09-15T22:50:21.387053+0000","last_became_peered":"2024-09-15T22:50:21.387053+0000","last_unstale":"2024-09-15T22:50:22.304215+0000","last_undegraded":"2024-09-15T22:50:22.304215+0000","last_fullsized":"2024-09-15T22:50:22.304215+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:29:55.525858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487044+0000","last_change":"2024-09-15T22:50:17.073751+0000","last_active":"2024-09-15T22:50:22.487044+0000","last_peered":"2024-09-15T22:50:22.487044+0000","last_clean":"2024-09-15T22:50:22.487044+0000","last_became_active":"2024-09-15T22:50:17.065140+0000","last_became_peered":"2024-09-15T22:50:17.065140+0000","last_unstale":"2024-09-15T22:50:22.487044+0000","last_undegraded":"2024-09-15T22:50:22.487044+0000","last_fullsized":"2024-09-15T22:50:22.487044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:19.682526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305439+0000","last_change":"2024-09-15T22:50:16.065101+0000","last_active":"2024-09-15T22:50:22.305439+0000","last_peered":"2024-09-15T22:50:22.305439+0000","last_clean":"2024-09-15T22:50:22.305439+0000","last_became_active":"2024-09-15T22:50:16.064796+0000","last_became_peered":"2024-09-15T22:50:16.064796+0000","last_unstale":"2024-09-15T22:50:22.305439+0000","last_undegraded":"2024-09-15T22:50:22.305439+0000","last_fullsized":"2024-09-15T22:50:22.305439+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:08:16.223077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304254+0000","last_change":"2024-09-15T22:50:21.331825+0000","last_active":"2024-09-15T22:50:22.304254+0000","last_peered":"2024-09-15T22:50:22.304254+0000","last_clean":"2024-09-15T22:50:22.304254+0000","last_became_active":"2024-09-15T22:50:21.331115+0000","last_became_peered":"2024-09-15T22:50:21.331115+0000","last_unstale":"2024-09-15T22:50:22.304254+0000","last_undegraded":"2024-09-15T22:50:22.304254+0000","last_fullsized":"2024-09-15T22:50:22.304254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:22.486441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486479+0000","last_change":"2024-09-15T22:50:17.069472+0000","last_active":"2024-09-15T22:50:22.486479+0000","last_peered":"2024-09-15T22:50:22.486479+0000","last_clean":"2024-09-15T22:50:22.486479+0000","last_became_active":"2024-09-15T22:50:17.066357+0000","last_became_peered":"2024-09-15T22:50:17.066357+0000","last_unstale":"2024-09-15T22:50:22.486479+0000","last_undegraded":"2024-09-15T22:50:22.486479+0000","last_fullsized":"2024-09-15T22:50:22.486479+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:04:21.089216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":29,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301701+0000","last_change":"2024-09-15T22:50:16.054885+0000","last_active":"2024-09-15T22:50:22.301701+0000","last_peered":"2024-09-15T22:50:22.301701+0000","last_clean":"2024-09-15T22:50:22.301701+0000","last_became_active":"2024-09-15T22:50:16.054595+0000","last_became_peered":"2024-09-15T22:50:16.054595+0000","last_unstale":"2024-09-15T22:50:22.301701+0000","last_undegraded":"2024-09-15T22:50:22.301701+0000","last_fullsized":"2024-09-15T22:50:22.301701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486700+0000","last_change":"2024-09-15T22:50:21.326386+0000","last_active":"2024-09-15T22:50:22.486700+0000","last_peered":"2024-09-15T22:50:22.486700+0000","last_clean":"2024-09-15T22:50:22.486700+0000","last_became_active":"2024-09-15T22:50:21.323287+0000","last_became_peered":"2024-09-15T22:50:21.323287+0000","last_unstale":"2024-09-15T22:50:22.486700+0000","last_undegraded":"2024-09-15T22:50:22.486700+0000","last_fullsized":"2024-09-15T22:50:22.486700+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:33:17.316836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485918+0000","last_change":"2024-09-15T22:50:17.075345+0000","last_active":"2024-09-15T22:50:22.485918+0000","last_peered":"2024-09-15T22:50:22.485918+0000","last_clean":"2024-09-15T22:50:22.485918+0000","last_became_active":"2024-09-15T22:50:17.071860+0000","last_became_peered":"2024-09-15T22:50:17.071860+0000","last_unstale":"2024-09-15T22:50:22.485918+0000","last_undegraded":"2024-09-15T22:50:22.485918+0000","last_fullsized":"2024-09-15T22:50:22.485918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486616+0000","last_change":"2024-09-15T22:50:16.066823+0000","last_active":"2024-09-15T22:50:22.486616+0000","last_peered":"2024-09-15T22:50:22.486616+0000","last_clean":"2024-09-15T22:50:22.486616+0000","last_became_active":"2024-09-15T22:50:16.066066+0000","last_became_peered":"2024-09-15T22:50:16.066066+0000","last_unstale":"2024-09-15T22:50:22.486616+0000","last_undegraded":"2024-09-15T22:50:22.486616+0000","last_fullsized":"2024-09-15T22:50:22.486616+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484534+0000","last_change":"2024-09-15T22:50:21.387848+0000","last_active":"2024-09-15T22:50:22.484534+0000","last_peered":"2024-09-15T22:50:22.484534+0000","last_clean":"2024-09-15T22:50:22.484534+0000","last_became_active":"2024-09-15T22:50:21.387224+0000","last_became_peered":"2024-09-15T22:50:21.387224+0000","last_unstale":"2024-09-15T22:50:22.484534+0000","last_undegraded":"2024-09-15T22:50:22.484534+0000","last_fullsized":"2024-09-15T22:50:22.484534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:49.174091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486681+0000","last_change":"2024-09-15T22:50:17.071304+0000","last_active":"2024-09-15T22:50:22.486681+0000","last_peered":"2024-09-15T22:50:22.486681+0000","last_clean":"2024-09-15T22:50:22.486681+0000","last_became_active":"2024-09-15T22:50:17.070613+0000","last_became_peered":"2024-09-15T22:50:17.070613+0000","last_unstale":"2024-09-15T22:50:22.486681+0000","last_undegraded":"2024-09-15T22:50:22.486681+0000","last_fullsized":"2024-09-15T22:50:22.486681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:40:02.870943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305454+0000","last_change":"2024-09-15T22:50:16.069513+0000","last_active":"2024-09-15T22:50:22.305454+0000","last_peered":"2024-09-15T22:50:22.305454+0000","last_clean":"2024-09-15T22:50:22.305454+0000","last_became_active":"2024-09-15T22:50:16.069194+0000","last_became_peered":"2024-09-15T22:50:16.069194+0000","last_unstale":"2024-09-15T22:50:22.305454+0000","last_undegraded":"2024-09-15T22:50:22.305454+0000","last_fullsized":"2024-09-15T22:50:22.305454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:16:32.487332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484440+0000","last_change":"2024-09-15T22:50:21.385231+0000","last_active":"2024-09-15T22:50:22.484440+0000","last_peered":"2024-09-15T22:50:22.484440+0000","last_clean":"2024-09-15T22:50:22.484440+0000","last_became_active":"2024-09-15T22:50:21.384687+0000","last_became_peered":"2024-09-15T22:50:21.384687+0000","last_unstale":"2024-09-15T22:50:22.484440+0000","last_undegraded":"2024-09-15T22:50:22.484440+0000","last_fullsized":"2024-09-15T22:50:22.484440+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:58.714208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485419+0000","last_change":"2024-09-15T22:50:17.062760+0000","last_active":"2024-09-15T22:50:22.485419+0000","last_peered":"2024-09-15T22:50:22.485419+0000","last_clean":"2024-09-15T22:50:22.485419+0000","last_became_active":"2024-09-15T22:50:17.062472+0000","last_became_peered":"2024-09-15T22:50:17.062472+0000","last_unstale":"2024-09-15T22:50:22.485419+0000","last_undegraded":"2024-09-15T22:50:22.485419+0000","last_fullsized":"2024-09-15T22:50:22.485419+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:08:55.399729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486167+0000","last_change":"2024-09-15T22:50:16.060509+0000","last_active":"2024-09-15T22:50:22.486167+0000","last_peered":"2024-09-15T22:50:22.486167+0000","last_clean":"2024-09-15T22:50:22.486167+0000","last_became_active":"2024-09-15T22:50:16.060218+0000","last_became_peered":"2024-09-15T22:50:16.060218+0000","last_unstale":"2024-09-15T22:50:22.486167+0000","last_undegraded":"2024-09-15T22:50:22.486167+0000","last_fullsized":"2024-09-15T22:50:22.486167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:50:08.397738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305780+0000","last_change":"2024-09-15T22:50:21.389097+0000","last_active":"2024-09-15T22:50:22.305780+0000","last_peered":"2024-09-15T22:50:22.305780+0000","last_clean":"2024-09-15T22:50:22.305780+0000","last_became_active":"2024-09-15T22:50:21.388634+0000","last_became_peered":"2024-09-15T22:50:21.388634+0000","last_unstale":"2024-09-15T22:50:22.305780+0000","last_undegraded":"2024-09-15T22:50:22.305780+0000","last_fullsized":"2024-09-15T22:50:22.305780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:38:17.326409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486187+0000","last_change":"2024-09-15T22:50:17.077973+0000","last_active":"2024-09-15T22:50:22.486187+0000","last_peered":"2024-09-15T22:50:22.486187+0000","last_clean":"2024-09-15T22:50:22.486187+0000","last_became_active":"2024-09-15T22:50:17.077686+0000","last_became_peered":"2024-09-15T22:50:17.077686+0000","last_unstale":"2024-09-15T22:50:22.486187+0000","last_undegraded":"2024-09-15T22:50:22.486187+0000","last_fullsized":"2024-09-15T22:50:22.486187+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:22:47.346696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:28.191364+0000","last_change":"2024-09-15T22:50:16.062195+0000","last_active":"2024-09-15T22:50:28.191364+0000","last_peered":"2024-09-15T22:50:28.191364+0000","last_clean":"2024-09-15T22:50:28.191364+0000","last_became_active":"2024-09-15T22:50:16.061907+0000","last_became_peered":"2024-09-15T22:50:16.061907+0000","last_unstale":"2024-09-15T22:50:28.191364+0000","last_undegraded":"2024-09-15T22:50:28.191364+0000","last_fullsized":"2024-09-15T22:50:28.191364+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:02.047194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3844,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485394+0000","last_change":"2024-09-15T22:50:21.332064+0000","last_active":"2024-09-15T22:50:22.485394+0000","last_peered":"2024-09-15T22:50:22.485394+0000","last_clean":"2024-09-15T22:50:22.485394+0000","last_became_active":"2024-09-15T22:50:21.331679+0000","last_became_peered":"2024-09-15T22:50:21.331679+0000","last_unstale":"2024-09-15T22:50:22.485394+0000","last_undegraded":"2024-09-15T22:50:22.485394+0000","last_fullsized":"2024-09-15T22:50:22.485394+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:33:23.940335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306155+0000","last_change":"2024-09-15T22:50:17.066523+0000","last_active":"2024-09-15T22:50:22.306155+0000","last_peered":"2024-09-15T22:50:22.306155+0000","last_clean":"2024-09-15T22:50:22.306155+0000","last_became_active":"2024-09-15T22:50:17.066271+0000","last_became_peered":"2024-09-15T22:50:17.066271+0000","last_unstale":"2024-09-15T22:50:22.306155+0000","last_undegraded":"2024-09-15T22:50:22.306155+0000","last_fullsized":"2024-09-15T22:50:22.306155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:52.234038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487798+0000","last_change":"2024-09-15T22:50:16.072533+0000","last_active":"2024-09-15T22:50:22.487798+0000","last_peered":"2024-09-15T22:50:22.487798+0000","last_clean":"2024-09-15T22:50:22.487798+0000","last_became_active":"2024-09-15T22:50:16.072230+0000","last_became_peered":"2024-09-15T22:50:16.072230+0000","last_unstale":"2024-09-15T22:50:22.487798+0000","last_undegraded":"2024-09-15T22:50:22.487798+0000","last_fullsized":"2024-09-15T22:50:22.487798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305802+0000","last_change":"2024-09-15T22:50:21.333434+0000","last_active":"2024-09-15T22:50:22.305802+0000","last_peered":"2024-09-15T22:50:22.305802+0000","last_clean":"2024-09-15T22:50:22.305802+0000","last_became_active":"2024-09-15T22:50:21.332505+0000","last_became_peered":"2024-09-15T22:50:21.332505+0000","last_unstale":"2024-09-15T22:50:22.305802+0000","last_undegraded":"2024-09-15T22:50:22.305802+0000","last_fullsized":"2024-09-15T22:50:22.305802+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:44.089122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486491+0000","last_change":"2024-09-15T22:50:17.052446+0000","last_active":"2024-09-15T22:50:22.486491+0000","last_peered":"2024-09-15T22:50:22.486491+0000","last_clean":"2024-09-15T22:50:22.486491+0000","last_became_active":"2024-09-15T22:50:17.052187+0000","last_became_peered":"2024-09-15T22:50:17.052187+0000","last_unstale":"2024-09-15T22:50:22.486491+0000","last_undegraded":"2024-09-15T22:50:22.486491+0000","last_fullsized":"2024-09-15T22:50:22.486491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306067+0000","last_change":"2024-09-15T22:50:16.067884+0000","last_active":"2024-09-15T22:50:22.306067+0000","last_peered":"2024-09-15T22:50:22.306067+0000","last_clean":"2024-09-15T22:50:22.306067+0000","last_became_active":"2024-09-15T22:50:16.067613+0000","last_became_peered":"2024-09-15T22:50:16.067613+0000","last_unstale":"2024-09-15T22:50:22.306067+0000","last_undegraded":"2024-09-15T22:50:22.306067+0000","last_fullsized":"2024-09-15T22:50:22.306067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:48:02.473555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484670+0000","last_change":"2024-09-15T22:50:21.329190+0000","last_active":"2024-09-15T22:50:22.484670+0000","last_peered":"2024-09-15T22:50:22.484670+0000","last_clean":"2024-09-15T22:50:22.484670+0000","last_became_active":"2024-09-15T22:50:21.328672+0000","last_became_peered":"2024-09-15T22:50:21.328672+0000","last_unstale":"2024-09-15T22:50:22.484670+0000","last_undegraded":"2024-09-15T22:50:22.484670+0000","last_fullsized":"2024-09-15T22:50:22.484670+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:53:10.631612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306101+0000","last_change":"2024-09-15T22:50:17.065691+0000","last_active":"2024-09-15T22:50:22.306101+0000","last_peered":"2024-09-15T22:50:22.306101+0000","last_clean":"2024-09-15T22:50:22.306101+0000","last_became_active":"2024-09-15T22:50:17.065428+0000","last_became_peered":"2024-09-15T22:50:17.065428+0000","last_unstale":"2024-09-15T22:50:22.306101+0000","last_undegraded":"2024-09-15T22:50:22.306101+0000","last_fullsized":"2024-09-15T22:50:22.306101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:21:42.029371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486901+0000","last_change":"2024-09-15T22:50:16.071238+0000","last_active":"2024-09-15T22:50:22.486901+0000","last_peered":"2024-09-15T22:50:22.486901+0000","last_clean":"2024-09-15T22:50:22.486901+0000","last_became_active":"2024-09-15T22:50:16.070890+0000","last_became_peered":"2024-09-15T22:50:16.070890+0000","last_unstale":"2024-09-15T22:50:22.486901+0000","last_undegraded":"2024-09-15T22:50:22.486901+0000","last_fullsized":"2024-09-15T22:50:22.486901+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:43.333769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484106+0000","last_change":"2024-09-15T22:50:21.387626+0000","last_active":"2024-09-15T22:50:22.484106+0000","last_peered":"2024-09-15T22:50:22.484106+0000","last_clean":"2024-09-15T22:50:22.484106+0000","last_became_active":"2024-09-15T22:50:21.386716+0000","last_became_peered":"2024-09-15T22:50:21.386716+0000","last_unstale":"2024-09-15T22:50:22.484106+0000","last_undegraded":"2024-09-15T22:50:22.484106+0000","last_fullsized":"2024-09-15T22:50:22.484106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:51:12.968147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486614+0000","last_change":"2024-09-15T22:50:21.386695+0000","last_active":"2024-09-15T22:50:22.486614+0000","last_peered":"2024-09-15T22:50:22.486614+0000","last_clean":"2024-09-15T22:50:22.486614+0000","last_became_active":"2024-09-15T22:50:21.386288+0000","last_became_peered":"2024-09-15T22:50:21.386288+0000","last_unstale":"2024-09-15T22:50:22.486614+0000","last_undegraded":"2024-09-15T22:50:22.486614+0000","last_fullsized":"2024-09-15T22:50:22.486614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:44.972815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486042+0000","last_change":"2024-09-15T22:50:17.071310+0000","last_active":"2024-09-15T22:50:22.486042+0000","last_peered":"2024-09-15T22:50:22.486042+0000","last_clean":"2024-09-15T22:50:22.486042+0000","last_became_active":"2024-09-15T22:50:17.070951+0000","last_became_peered":"2024-09-15T22:50:17.070951+0000","last_unstale":"2024-09-15T22:50:22.486042+0000","last_undegraded":"2024-09-15T22:50:22.486042+0000","last_fullsized":"2024-09-15T22:50:22.486042+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304617+0000","last_change":"2024-09-15T22:50:16.062316+0000","last_active":"2024-09-15T22:50:22.304617+0000","last_peered":"2024-09-15T22:50:22.304617+0000","last_clean":"2024-09-15T22:50:22.304617+0000","last_became_active":"2024-09-15T22:50:16.062018+0000","last_became_peered":"2024-09-15T22:50:16.062018+0000","last_unstale":"2024-09-15T22:50:22.304617+0000","last_undegraded":"2024-09-15T22:50:22.304617+0000","last_fullsized":"2024-09-15T22:50:22.304617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:18.421004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486740+0000","last_change":"2024-09-15T22:50:21.334779+0000","last_active":"2024-09-15T22:50:22.486740+0000","last_peered":"2024-09-15T22:50:22.486740+0000","last_clean":"2024-09-15T22:50:22.486740+0000","last_became_active":"2024-09-15T22:50:21.334375+0000","last_became_peered":"2024-09-15T22:50:21.334375+0000","last_unstale":"2024-09-15T22:50:22.486740+0000","last_undegraded":"2024-09-15T22:50:22.486740+0000","last_fullsized":"2024-09-15T22:50:22.486740+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:52.957905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484755+0000","last_change":"2024-09-15T22:50:17.068912+0000","last_active":"2024-09-15T22:50:22.484755+0000","last_peered":"2024-09-15T22:50:22.484755+0000","last_clean":"2024-09-15T22:50:22.484755+0000","last_became_active":"2024-09-15T22:50:17.068633+0000","last_became_peered":"2024-09-15T22:50:17.068633+0000","last_unstale":"2024-09-15T22:50:22.484755+0000","last_undegraded":"2024-09-15T22:50:22.484755+0000","last_fullsized":"2024-09-15T22:50:22.484755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484365+0000","last_change":"2024-09-15T22:50:16.063180+0000","last_active":"2024-09-15T22:50:22.484365+0000","last_peered":"2024-09-15T22:50:22.484365+0000","last_clean":"2024-09-15T22:50:22.484365+0000","last_became_active":"2024-09-15T22:50:16.062573+0000","last_became_peered":"2024-09-15T22:50:16.062573+0000","last_unstale":"2024-09-15T22:50:22.484365+0000","last_undegraded":"2024-09-15T22:50:22.484365+0000","last_fullsized":"2024-09-15T22:50:22.484365+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:28:09.656236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486218+0000","last_change":"2024-09-15T22:50:16.061455+0000","last_active":"2024-09-15T22:50:22.486218+0000","last_peered":"2024-09-15T22:50:22.486218+0000","last_clean":"2024-09-15T22:50:22.486218+0000","last_became_active":"2024-09-15T22:50:16.061101+0000","last_became_peered":"2024-09-15T22:50:16.061101+0000","last_unstale":"2024-09-15T22:50:22.486218+0000","last_undegraded":"2024-09-15T22:50:22.486218+0000","last_fullsized":"2024-09-15T22:50:22.486218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:08:10.672527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486076+0000","last_change":"2024-09-15T22:50:17.051703+0000","last_active":"2024-09-15T22:50:22.486076+0000","last_peered":"2024-09-15T22:50:22.486076+0000","last_clean":"2024-09-15T22:50:22.486076+0000","last_became_active":"2024-09-15T22:50:17.051442+0000","last_became_peered":"2024-09-15T22:50:17.051442+0000","last_unstale":"2024-09-15T22:50:22.486076+0000","last_undegraded":"2024-09-15T22:50:22.486076+0000","last_fullsized":"2024-09-15T22:50:22.486076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302396+0000","last_change":"2024-09-15T22:50:21.330393+0000","last_active":"2024-09-15T22:50:22.302396+0000","last_peered":"2024-09-15T22:50:22.302396+0000","last_clean":"2024-09-15T22:50:22.302396+0000","last_became_active":"2024-09-15T22:50:21.329923+0000","last_became_peered":"2024-09-15T22:50:21.329923+0000","last_unstale":"2024-09-15T22:50:22.302396+0000","last_undegraded":"2024-09-15T22:50:22.302396+0000","last_fullsized":"2024-09-15T22:50:22.302396+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:34.927144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484326+0000","last_change":"2024-09-15T22:50:16.062501+0000","last_active":"2024-09-15T22:50:22.484326+0000","last_peered":"2024-09-15T22:50:22.484326+0000","last_clean":"2024-09-15T22:50:22.484326+0000","last_became_active":"2024-09-15T22:50:16.061957+0000","last_became_peered":"2024-09-15T22:50:16.061957+0000","last_unstale":"2024-09-15T22:50:22.484326+0000","last_undegraded":"2024-09-15T22:50:22.484326+0000","last_fullsized":"2024-09-15T22:50:22.484326+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:15.021216+0000","last_clean_scrub_stamp":"2024-09-15T22:50:15.021216+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:27:00.450057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305592+0000","last_change":"2024-09-15T22:50:17.057565+0000","last_active":"2024-09-15T22:50:22.305592+0000","last_peered":"2024-09-15T22:50:22.305592+0000","last_clean":"2024-09-15T22:50:22.305592+0000","last_became_active":"2024-09-15T22:50:17.057276+0000","last_became_peered":"2024-09-15T22:50:17.057276+0000","last_unstale":"2024-09-15T22:50:22.305592+0000","last_undegraded":"2024-09-15T22:50:22.305592+0000","last_fullsized":"2024-09-15T22:50:22.305592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:05:03.054052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484704+0000","last_change":"2024-09-15T22:50:21.330952+0000","last_active":"2024-09-15T22:50:22.484704+0000","last_peered":"2024-09-15T22:50:22.484704+0000","last_clean":"2024-09-15T22:50:22.484704+0000","last_became_active":"2024-09-15T22:50:21.330543+0000","last_became_peered":"2024-09-15T22:50:21.330543+0000","last_unstale":"2024-09-15T22:50:22.484704+0000","last_undegraded":"2024-09-15T22:50:22.484704+0000","last_fullsized":"2024-09-15T22:50:22.484704+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:20.285884+0000","last_clean_scrub_stamp":"2024-09-15T22:50:20.285884+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:33:57.065313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485812+0000","last_change":"2024-09-15T22:50:17.075360+0000","last_active":"2024-09-15T22:50:22.485812+0000","last_peered":"2024-09-15T22:50:22.485812+0000","last_clean":"2024-09-15T22:50:22.485812+0000","last_became_active":"2024-09-15T22:50:17.072943+0000","last_became_peered":"2024-09-15T22:50:17.072943+0000","last_unstale":"2024-09-15T22:50:22.485812+0000","last_undegraded":"2024-09-15T22:50:22.485812+0000","last_fullsized":"2024-09-15T22:50:22.485812+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.301837+0000","last_change":"2024-09-15T22:50:17.062719+0000","last_active":"2024-09-15T22:50:22.301837+0000","last_peered":"2024-09-15T22:50:22.301837+0000","last_clean":"2024-09-15T22:50:22.301837+0000","last_became_active":"2024-09-15T22:50:17.060683+0000","last_became_peered":"2024-09-15T22:50:17.060683+0000","last_unstale":"2024-09-15T22:50:22.301837+0000","last_undegraded":"2024-09-15T22:50:22.301837+0000","last_fullsized":"2024-09-15T22:50:22.301837+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:39:59.707706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305406+0000","last_change":"2024-09-15T22:50:17.067025+0000","last_active":"2024-09-15T22:50:22.305406+0000","last_peered":"2024-09-15T22:50:22.305406+0000","last_clean":"2024-09-15T22:50:22.305406+0000","last_became_active":"2024-09-15T22:50:17.066744+0000","last_became_peered":"2024-09-15T22:50:17.066744+0000","last_unstale":"2024-09-15T22:50:22.305406+0000","last_undegraded":"2024-09-15T22:50:22.305406+0000","last_fullsized":"2024-09-15T22:50:22.305406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:36:50.397722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485996+0000","last_change":"2024-09-15T22:50:17.080748+0000","last_active":"2024-09-15T22:50:22.485996+0000","last_peered":"2024-09-15T22:50:22.485996+0000","last_clean":"2024-09-15T22:50:22.485996+0000","last_became_active":"2024-09-15T22:50:17.080432+0000","last_became_peered":"2024-09-15T22:50:17.080432+0000","last_unstale":"2024-09-15T22:50:22.485996+0000","last_undegraded":"2024-09-15T22:50:22.485996+0000","last_fullsized":"2024-09-15T22:50:22.485996+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484735+0000","last_change":"2024-09-15T22:50:17.057480+0000","last_active":"2024-09-15T22:50:22.484735+0000","last_peered":"2024-09-15T22:50:22.484735+0000","last_clean":"2024-09-15T22:50:22.484735+0000","last_became_active":"2024-09-15T22:50:17.056801+0000","last_became_peered":"2024-09-15T22:50:17.056801+0000","last_unstale":"2024-09-15T22:50:22.484735+0000","last_undegraded":"2024-09-15T22:50:22.484735+0000","last_fullsized":"2024-09-15T22:50:22.484735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:04:56.384966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487677+0000","last_change":"2024-09-15T22:50:17.070941+0000","last_active":"2024-09-15T22:50:22.487677+0000","last_peered":"2024-09-15T22:50:22.487677+0000","last_clean":"2024-09-15T22:50:22.487677+0000","last_became_active":"2024-09-15T22:50:17.070675+0000","last_became_peered":"2024-09-15T22:50:17.070675+0000","last_unstale":"2024-09-15T22:50:22.487677+0000","last_undegraded":"2024-09-15T22:50:22.487677+0000","last_fullsized":"2024-09-15T22:50:22.487677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487164+0000","last_change":"2024-09-15T22:50:17.069743+0000","last_active":"2024-09-15T22:50:22.487164+0000","last_peered":"2024-09-15T22:50:22.487164+0000","last_clean":"2024-09-15T22:50:22.487164+0000","last_became_active":"2024-09-15T22:50:17.069457+0000","last_became_peered":"2024-09-15T22:50:17.069457+0000","last_unstale":"2024-09-15T22:50:22.487164+0000","last_undegraded":"2024-09-15T22:50:22.487164+0000","last_fullsized":"2024-09-15T22:50:22.487164+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484640+0000","last_change":"2024-09-15T22:50:17.061920+0000","last_active":"2024-09-15T22:50:22.484640+0000","last_peered":"2024-09-15T22:50:22.484640+0000","last_clean":"2024-09-15T22:50:22.484640+0000","last_became_active":"2024-09-15T22:50:17.061519+0000","last_became_peered":"2024-09-15T22:50:17.061519+0000","last_unstale":"2024-09-15T22:50:22.484640+0000","last_undegraded":"2024-09-15T22:50:22.484640+0000","last_fullsized":"2024-09-15T22:50:22.484640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:34:49.122936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304510+0000","last_change":"2024-09-15T22:50:17.073525+0000","last_active":"2024-09-15T22:50:22.304510+0000","last_peered":"2024-09-15T22:50:22.304510+0000","last_clean":"2024-09-15T22:50:22.304510+0000","last_became_active":"2024-09-15T22:50:17.073252+0000","last_became_peered":"2024-09-15T22:50:17.073252+0000","last_unstale":"2024-09-15T22:50:22.304510+0000","last_undegraded":"2024-09-15T22:50:22.304510+0000","last_fullsized":"2024-09-15T22:50:22.304510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:28:26.300782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484201+0000","last_change":"2024-09-15T22:50:17.062213+0000","last_active":"2024-09-15T22:50:22.484201+0000","last_peered":"2024-09-15T22:50:22.484201+0000","last_clean":"2024-09-15T22:50:22.484201+0000","last_became_active":"2024-09-15T22:50:17.061935+0000","last_became_peered":"2024-09-15T22:50:17.061935+0000","last_unstale":"2024-09-15T22:50:22.484201+0000","last_undegraded":"2024-09-15T22:50:22.484201+0000","last_fullsized":"2024-09-15T22:50:22.484201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:54:33.780536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305356+0000","last_change":"2024-09-15T22:50:17.065311+0000","last_active":"2024-09-15T22:50:22.305356+0000","last_peered":"2024-09-15T22:50:22.305356+0000","last_clean":"2024-09-15T22:50:22.305356+0000","last_became_active":"2024-09-15T22:50:17.064941+0000","last_became_peered":"2024-09-15T22:50:17.064941+0000","last_unstale":"2024-09-15T22:50:22.305356+0000","last_undegraded":"2024-09-15T22:50:22.305356+0000","last_fullsized":"2024-09-15T22:50:22.305356+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:10.798798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485778+0000","last_change":"2024-09-15T22:50:17.066892+0000","last_active":"2024-09-15T22:50:22.485778+0000","last_peered":"2024-09-15T22:50:22.485778+0000","last_clean":"2024-09-15T22:50:22.485778+0000","last_became_active":"2024-09-15T22:50:17.066604+0000","last_became_peered":"2024-09-15T22:50:17.066604+0000","last_unstale":"2024-09-15T22:50:22.485778+0000","last_undegraded":"2024-09-15T22:50:22.485778+0000","last_fullsized":"2024-09-15T22:50:22.485778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:32:10.165289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486617+0000","last_change":"2024-09-15T22:50:17.063913+0000","last_active":"2024-09-15T22:50:22.486617+0000","last_peered":"2024-09-15T22:50:22.486617+0000","last_clean":"2024-09-15T22:50:22.486617+0000","last_became_active":"2024-09-15T22:50:17.063640+0000","last_became_peered":"2024-09-15T22:50:17.063640+0000","last_unstale":"2024-09-15T22:50:22.486617+0000","last_undegraded":"2024-09-15T22:50:22.486617+0000","last_fullsized":"2024-09-15T22:50:22.486617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486943+0000","last_change":"2024-09-15T22:50:17.065821+0000","last_active":"2024-09-15T22:50:22.486943+0000","last_peered":"2024-09-15T22:50:22.486943+0000","last_clean":"2024-09-15T22:50:22.486943+0000","last_became_active":"2024-09-15T22:50:17.065504+0000","last_became_peered":"2024-09-15T22:50:17.065504+0000","last_unstale":"2024-09-15T22:50:22.486943+0000","last_undegraded":"2024-09-15T22:50:22.486943+0000","last_fullsized":"2024-09-15T22:50:22.486943+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:08:48.700096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.302260+0000","last_change":"2024-09-15T22:50:17.059784+0000","last_active":"2024-09-15T22:50:22.302260+0000","last_peered":"2024-09-15T22:50:22.302260+0000","last_clean":"2024-09-15T22:50:22.302260+0000","last_became_active":"2024-09-15T22:50:17.059381+0000","last_became_peered":"2024-09-15T22:50:17.059381+0000","last_unstale":"2024-09-15T22:50:22.302260+0000","last_undegraded":"2024-09-15T22:50:22.302260+0000","last_fullsized":"2024-09-15T22:50:22.302260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:14.379200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306503+0000","last_change":"2024-09-15T22:50:17.069837+0000","last_active":"2024-09-15T22:50:22.306503+0000","last_peered":"2024-09-15T22:50:22.306503+0000","last_clean":"2024-09-15T22:50:22.306503+0000","last_became_active":"2024-09-15T22:50:17.068275+0000","last_became_peered":"2024-09-15T22:50:17.068275+0000","last_unstale":"2024-09-15T22:50:22.306503+0000","last_undegraded":"2024-09-15T22:50:22.306503+0000","last_fullsized":"2024-09-15T22:50:22.306503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.202716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304393+0000","last_change":"2024-09-15T22:50:17.047980+0000","last_active":"2024-09-15T22:50:22.304393+0000","last_peered":"2024-09-15T22:50:22.304393+0000","last_clean":"2024-09-15T22:50:22.304393+0000","last_became_active":"2024-09-15T22:50:17.047534+0000","last_became_peered":"2024-09-15T22:50:17.047534+0000","last_unstale":"2024-09-15T22:50:22.304393+0000","last_undegraded":"2024-09-15T22:50:22.304393+0000","last_fullsized":"2024-09-15T22:50:22.304393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:45:25.741139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486065+0000","last_change":"2024-09-15T22:50:17.064022+0000","last_active":"2024-09-15T22:50:22.486065+0000","last_peered":"2024-09-15T22:50:22.486065+0000","last_clean":"2024-09-15T22:50:22.486065+0000","last_became_active":"2024-09-15T22:50:17.063674+0000","last_became_peered":"2024-09-15T22:50:17.063674+0000","last_unstale":"2024-09-15T22:50:22.486065+0000","last_undegraded":"2024-09-15T22:50:22.486065+0000","last_fullsized":"2024-09-15T22:50:22.486065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.485117+0000","last_change":"2024-09-15T22:50:17.068410+0000","last_active":"2024-09-15T22:50:22.485117+0000","last_peered":"2024-09-15T22:50:22.485117+0000","last_clean":"2024-09-15T22:50:22.485117+0000","last_became_active":"2024-09-15T22:50:17.068107+0000","last_became_peered":"2024-09-15T22:50:17.068107+0000","last_unstale":"2024-09-15T22:50:22.485117+0000","last_undegraded":"2024-09-15T22:50:22.485117+0000","last_fullsized":"2024-09-15T22:50:22.485117+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:02:30.669334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484956+0000","last_change":"2024-09-15T22:50:17.065023+0000","last_active":"2024-09-15T22:50:22.484956+0000","last_peered":"2024-09-15T22:50:22.484956+0000","last_clean":"2024-09-15T22:50:22.484956+0000","last_became_active":"2024-09-15T22:50:17.062070+0000","last_became_peered":"2024-09-15T22:50:17.062070+0000","last_unstale":"2024-09-15T22:50:22.484956+0000","last_undegraded":"2024-09-15T22:50:22.484956+0000","last_fullsized":"2024-09-15T22:50:22.484956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:10.219077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.306061+0000","last_change":"2024-09-15T22:50:17.057591+0000","last_active":"2024-09-15T22:50:22.306061+0000","last_peered":"2024-09-15T22:50:22.306061+0000","last_clean":"2024-09-15T22:50:22.306061+0000","last_became_active":"2024-09-15T22:50:17.057197+0000","last_became_peered":"2024-09-15T22:50:17.057197+0000","last_unstale":"2024-09-15T22:50:22.306061+0000","last_undegraded":"2024-09-15T22:50:22.306061+0000","last_fullsized":"2024-09-15T22:50:22.306061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:31:44.340627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486588+0000","last_change":"2024-09-15T22:50:17.068923+0000","last_active":"2024-09-15T22:50:22.486588+0000","last_peered":"2024-09-15T22:50:22.486588+0000","last_clean":"2024-09-15T22:50:22.486588+0000","last_became_active":"2024-09-15T22:50:17.068660+0000","last_became_peered":"2024-09-15T22:50:17.068660+0000","last_unstale":"2024-09-15T22:50:22.486588+0000","last_undegraded":"2024-09-15T22:50:22.486588+0000","last_fullsized":"2024-09-15T22:50:22.486588+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:00:23.761198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487061+0000","last_change":"2024-09-15T22:50:17.061612+0000","last_active":"2024-09-15T22:50:22.487061+0000","last_peered":"2024-09-15T22:50:22.487061+0000","last_clean":"2024-09-15T22:50:22.487061+0000","last_became_active":"2024-09-15T22:50:17.061326+0000","last_became_peered":"2024-09-15T22:50:17.061326+0000","last_unstale":"2024-09-15T22:50:22.487061+0000","last_undegraded":"2024-09-15T22:50:22.487061+0000","last_fullsized":"2024-09-15T22:50:22.487061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487332+0000","last_change":"2024-09-15T22:50:17.069598+0000","last_active":"2024-09-15T22:50:22.487332+0000","last_peered":"2024-09-15T22:50:22.487332+0000","last_clean":"2024-09-15T22:50:22.487332+0000","last_became_active":"2024-09-15T22:50:17.069306+0000","last_became_peered":"2024-09-15T22:50:17.069306+0000","last_unstale":"2024-09-15T22:50:22.487332+0000","last_undegraded":"2024-09-15T22:50:22.487332+0000","last_fullsized":"2024-09-15T22:50:22.487332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:14:40.715006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.484518+0000","last_change":"2024-09-15T22:50:17.065548+0000","last_active":"2024-09-15T22:50:22.484518+0000","last_peered":"2024-09-15T22:50:22.484518+0000","last_clean":"2024-09-15T22:50:22.484518+0000","last_became_active":"2024-09-15T22:50:17.065190+0000","last_became_peered":"2024-09-15T22:50:17.065190+0000","last_unstale":"2024-09-15T22:50:22.484518+0000","last_undegraded":"2024-09-15T22:50:22.484518+0000","last_fullsized":"2024-09-15T22:50:22.484518+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486349+0000","last_change":"2024-09-15T22:50:17.076002+0000","last_active":"2024-09-15T22:50:22.486349+0000","last_peered":"2024-09-15T22:50:22.486349+0000","last_clean":"2024-09-15T22:50:22.486349+0000","last_became_active":"2024-09-15T22:50:17.075622+0000","last_became_peered":"2024-09-15T22:50:17.075622+0000","last_unstale":"2024-09-15T22:50:22.486349+0000","last_undegraded":"2024-09-15T22:50:22.486349+0000","last_fullsized":"2024-09-15T22:50:22.486349+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:37:25.042098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.305301+0000","last_change":"2024-09-15T22:50:17.047855+0000","last_active":"2024-09-15T22:50:22.305301+0000","last_peered":"2024-09-15T22:50:22.305301+0000","last_clean":"2024-09-15T22:50:22.305301+0000","last_became_active":"2024-09-15T22:50:17.047575+0000","last_became_peered":"2024-09-15T22:50:17.047575+0000","last_unstale":"2024-09-15T22:50:22.305301+0000","last_undegraded":"2024-09-15T22:50:22.305301+0000","last_fullsized":"2024-09-15T22:50:22.305301+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:54.712256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486484+0000","last_change":"2024-09-15T22:50:17.065385+0000","last_active":"2024-09-15T22:50:22.486484+0000","last_peered":"2024-09-15T22:50:22.486484+0000","last_clean":"2024-09-15T22:50:22.486484+0000","last_became_active":"2024-09-15T22:50:17.065082+0000","last_became_peered":"2024-09-15T22:50:17.065082+0000","last_unstale":"2024-09-15T22:50:22.486484+0000","last_undegraded":"2024-09-15T22:50:22.486484+0000","last_fullsized":"2024-09-15T22:50:22.486484+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:52:39.831313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.304881+0000","last_change":"2024-09-15T22:50:17.069029+0000","last_active":"2024-09-15T22:50:22.304881+0000","last_peered":"2024-09-15T22:50:22.304881+0000","last_clean":"2024-09-15T22:50:22.304881+0000","last_became_active":"2024-09-15T22:50:17.068353+0000","last_became_peered":"2024-09-15T22:50:17.068353+0000","last_unstale":"2024-09-15T22:50:22.304881+0000","last_undegraded":"2024-09-15T22:50:22.304881+0000","last_fullsized":"2024-09-15T22:50:22.304881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:10.316118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.486448+0000","last_change":"2024-09-15T22:50:17.066254+0000","last_active":"2024-09-15T22:50:22.486448+0000","last_peered":"2024-09-15T22:50:22.486448+0000","last_clean":"2024-09-15T22:50:22.486448+0000","last_became_active":"2024-09-15T22:50:17.065906+0000","last_became_peered":"2024-09-15T22:50:17.065906+0000","last_unstale":"2024-09-15T22:50:22.486448+0000","last_undegraded":"2024-09-15T22:50:22.486448+0000","last_fullsized":"2024-09-15T22:50:22.486448+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:26:08.396690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.488087+0000","last_change":"2024-09-15T22:50:17.075262+0000","last_active":"2024-09-15T22:50:22.488087+0000","last_peered":"2024-09-15T22:50:22.488087+0000","last_clean":"2024-09-15T22:50:22.488087+0000","last_became_active":"2024-09-15T22:50:17.074935+0000","last_became_peered":"2024-09-15T22:50:17.074935+0000","last_unstale":"2024-09-15T22:50:22.488087+0000","last_undegraded":"2024-09-15T22:50:22.488087+0000","last_fullsized":"2024-09-15T22:50:22.488087+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:28:18.228632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-09-15T22:50:22.487272+0000","last_change":"2024-09-15T22:50:17.065618+0000","last_active":"2024-09-15T22:50:22.487272+0000","last_peered":"2024-09-15T22:50:22.487272+0000","last_clean":"2024-09-15T22:50:22.487272+0000","last_became_active":"2024-09-15T22:50:17.065380+0000","last_became_peered":"2024-09-15T22:50:17.065380+0000","last_unstale":"2024-09-15T22:50:22.487272+0000","last_undegraded":"2024-09-15T22:50:22.487272+0000","last_fullsized":"2024-09-15T22:50:22.487272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:16.028074+0000","last_clean_scrub_stamp":"2024-09-15T22:50:16.028074+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:10:41.033194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4642,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27880,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343960,"statfs":{"total":96636764160,"available":96608215040,"internally_reserved":0,"allocated":860160,"data_stored":694509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542154,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":266240,"data_stored":103649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":274432,"data_stored":103685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":274432,"data_stored":107403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542155,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":262144,"data_stored":103559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542154,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":270336,"data_stored":103719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27876,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343964,"statfs":{"total":96636764160,"available":96608219136,"internally_reserved":0,"allocated":868352,"data_stored":694565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:50:44.613 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:50:44.613 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-15T22:50:44.613 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-15T22:50:44.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-15T22:50:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 Processor -- start 2024-09-15T22:50:44.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 -- start start 2024-09-15T22:50:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 0x7fdef8140720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef815b610 con 0x7fdef8140340 2024-09-15T22:50:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdef815b8d0 con 0x7fdef806f270 2024-09-15T22:50:44.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.789+0000 7fdefce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdef815bbb0 con 0x7fdef813e720 2024-09-15T22:50:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdef8140340 0x7fdef8141100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:58620/0 (socket says 172.21.15.31:58620) 2024-09-15T22:50:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5e00640 1 -- 172.21.15.31:0/1403020820 learned_addr learned my addr 172.21.15.31:0/1403020820 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdeed400640 1 --2- 172.21.15.31:0/1403020820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 0x7fdef8140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2123984206 0 0) 0x7fdef815b610 con 0x7fdef8140340 2024-09-15T22:50:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdedc003530 con 0x7fdef8140340 2024-09-15T22:50:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdeed400640 1 -- 172.21.15.31:0/1403020820 >> v1:172.21.15.102:6789/0 conn(0x7fdef806f270 legacy=0x7fdef80cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888769253 0 0) 0x7fdef815b8d0 con 0x7fdef806f270 2024-09-15T22:50:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdeed400640 1 -- 172.21.15.31:0/1403020820 >> v1:172.21.15.31:6789/0 conn(0x7fdef8140340 legacy=0x7fdef8141100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdeed400640 1 -- 172.21.15.31:0/1403020820 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef815be90 con 0x7fdef813e720 2024-09-15T22:50:44.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdeed400640 1 --2- 172.21.15.31:0/1403020820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 0x7fdef8140720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097f0 tx=0x7fdee001c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c2073b73c9d142 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.793+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b2070 con 0x7fdef813e720 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee00a9070 con 0x7fdef813e720 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdef5400640 1 -- 172.21.15.31:0/1403020820 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00ad880 con 0x7fdef813e720 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- 172.21.15.31:0/1403020820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 msgr2=0x7fdef8140720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 --2- 172.21.15.31:0/1403020820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 0x7fdef8140720 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdee00097f0 tx=0x7fdee001c450 comp rx=0 tx=0).stop 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- 172.21.15.31:0/1403020820 shutdown_connections 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 --2- 172.21.15.31:0/1403020820 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef813e720 0x7fdef8140720 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- 172.21.15.31:0/1403020820 >> 172.21.15.31:0/1403020820 conn(0x7fdef8067e00 msgr2=0x7fdef806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:44.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- 172.21.15.31:0/1403020820 shutdown_connections 2024-09-15T22:50:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- 172.21.15.31:0/1403020820 wait complete. 2024-09-15T22:50:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 Processor -- start 2024-09-15T22:50:44.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- start start 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 0x7fdef8156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef8140340 0x7fdef8165f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806e2e0 con 0x7fdef813e720 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdef806e160 con 0x7fdef806f270 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdefce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdef806e460 con 0x7fdef8140340 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39486/0 (socket says 172.21.15.31:39486) 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 -- 172.21.15.31:0/2119210730 learned_addr learned my addr 172.21.15.31:0/2119210730 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdef5e00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 0x7fdef8156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdef6800640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef8140340 0x7fdef8165f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 -- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef8140340 msgr2=0x7fdef8165f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef8140340 0x7fdef8165f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 -- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 msgr2=0x7fdef8156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 0x7fdef8156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdeed400640 1 -- 172.21.15.31:0/2119210730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef8155cd0 con 0x7fdef813e720 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.797+0000 7fdef5e00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 0x7fdef8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:44.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeed400640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009740 tx=0x7fdee00191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00bc020 con 0x7fdef813e720 2024-09-15T22:50:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdee00add60 con 0x7fdef813e720 2024-09-15T22:50:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdee00b2040 con 0x7fdef813e720 2024-09-15T22:50:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef8158440 con 0x7fdef813e720 2024-09-15T22:50:44.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef8156270 con 0x7fdef813e720 2024-09-15T22:50:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef8140720 con 0x7fdef813e720 2024-09-15T22:50:44.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdee00bf070 con 0x7fdef813e720 2024-09-15T22:50:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.801+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fdee011eda0 con 0x7fdef813e720 2024-09-15T22:50:44.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.805+0000 7fdef5e00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:44.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.805+0000 7fdef5e00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 0x7fded4069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdee8005890 tx=0x7fdee8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:44.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:44.809+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdee00160d0 con 0x7fdef813e720 2024-09-15T22:50:45.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.005+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fdef80cf6d0 con 0x7fdef813e720 2024-09-15T22:50:45.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.005+0000 7fdeeea00640 1 -- 172.21.15.31:0/2119210730 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fdee00ef580 con 0x7fdef813e720 2024-09-15T22:50:45.012 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:45.012 INFO:teuthology.orchestra.run.smithi031.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-15T22:50:45.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 msgr2=0x7fded4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 0x7fded4069d80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdee8005890 tx=0x7fdee8009040 comp rx=0 tx=0).stop 2024-09-15T22:50:45.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 msgr2=0x7fdef8139fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fdee0009740 tx=0x7fdee00191f0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 shutdown_connections 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fded40678c0 0x7fded4069d80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdef8140340 0x7fdef8165f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdef813e720 0x7fdef8139fc0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 --2- 172.21.15.31:0/2119210730 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdef806f270 0x7fdef8156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 >> 172.21.15.31:0/2119210730 conn(0x7fdef8067e00 msgr2=0x7fdef80b4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 shutdown_connections 2024-09-15T22:50:45.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.009+0000 7fdefce00640 1 -- 172.21.15.31:0/2119210730 wait complete. 2024-09-15T22:50:45.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-15T22:50:45.034 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:45.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.169+0000 7f622ce00640 1 Processor -- start 2024-09-15T22:50:45.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.169+0000 7f622ce00640 1 -- start start 2024-09-15T22:50:45.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f622ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f6228166d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f622ce00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62281407b0 con 0x7f622813fa40 2024-09-15T22:50:45.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f622ce00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6228140a90 con 0x7f6228072160 2024-09-15T22:50:45.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f622ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f622813f640 con 0x7f622806f170 2024-09-15T22:50:45.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f622813fa40 0x7f622813fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47746/0 (socket says 172.21.15.31:47746) 2024-09-15T22:50:45.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 -- 172.21.15.31:0/3539774772 learned_addr learned my addr 172.21.15.31:0/3539774772 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399929555 0 0) 0x7f62281407b0 con 0x7f622813fa40 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620c003530 con 0x7f622813fa40 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6226800640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f6228166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3193758611 0 0) 0x7f620c003530 con 0x7f622813fa40 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 msgr2=0x7f6228166d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f6228166d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 >> v1:172.21.15.102:6789/0 conn(0x7f6228072160 legacy=0x7f6228072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6228140d70 con 0x7f622813fa40 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f6210001680 con 0x7f622813fa40 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 >> v1:172.21.15.31:6789/0 conn(0x7f622813fa40 legacy=0x7f622813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f620c0039f0 0x7f620c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f620c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f620c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f622813f640 con 0x7f620c004810 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f620c00bb00 con 0x7f620c0039f0 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f620c00bd00 con 0x7f622806f170 2024-09-15T22:50:45.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f620c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6226800640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f620c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f6225e00640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f620c0039f0 0x7f620c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 -- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 msgr2=0x7f620c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f622806f170 0x7f620c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 -- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f620c0039f0 msgr2=0x7f620c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f620c0039f0 0x7f620c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.173+0000 7f621d400640 1 -- 172.21.15.31:0/3539774772 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f620c003530 con 0x7f620c004810 2024-09-15T22:50:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f621d400640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f620c004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f621000c160 tx=0x7f621001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804395d82939278c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210007c90 con 0x7f620c004810 2024-09-15T22:50:45.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62100a9070 con 0x7f620c004810 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f6225400640 1 -- 172.21.15.31:0/3539774772 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6210005d40 con 0x7f620c004810 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- 172.21.15.31:0/3539774772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 msgr2=0x7f620c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 --2- 172.21.15.31:0/3539774772 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f620c004c90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f621000c160 tx=0x7f621001cbc0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f6226800640 1 -- 172.21.15.31:0/3539774772 reap_dead start 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- 172.21.15.31:0/3539774772 shutdown_connections 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- 172.21.15.31:0/3539774772 >> 172.21.15.31:0/3539774772 conn(0x7f6228067e00 msgr2=0x7f622806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- 172.21.15.31:0/3539774772 shutdown_connections 2024-09-15T22:50:45.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- 172.21.15.31:0/3539774772 wait complete. 2024-09-15T22:50:45.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 Processor -- start 2024-09-15T22:50:45.184 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.177+0000 7f622ce00640 1 -- start start 2024-09-15T22:50:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f622815f620 0x7f6228139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62281f0d80 0x7f62281592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f62280b35e0 con 0x7f620c004810 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62281413c0 con 0x7f622815f620 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f62280b3760 con 0x7f62281f0d80 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53328/0 (socket says 172.21.15.31:53328) 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 -- 172.21.15.31:0/448098721 learned_addr learned my addr 172.21.15.31:0/448098721 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f621d400640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f622815f620 0x7f6228139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6226800640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62281f0d80 0x7f62281592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 -- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62281f0d80 msgr2=0x7f62281592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62281f0d80 0x7f62281592f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 -- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f622815f620 msgr2=0x7f6228139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f622815f620 0x7f6228139e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 -- 172.21.15.31:0/448098721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622815d0e0 con 0x7f620c004810 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f6225e00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6218011be0 tx=0x7f621800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218011cd0 con 0x7f620c004810 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f621801a070 con 0x7f620c004810 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f622815d3c0 con 0x7f620c004810 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6218005310 con 0x7f620c004810 2024-09-15T22:50:45.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f622815d6a0 con 0x7f620c004810 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6228140a90 con 0x7f620c004810 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.181+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6218013040 con 0x7f620c004810 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.185+0000 7f621ea00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 0x7f6204069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.185+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f62180890b0 con 0x7f620c004810 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.185+0000 7f621d400640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 0x7f6204069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.185+0000 7f621d400640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 0x7f6204069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62100ab000 tx=0x7f62100a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.189+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6218059250 con 0x7f620c004810 2024-09-15T22:50:45.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.393+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f622813d8d0 con 0x7f620c004810 2024-09-15T22:50:45.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.393+0000 7f621ea00640 1 -- 172.21.15.31:0/448098721 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7f621805d550 con 0x7f620c004810 2024-09-15T22:50:45.398 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:45.398 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:45.399 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:50:45.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 msgr2=0x7f6204069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 0x7f6204069d80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f62100ab000 tx=0x7f62100a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 msgr2=0x7f62280aee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6218011be0 tx=0x7f621800f5a0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 shutdown_connections 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62040678c0 0x7f6204069d80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62281f0d80 0x7f62281592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f622815f620 0x7f6228139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 --2- 172.21.15.31:0/448098721 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f620c004810 0x7f62280aee90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 >> 172.21.15.31:0/448098721 conn(0x7f6228067e00 msgr2=0x7f62280b21c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 shutdown_connections 2024-09-15T22:50:45.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.397+0000 7f622ce00640 1 -- 172.21.15.31:0/448098721 wait complete. 2024-09-15T22:50:45.420 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:45.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 Processor -- start 2024-09-15T22:50:45.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 -- start start 2024-09-15T22:50:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8d7c15f770 0x7f8d7c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d7c161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d7c0d0c70 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8d7c160040 con 0x7f8d7c15f770 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d83800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0d0f50 con 0x7f8d7c09af80 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d80e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8d7c15e6d0 0x7f8d7c0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47748/0 (socket says 172.21.15.31:47748) 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d80e00640 1 -- 172.21.15.31:0/1816680276 learned_addr learned my addr 172.21.15.31:0/1816680276 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d81800640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d7c161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7be00640 1 --2- 172.21.15.31:0/1816680276 >> v2:172.21.15.102:3300/0 conn(0x7f8d7c15f770 0x7f8d7c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 471016565 0 0) 0x7f8d7c0d0c70 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d64003530 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3224310888 0 0) 0x7f8d64003530 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 msgr2=0x7f8d7c161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d7c161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 >> v2:172.21.15.102:3300/0 conn(0x7f8d7c15f770 msgr2=0x7f8d7c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 --2- 172.21.15.31:0/1816680276 >> v2:172.21.15.102:3300/0 conn(0x7f8d7c15f770 0x7f8d7c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0d1230 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f8d70001680 con 0x7f8d7c15e6d0 2024-09-15T22:50:45.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 >> v1:172.21.15.31:6789/0 conn(0x7f8d7c15e6d0 legacy=0x7f8d7c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d640039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d64003f90 0x7f8d64004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d64004d50 0x7f8d640051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c0d0f50 con 0x7f8d64003f90 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6400b9d0 con 0x7f8d64004d50 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8d6400bb50 con 0x7f8d7c09af80 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7be00640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d64003f90 0x7f8d64004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d80e00640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d640039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d81800640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d64004d50 0x7f8d640051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7be00640 1 -- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 msgr2=0x7f8d640039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.557+0000 7f8d7be00640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d7c09af80 0x7f8d640039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.566 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7be00640 1 -- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d64004d50 msgr2=0x7f8d640051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7be00640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d64004d50 0x7f8d640051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7be00640 1 -- 172.21.15.31:0/1816680276 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d64003530 con 0x7f8d64003f90 2024-09-15T22:50:45.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d81800640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d64004d50 0x7f8d640051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7be00640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d64003f90 0x7f8d64004810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b10 tx=0x7f8d6801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1871b0433e44291 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680b2070 con 0x7f8d64003f90 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d680a56a0 con 0x7f8d64003f90 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d7b400640 1 -- 172.21.15.31:0/1816680276 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680096b0 con 0x7f8d64003f90 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 -- 172.21.15.31:0/1816680276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d64003f90 msgr2=0x7f8d64004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 --2- 172.21.15.31:0/1816680276 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d64003f90 0x7f8d64004810 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b10 tx=0x7f8d6801cab0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d81800640 1 -- 172.21.15.31:0/1816680276 reap_dead start 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 -- 172.21.15.31:0/1816680276 shutdown_connections 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 -- 172.21.15.31:0/1816680276 >> 172.21.15.31:0/1816680276 conn(0x7f8d7c0d23b0 msgr2=0x7f8d7c0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 -- 172.21.15.31:0/1816680276 shutdown_connections 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.561+0000 7f8d83800640 1 -- 172.21.15.31:0/1816680276 wait complete. 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 Processor -- start 2024-09-15T22:50:45.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 -- start start 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d64003f90 0x7f8d7c0b0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d7c1571f0 0x7f8d7c1e8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c15eab0 con 0x7f8d7c0af150 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8d7c15fbb0 con 0x7f8d7c1571f0 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8d7c0d17f0 con 0x7f8d64003f90 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53350/0 (socket says 172.21.15.31:53350) 2024-09-15T22:50:45.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 -- 172.21.15.31:0/3637552498 learned_addr learned my addr 172.21.15.31:0/3637552498 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:45.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d80e00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d64003f90 0x7f8d7c0b0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d81800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d7c1571f0 0x7f8d7c1e8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 -- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d64003f90 msgr2=0x7f8d7c0b0860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d64003f90 0x7f8d7c0b0860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 -- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d7c1571f0 msgr2=0x7f8d7c1e8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d7c1571f0 0x7f8d7c1e8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 -- 172.21.15.31:0/3637552498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7c0b7e60 con 0x7f8d7c0af150 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d7be00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b10 tx=0x7f8d64005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680bc020 con 0x7f8d7c0af150 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d68004020 con 0x7f8d7c0af150 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d680b2040 con 0x7f8d7c0af150 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.565+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7c0af7c0 con 0x7f8d7c0af150 2024-09-15T22:50:45.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7c0afd80 con 0x7f8d7c0af150 2024-09-15T22:50:45.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d7c09aa40 con 0x7f8d7c0af150 2024-09-15T22:50:45.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8d68003620 con 0x7f8d7c0af150 2024-09-15T22:50:45.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d78c00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 0x7f8d5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d68120220 con 0x7f8d7c0af150 2024-09-15T22:50:45.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d80e00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 0x7f8d5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.569+0000 7f8d80e00640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 0x7f8d5c069db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d70001060 tx=0x7f8d70009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.573+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8d680c6020 con 0x7f8d7c0af150 2024-09-15T22:50:45.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d7c163110 con 0x7f8d7c0af150 2024-09-15T22:50:45.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d78c00640 1 -- 172.21.15.31:0/3637552498 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7f8d7c0b7e60 con 0x7f8d7c0af150 2024-09-15T22:50:45.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:45.781 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:45.782 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:50:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 msgr2=0x7f8d5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 0x7f8d5c069db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8d70001060 tx=0x7f8d70009040 comp rx=0 tx=0).stop 2024-09-15T22:50:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 msgr2=0x7f8d7c0b7920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b10 tx=0x7f8d64005840 comp rx=0 tx=0).stop 2024-09-15T22:50:45.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 shutdown_connections 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8d5c0678f0 0x7f8d5c069db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8d7c1571f0 0x7f8d7c1e8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8d7c0af150 0x7f8d7c0b7920 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 --2- 172.21.15.31:0/3637552498 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8d64003f90 0x7f8d7c0b0860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 >> 172.21.15.31:0/3637552498 conn(0x7f8d7c0d23b0 msgr2=0x7f8d7c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 shutdown_connections 2024-09-15T22:50:45.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.777+0000 7f8d83800640 1 -- 172.21.15.31:0/3637552498 wait complete. 2024-09-15T22:50:45.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:45.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.937+0000 7f4b3a400640 1 Processor -- start 2024-09-15T22:50:45.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.937+0000 7f4b3a400640 1 -- start start 2024-09-15T22:50:45.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b3a400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 0x7f4b3415f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b3a400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b340b1c70 con 0x7f4b3406d990 2024-09-15T22:50:45.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b3a400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b3409b1e0 con 0x7f4b3415ffb0 2024-09-15T22:50:45.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b3a400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b341603f0 con 0x7f4b340b1890 2024-09-15T22:50:45.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4b3406d990 0x7f4b3415e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47760/0 (socket says 172.21.15.31:47760) 2024-09-15T22:50:45.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33e00640 1 -- 172.21.15.31:0/3300558050 learned_addr learned my addr 172.21.15.31:0/3300558050 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:45.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33400640 1 --2- 172.21.15.31:0/3300558050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 0x7f4b3415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4194361285 0 0) 0x7f4b2c001120 con 0x7f4b3406d990 2024-09-15T22:50:45.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b18003530 con 0x7f4b3406d990 2024-09-15T22:50:45.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660292799 0 0) 0x7f4b3409b1e0 con 0x7f4b3415ffb0 2024-09-15T22:50:45.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b2c001120 con 0x7f4b3415ffb0 2024-09-15T22:50:45.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33400640 1 -- 172.21.15.31:0/3300558050 >> v1:172.21.15.102:6789/0 conn(0x7f4b3415ffb0 legacy=0x7f4b3406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33400640 1 -- 172.21.15.31:0/3300558050 >> v1:172.21.15.31:6789/0 conn(0x7f4b3406d990 legacy=0x7f4b3415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.941+0000 7f4b33400640 1 -- 172.21.15.31:0/3300558050 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b3409b4c0 con 0x7f4b340b1890 2024-09-15T22:50:45.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b33400640 1 --2- 172.21.15.31:0/3300558050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 0x7f4b3415f810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009dc0 tx=0x7f4b2401c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5edba1a1cf5d0e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240b2070 con 0x7f4b340b1890 2024-09-15T22:50:45.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b240a5930 con 0x7f4b340b1890 2024-09-15T22:50:45.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b32a00640 1 -- 172.21.15.31:0/3300558050 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b240a5ce0 con 0x7f4b340b1890 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- 172.21.15.31:0/3300558050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 msgr2=0x7f4b3415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 --2- 172.21.15.31:0/3300558050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 0x7f4b3415f810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4b24009dc0 tx=0x7f4b2401c960 comp rx=0 tx=0).stop 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- 172.21.15.31:0/3300558050 shutdown_connections 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 --2- 172.21.15.31:0/3300558050 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b340b1890 0x7f4b3415f810 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- 172.21.15.31:0/3300558050 >> 172.21.15.31:0/3300558050 conn(0x7f4b340d23b0 msgr2=0x7f4b340d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- 172.21.15.31:0/3300558050 shutdown_connections 2024-09-15T22:50:45.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- 172.21.15.31:0/3300558050 wait complete. 2024-09-15T22:50:45.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 Processor -- start 2024-09-15T22:50:45.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 -- start start 2024-09-15T22:50:45.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.945+0000 7f4b3a400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b3406d990 0x7f4b34159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 0x7f4b3415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4b340d13a0 con 0x7f4b340b1890 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b3409ae50 con 0x7f4b3415ffb0 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b340d1520 con 0x7f4b3406d990 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53352/0 (socket says 172.21.15.31:53352) 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 -- 172.21.15.31:0/484231214 learned_addr learned my addr 172.21.15.31:0/484231214 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b33400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b3406d990 0x7f4b34159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b33e00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 0x7f4b3415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 -- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b3406d990 msgr2=0x7f4b34159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b3406d990 0x7f4b34159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 -- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 msgr2=0x7f4b3415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 0x7f4b3415a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 -- 172.21.15.31:0/484231214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b340b70e0 con 0x7f4b340b1890 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b33e00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 0x7f4b3415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2aa00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c430 tx=0x7f4b1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c017070 con 0x7f4b340b1890 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0052f0 con 0x7f4b340b1890 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c003840 con 0x7f4b340b1890 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b340b73c0 con 0x7f4b340b1890 2024-09-15T22:50:45.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b340b7980 con 0x7f4b340b1890 2024-09-15T22:50:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b3409b1e0 con 0x7f4b340b1890 2024-09-15T22:50:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.949+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b1c01a070 con 0x7f4b340b1890 2024-09-15T22:50:45.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.953+0000 7f4b2be00640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.953+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4b1c085760 con 0x7f4b340b1890 2024-09-15T22:50:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.953+0000 7f4b33400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:45.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.953+0000 7f4b33400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 0x7f4b10069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b240af000 tx=0x7f4b240a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:45.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:45.953+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b1c021020 con 0x7f4b340b1890 2024-09-15T22:50:46.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.121+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b340b6ec0 con 0x7f4b340b1890 2024-09-15T22:50:46.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.121+0000 7f4b2be00640 1 -- 172.21.15.31:0/484231214 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7f4b1c0558f0 con 0x7f4b340b1890 2024-09-15T22:50:46.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:46.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:46.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 msgr2=0x7f4b10069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 0x7f4b10069d80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4b240af000 tx=0x7f4b240a7070 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 msgr2=0x7f4b3415c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c430 tx=0x7f4b1c00c8f0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 shutdown_connections 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b100678c0 0x7f4b10069d80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b3415ffb0 0x7f4b3415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b340b1890 0x7f4b3415c6a0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 --2- 172.21.15.31:0/484231214 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b3406d990 0x7f4b34159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 >> 172.21.15.31:0/484231214 conn(0x7f4b340d23b0 msgr2=0x7f4b340b26a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 shutdown_connections 2024-09-15T22:50:46.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.125+0000 7f4b3a400640 1 -- 172.21.15.31:0/484231214 wait complete. 2024-09-15T22:50:46.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:50:46.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 Processor -- start 2024-09-15T22:50:46.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 -- start start 2024-09-15T22:50:46.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f371c0ae470 0x7f371c169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:46.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c0af440 con 0x7f371c0b04e0 2024-09-15T22:50:46.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371c0af720 con 0x7f371c15c080 2024-09-15T22:50:46.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3721a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f371c0b0050 con 0x7f371c0ae470 2024-09-15T22:50:46.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3712000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f371c0b04e0 0x7f371c0add60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:47772/0 (socket says 172.21.15.31:47772) 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f3712000640 1 -- 172.21.15.31:0/1317702832 learned_addr learned my addr 172.21.15.31:0/1317702832 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.285+0000 7f371b400640 1 --2- 172.21.15.31:0/1317702832 >> v2:172.21.15.102:3300/0 conn(0x7f371c0ae470 0x7f371c169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432748237 0 0) 0x7f371c0af440 con 0x7f371c0b04e0 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3700003530 con 0x7f371c0b04e0 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371b400640 1 -- 172.21.15.31:0/1317702832 >> v1:172.21.15.102:6789/0 conn(0x7f371c15c080 legacy=0x7f371c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840097579 0 0) 0x7f371c0af720 con 0x7f371c15c080 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371b400640 1 -- 172.21.15.31:0/1317702832 >> v1:172.21.15.31:6789/0 conn(0x7f371c0b04e0 legacy=0x7f371c0add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371b400640 1 -- 172.21.15.31:0/1317702832 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c0afa00 con 0x7f371c0ae470 2024-09-15T22:50:46.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371b400640 1 --2- 172.21.15.31:0/1317702832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c0ae470 0x7f371c169110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=64ef191f86fa1162 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:46.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140b2070 con 0x7f371c0ae470 2024-09-15T22:50:46.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37140a5830 con 0x7f371c0ae470 2024-09-15T22:50:46.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f371a000640 1 -- 172.21.15.31:0/1317702832 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37140a5be0 con 0x7f371c0ae470 2024-09-15T22:50:46.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f3721a00640 1 -- 172.21.15.31:0/1317702832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c0ae470 msgr2=0x7f371c169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f3721a00640 1 --2- 172.21.15.31:0/1317702832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c0ae470 0x7f371c169110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3714009d90 tx=0x7f371401c970 comp rx=0 tx=0).stop 2024-09-15T22:50:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f3721a00640 1 -- 172.21.15.31:0/1317702832 shutdown_connections 2024-09-15T22:50:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f3721a00640 1 --2- 172.21.15.31:0/1317702832 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c0ae470 0x7f371c169110 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.289+0000 7f3721a00640 1 -- 172.21.15.31:0/1317702832 >> 172.21.15.31:0/1317702832 conn(0x7f371c06bcc0 msgr2=0x7f371c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- 172.21.15.31:0/1317702832 shutdown_connections 2024-09-15T22:50:46.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- 172.21.15.31:0/1317702832 wait complete. 2024-09-15T22:50:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 Processor -- start 2024-09-15T22:50:46.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- start start 2024-09-15T22:50:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:46.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c0b04e0 0x7f371c152460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c15c080 0x7f371c147f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f371c16c200 con 0x7f371c0ae470 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f371c16c080 con 0x7f371c15c080 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3721a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f371c16c380 con 0x7f371c0b04e0 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53364/0 (socket says 172.21.15.31:53364) 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371b400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c15c080 0x7f371c147f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3712000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c0b04e0 0x7f371c152460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 -- 172.21.15.31:0/3000111552 learned_addr learned my addr 172.21.15.31:0/3000111552 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:46.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 -- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c0b04e0 msgr2=0x7f371c152460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c0b04e0 0x7f371c152460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 -- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c15c080 msgr2=0x7f371c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c15c080 0x7f371c147f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 -- 172.21.15.31:0/3000111552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c1543d0 con 0x7f371c0ae470 2024-09-15T22:50:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f371aa00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f370c001ec0 tx=0x7f370c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.293+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c017070 con 0x7f371c0ae470 2024-09-15T22:50:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f370c003600 con 0x7f371c0ae470 2024-09-15T22:50:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c151980 con 0x7f371c0ae470 2024-09-15T22:50:46.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f370c0039f0 con 0x7f371c0ae470 2024-09-15T22:50:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c151f40 con 0x7f371c0ae470 2024-09-15T22:50:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c151770 con 0x7f371c0ae470 2024-09-15T22:50:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f370c01a070 con 0x7f371c0ae470 2024-09-15T22:50:46.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3713400640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 0x7f36f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:46.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f370c0853c0 con 0x7f371c0ae470 2024-09-15T22:50:46.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.297+0000 7f3712000640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 0x7f36f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:46.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.301+0000 7f3712000640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 0x7f36f8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3704007fd0 tx=0x7f3704009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:46.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.301+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f370c0554d0 con 0x7f371c0ae470 2024-09-15T22:50:46.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.501+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f371c0d0910 con 0x7f371c0ae470 2024-09-15T22:50:46.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3713400640 1 -- 172.21.15.31:0/3000111552 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7f370c0597d0 con 0x7f371c0ae470 2024-09-15T22:50:46.509 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:46.509 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:50:46.509 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:50:46.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 msgr2=0x7f36f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 0x7f36f8069d80 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3704007fd0 tx=0x7f3704009040 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 msgr2=0x7f371c161470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f370c001ec0 tx=0x7f370c00c8e0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 shutdown_connections 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f36f80678c0 0x7f36f8069d80 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f371c15c080 0x7f371c147f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f371c0b04e0 0x7f371c152460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 --2- 172.21.15.31:0/3000111552 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f371c0ae470 0x7f371c161470 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:46.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 >> 172.21.15.31:0/3000111552 conn(0x7f371c06bcc0 msgr2=0x7f371c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:46.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 shutdown_connections 2024-09-15T22:50:46.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:46.505+0000 7f3721a00640 1 -- 172.21.15.31:0/3000111552 wait complete. 2024-09-15T22:50:46.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:50:16.436200+0000', 'modified': '2024-09-15T22:50:37.749651+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4281}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4281': {'gid': 4281, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6834/2632823405', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 2632823405}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 2632823405}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4281, 'qdb_cluster': [4281]} 2024-09-15T22:50:46.933 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:50:46.933 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-15T22:50:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 Processor -- start 2024-09-15T22:50:47.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 -- start start 2024-09-15T22:50:47.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6b7015c020 0x7f6b7006bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b700ae0b0 0x7f6b7006c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b700b3cf0 con 0x7f6b7015fca0 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7009ad20 con 0x7f6b700ae0b0 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b76c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6b7009aa40 con 0x7f6b7015c020 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b700ae0b0 0x7f6b7006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b700ae0b0 0x7f6b7006c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53376/0 (socket says 172.21.15.31:53376) 2024-09-15T22:50:47.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 -- 172.21.15.31:0/2425562892 learned_addr learned my addr 172.21.15.31:0/2425562892 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b75800640 1 --2- 172.21.15.31:0/2425562892 >> v2:172.21.15.102:3300/0 conn(0x7f6b7015c020 0x7f6b7006bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 -- 172.21.15.31:0/2425562892 >> v2:172.21.15.102:3300/0 conn(0x7f6b7015c020 msgr2=0x7f6b7006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 --2- 172.21.15.31:0/2425562892 >> v2:172.21.15.102:3300/0 conn(0x7f6b7015c020 0x7f6b7006bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 -- 172.21.15.31:0/2425562892 >> v1:172.21.15.102:6789/0 conn(0x7f6b7015fca0 legacy=0x7f6b70160110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.073+0000 7f6b74e00640 1 -- 172.21.15.31:0/2425562892 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b700b3730 con 0x7f6b700ae0b0 2024-09-15T22:50:47.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b74e00640 1 --2- 172.21.15.31:0/2425562892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b700ae0b0 0x7f6b7006c200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6b70073880 tx=0x7f6b5c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dc4fdea88e21e20 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b6fe00640 1 -- 172.21.15.31:0/2425562892 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0b0070 con 0x7f6b700ae0b0 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b6fe00640 1 -- 172.21.15.31:0/2425562892 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5c0ab600 con 0x7f6b700ae0b0 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b6fe00640 1 -- 172.21.15.31:0/2425562892 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0ab9d0 con 0x7f6b700ae0b0 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 -- 172.21.15.31:0/2425562892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b700ae0b0 msgr2=0x7f6b7006c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 --2- 172.21.15.31:0/2425562892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b700ae0b0 0x7f6b7006c200 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6b70073880 tx=0x7f6b5c01c490 comp rx=0 tx=0).stop 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 -- 172.21.15.31:0/2425562892 shutdown_connections 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 --2- 172.21.15.31:0/2425562892 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b700ae0b0 0x7f6b7006c200 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 --2- 172.21.15.31:0/2425562892 >> v2:172.21.15.102:3300/0 conn(0x7f6b7015c020 0x7f6b7006bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 -- 172.21.15.31:0/2425562892 >> 172.21.15.31:0/2425562892 conn(0x7f6b70073340 msgr2=0x7f6b700b2dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 -- 172.21.15.31:0/2425562892 shutdown_connections 2024-09-15T22:50:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.077+0000 7f6b76c00640 1 -- 172.21.15.31:0/2425562892 wait complete. 2024-09-15T22:50:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 Processor -- start 2024-09-15T22:50:47.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- start start 2024-09-15T22:50:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 0x7f6b7014eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 0x7f6b70153d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700b6560 con 0x7f6b7015fca0 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700b63e0 con 0x7f6b7015c020 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b70169620 con 0x7f6b700ae0b0 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b75800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 0x7f6b7014eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 0x7f6b70153d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b75800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 0x7f6b7014eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:58130/0 (socket says 172.21.15.31:58130) 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53378/0 (socket says 172.21.15.31:53378) 2024-09-15T22:50:47.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 0x7f6b70153d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:44044/0 (socket says 172.21.15.31:44044) 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b75800640 1 -- 172.21.15.31:0/1163957751 learned_addr learned my addr 172.21.15.31:0/1163957751 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 -- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 msgr2=0x7f6b7014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 0x7f6b7014eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 -- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 msgr2=0x7f6b70153d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 0x7f6b70153d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 -- 172.21.15.31:0/1163957751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b70159990 con 0x7f6b7015fca0 2024-09-15T22:50:47.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76200640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c700 tx=0x7f6b6800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b6d600640 1 -- 172.21.15.31:0/1163957751 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68003b80 con 0x7f6b7015fca0 2024-09-15T22:50:47.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b6d600640 1 -- 172.21.15.31:0/1163957751 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68003d20 con 0x7f6b7015fca0 2024-09-15T22:50:47.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b70159c70 con 0x7f6b7015fca0 2024-09-15T22:50:47.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b6d600640 1 -- 172.21.15.31:0/1163957751 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b68005310 con 0x7f6b7015fca0 2024-09-15T22:50:47.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.081+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7015a510 con 0x7f6b7015fca0 2024-09-15T22:50:47.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b6d600640 1 -- 172.21.15.31:0/1163957751 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b680054b0 con 0x7f6b7015fca0 2024-09-15T22:50:47.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b6d600640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 0x7f6b50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b6d600640 1 -- 172.21.15.31:0/1163957751 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b68085be0 con 0x7f6b7015fca0 2024-09-15T22:50:47.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b75800640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 0x7f6b50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 Processor -- start 2024-09-15T22:50:47.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 -- start start 2024-09-15T22:50:47.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b75800640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 0x7f6b50069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b701550c0 tx=0x7f6b64008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 0x5651b1790f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1791440 0x5651b1746d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651b162eb60 con 0x5651b1747290 2024-09-15T22:50:47.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5651b1595c70 con 0x5651b1790b20 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.085+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5651b153bed0 con 0x5651b1791440 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53388/0 (socket says 172.21.15.31:53388) 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 -- 172.21.15.31:0/3503169596 learned_addr learned my addr 172.21.15.31:0/3503169596 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b74e00640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1791440 0x5651b1746d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b75800640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 0x5651b1790f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 -- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1791440 msgr2=0x5651b1746d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1791440 0x5651b1746d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 -- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 msgr2=0x5651b1790f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 0x5651b1790f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 -- 172.21.15.31:0/3503169596 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b154de50 con 0x5651b1747290 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b75800640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 0x5651b1790f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b76200640 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800a430 tx=0x7f6b680557e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db367bfebf36c60f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b62000640 1 -- 172.21.15.31:0/3503169596 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680057a0 con 0x5651b1747290 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b62000640 1 -- 172.21.15.31:0/3503169596 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68054080 con 0x5651b1747290 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b62000640 1 -- 172.21.15.31:0/3503169596 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b680551d0 con 0x5651b1747290 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- 172.21.15.31:0/3503169596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 msgr2=0x5651b1747670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800a430 tx=0x7f6b680557e0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- 172.21.15.31:0/3503169596 shutdown_connections 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1747290 0x5651b1747670 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1791440 0x5651b1746d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/3503169596 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1790b20 0x5651b1790f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- 172.21.15.31:0/3503169596 >> 172.21.15.31:0/3503169596 conn(0x5651b174d600 msgr2=0x5651b1745630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- 172.21.15.31:0/3503169596 shutdown_connections 2024-09-15T22:50:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- 172.21.15.31:0/3503169596 wait complete. 2024-09-15T22:50:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- start start 2024-09-15T22:50:47.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 Processor -- start 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b174be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b174c390 0x5651b1752230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651b15f7b00 con 0x5651b1791440 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5651b1570360 con 0x5651b174c390 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5651b156d2d0 con 0x5651b1790b20 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b7b52f000 10 client.0 _ll_register_callbacks cb 0x5651b1732820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53404/0 (socket says 172.21.15.31:53404) 2024-09-15T22:50:47.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b74e00640 1 -- 172.21.15.31:0/534558554 learned_addr learned my addr 172.21.15.31:0/534558554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.089+0000 7f6b75800640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b174be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b76200640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b174c390 0x5651b1752230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 -- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 msgr2=0x5651b174be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b174be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 -- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b174c390 msgr2=0x5651b1752230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b174c390 0x5651b1752230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 -- 172.21.15.31:0/534558554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b153c120 con 0x5651b1791440 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b75800640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b174be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b74e00640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c01c4d0 tx=0x7f6b5c01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e96cec5e389418 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0bb070 con 0x5651b1791440 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b5c0abc80 con 0x5651b1791440 2024-09-15T22:50:47.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b68054080 con 0x5651b1791440 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f6b5c0c6050 con 0x5651b1791440 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 10 client.4656 fetch_fsmap learned FSMap version 8 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5651b1535450 con 0x5651b1791440 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b68054080 con 0x5651b1791440 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f6b5c0c9020 con 0x5651b1791440 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 10 client.4656 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 10 client.4656 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 20 client.4656 populate_metadata read hostname 'smithi031' 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b1797030 0x5651b1797410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 4 client.4656 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 --> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651b152fc00 con 0x5651b1797030 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b75800640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b1797030 0x5651b1797410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 10 client.4656 ms_handle_connect on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b75800640 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b1797030 0x5651b1797410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7da96ee486bac4b1 server_cookie=8835ed3477fac5f0 in_seq=0 out_seq=0 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 1 -- 172.21.15.31:0/534558554 <== mds.0 v2:172.21.15.31:6832/2632823405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651b152fc00 con 0x5651b1797030 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 10 client.4656 handle_command_reply: tid=0 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 client.4656 shutdown 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 msgr2=0x5651b1751cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c01c4d0 tx=0x7f6b5c01acd0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 shutdown_connections 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b1797030 0x5651b1797410 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b174c390 0x5651b1752230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1791440 0x5651b1751cf0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/534558554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b174be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b56a00640 0 client.4656 ms_handle_reset on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 >> 172.21.15.31:0/534558554 conn(0x5651b1747290 msgr2=0x5651b1745d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 shutdown_connections 2024-09-15T22:50:47.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 1 -- 172.21.15.31:0/534558554 wait complete. 2024-09-15T22:50:47.106 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.093+0000 7f6b7b52f000 20 client.4656 trim_cache size 0 max 16384 2024-09-15T22:50:47.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 Processor -- start 2024-09-15T22:50:47.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 -- start start 2024-09-15T22:50:47.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b17a76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b178ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b70204550 con 0x5651b174c390 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b700cfe70 con 0x5651b1791440 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b70203f00 con 0x5651b1790b20 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53420/0 (socket says 172.21.15.31:53420) 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 -- 172.21.15.31:0/1831847491 learned_addr learned my addr 172.21.15.31:0/1831847491 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b76200640 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b178ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b74e00640 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b17a76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 -- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 msgr2=0x5651b17a76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b17a76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 -- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 msgr2=0x5651b178ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b178ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.113+0000 7f6b75800640 1 -- 172.21.15.31:0/1831847491 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651b1791270 con 0x5651b174c390 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b75800640 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5651b151cb00 tx=0x7f6b64016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dbd257382d7a01a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b61600640 1 -- 172.21.15.31:0/1831847491 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b64030070 con 0x5651b174c390 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b61600640 1 -- 172.21.15.31:0/1831847491 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6401d040 con 0x5651b174c390 2024-09-15T22:50:47.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b61600640 1 -- 172.21.15.31:0/1831847491 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b6401c040 con 0x5651b174c390 2024-09-15T22:50:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/1831847491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 msgr2=0x5651b17a7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x5651b151cb00 tx=0x7f6b64016000 comp rx=0 tx=0).stop 2024-09-15T22:50:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/1831847491 shutdown_connections 2024-09-15T22:50:47.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b178ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b1790b20 0x5651b17a76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/1831847491 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b174c390 0x5651b17a7160 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/1831847491 >> 172.21.15.31:0/1831847491 conn(0x5651b1747290 msgr2=0x5651b174b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/1831847491 shutdown_connections 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/1831847491 wait complete. 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- start start 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 Processor -- start 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b174c390 0x5651b1800400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b179a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5651b1594f80 con 0x5651b1790b20 2024-09-15T22:50:47.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5651b154dca0 con 0x5651b1791440 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5651b159a2a0 con 0x5651b174c390 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 10 client.0 _ll_register_callbacks cb 0x7f6b5c0091c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53436/0 (socket says 172.21.15.31:53436) 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 -- 172.21.15.31:0/724903918 learned_addr learned my addr 172.21.15.31:0/724903918 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b75800640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b174c390 0x5651b1800400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b76200640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b179a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 -- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b174c390 msgr2=0x5651b1800400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b174c390 0x5651b1800400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 -- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 msgr2=0x5651b179a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b179a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 -- 172.21.15.31:0/724903918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651b151cfd0 con 0x5651b1790b20 2024-09-15T22:50:47.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b74e00640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0190a0 tx=0x7f6b5c0a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab754958948575d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b56a00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c0cf060 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6b5c0c08a0 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.117+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b6401d040 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f6b5c0bb040 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 10 client.4662 fetch_fsmap learned FSMap version 8 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x5651b1618750 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b6401d040 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 8) ==== 3510+0+0 (secure 0 0 0) 0x7f6b5c0d8020 con 0x5651b1790b20 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 10 client.4662 fetch_fsmap finished waiting for FSMap version 8 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 10 client.4662 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 20 client.4662 populate_metadata read hostname 'smithi031' 2024-09-15T22:50:47.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b180aa50 0x5651b179b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 4 client.4662 mds_command: new command op to 4281 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 --> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] -- command(tid 0: {"prefix": "status"}) -- 0x5651b15a33a0 con 0x5651b180aa50 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b75800640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b180aa50 0x5651b179b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b75800640 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b180aa50 0x5651b179b4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6694b3b9bf1f9ff server_cookie=6b0b9b67e1e2da1c in_seq=0 out_seq=0 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 10 client.4662 ms_handle_connect on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 1 -- 172.21.15.31:0/724903918 <== mds.0 v2:172.21.15.31:6832/2632823405 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5651b15a33a0 con 0x5651b180aa50 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 10 client.4662 handle_command_reply: tid=0 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 client.4662 shutdown 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 msgr2=0x5651b179a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c0190a0 tx=0x7f6b5c0a8000 comp rx=0 tx=0).stop 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 shutdown_connections 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:6832/2632823405,v1:172.21.15.31:6834/2632823405] conn(0x5651b180aa50 0x5651b179b4d0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5651b1791440 0x5651b179a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5651b1790b20 0x5651b179a470 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b56a00640 0 client.4662 ms_handle_reset on v2:172.21.15.31:6832/2632823405 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 --2- 172.21.15.31:0/724903918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5651b174c390 0x5651b1800400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 >> 172.21.15.31:0/724903918 conn(0x5651b1747290 msgr2=0x5651b17a6150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 shutdown_connections 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 1 -- 172.21.15.31:0/724903918 wait complete. 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b7b52f000 20 client.4662 trim_cache size 0 max 16384 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:50:47.132 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4281, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 30.089322578000001, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 8, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 25, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 25, 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 36.124069486000003 2024-09-15T22:50:47.133 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 msgr2=0x7f6b50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 0x7f6b50069d80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6b701550c0 tx=0x7f6b64008040 comp rx=0 tx=0).stop 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 msgr2=0x7f6b701573a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f6b6800c700 tx=0x7f6b6800cbc0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 shutdown_connections 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b500678c0 0x7f6b50069d80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b7015fca0 0x7f6b701573a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b7015c020 0x7f6b70153d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 --2- 172.21.15.31:0/1163957751 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b700ae0b0 0x7f6b7014eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 >> 172.21.15.31:0/1163957751 conn(0x7f6b70073340 msgr2=0x7f6b701653e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 shutdown_connections 2024-09-15T22:50:47.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:47.121+0000 7f6b76c00640 1 -- 172.21.15.31:0/1163957751 wait complete. 2024-09-15T22:50:47.146 INFO:teuthology.run_tasks:Running task sequential... 2024-09-15T22:50:47.157 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-15T22:50:47.157 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-15T22:50:47.158 INFO:teuthology.task.print:Enabling mgr modules 2024-09-15T22:50:47.158 INFO:teuthology.run_tasks:Running task kclient... 2024-09-15T22:50:47.229 INFO:tasks.kclient:Mounting kernel clients... 2024-09-15T22:50:47.230 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-15T22:50:47.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.230 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:50:47.240 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-15T22:50:47.241 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-15T22:50:47.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-15T22:50:47.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.783 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:50:47.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-15T22:50:47.862 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-15T22:50:47.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:50:47.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.865 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:50:47.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.875 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-15T22:50:47.941 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-15T22:50:47.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:50:47.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.943 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:50:47.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:47.998 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-15T22:50:48.061 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-15T22:50:48.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:50:48.064 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-15T22:50:48.064 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:50:48.064 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:50:48.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:50:48.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.205+0000 7fc7bb800640 1 Processor -- start 2024-09-15T22:50:48.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.205+0000 7fc7bb800640 1 -- start start 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.205+0000 7fc7bb800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc7b4158f30 0x7fc7b40cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7bb800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7bb800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7b40ce2f0 con 0x7fc7b415c350 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7bb800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b406f240 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7bb800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc7b40ce5d0 con 0x7fc7b4158f30 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53438/0 (socket says 172.21.15.31:53438) 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 -- 172.21.15.31:0/2728737682 learned_addr learned my addr 172.21.15.31:0/2728737682 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b8e00640 1 --2- 172.21.15.31:0/2728737682 >> v2:172.21.15.102:3300/0 conn(0x7fc7b4158f30 0x7fc7b40cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 -- 172.21.15.31:0/2728737682 >> v2:172.21.15.102:3300/0 conn(0x7fc7b4158f30 msgr2=0x7fc7b40cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 --2- 172.21.15.31:0/2728737682 >> v2:172.21.15.102:3300/0 conn(0x7fc7b4158f30 0x7fc7b40cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 -- 172.21.15.31:0/2728737682 >> v1:172.21.15.102:6789/0 conn(0x7fc7b415c350 legacy=0x7fc7b40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 -- 172.21.15.31:0/2728737682 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b40ce8b0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b9800640 1 --2- 172.21.15.31:0/2728737682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40d22f0 tx=0x7fc7ac01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=194573b55849ae8a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:48.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b3400640 1 -- 172.21.15.31:0/2728737682 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0a5710 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b3400640 1 -- 172.21.15.31:0/2728737682 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7ac0a58b0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.209+0000 7fc7b3400640 1 -- 172.21.15.31:0/2728737682 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7ac0a5c80 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- 172.21.15.31:0/2728737682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 msgr2=0x7fc7b406f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- 172.21.15.31:0/2728737682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc7b40d22f0 tx=0x7fc7ac01c9f0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- 172.21.15.31:0/2728737682 shutdown_connections 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- 172.21.15.31:0/2728737682 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b406f6d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- 172.21.15.31:0/2728737682 >> v2:172.21.15.102:3300/0 conn(0x7fc7b4158f30 0x7fc7b40cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- 172.21.15.31:0/2728737682 >> 172.21.15.31:0/2728737682 conn(0x7fc7b40b2f50 msgr2=0x7fc7b40b3360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- 172.21.15.31:0/2728737682 shutdown_connections 2024-09-15T22:50:48.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- 172.21.15.31:0/2728737682 wait complete. 2024-09-15T22:50:48.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 Processor -- start 2024-09-15T22:50:48.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- start start 2024-09-15T22:50:48.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 0x7fc7b4146a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 0x7fc7b40d1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b40707b0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc7b4070630 con 0x7fc7b4158f30 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7bb800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc7b4070930 con 0x7fc7b415c350 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53448/0 (socket says 172.21.15.31:53448) 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 -- 172.21.15.31:0/3945539286 learned_addr learned my addr 172.21.15.31:0/3945539286 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b3e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 0x7fc7b4146a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b9800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 0x7fc7b40d1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 -- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 msgr2=0x7fc7b40d1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 0x7fc7b40d1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 -- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 msgr2=0x7fc7b4146a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 0x7fc7b4146a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b8e00640 1 -- 172.21.15.31:0/3945539286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7b40b4b50 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b9800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 0x7fc7b40d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.213+0000 7fc7b3e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 0x7fc7b4146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b8e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e8a0 tx=0x7fc7a800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a8017070 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7a800c940 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a800ccf0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7b40b6520 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7b40b61d0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7b406f6d0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc7a801a070 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 0x7fc794069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:48.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc7a8085f20 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.217+0000 7fc7b3e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 0x7fc794069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:48.224 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.221+0000 7fc7b3e00640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 0x7fc794069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b414fed0 tx=0x7fc7a0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:48.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.221+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc7a8056710 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.425+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc7b40b66f0 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.425+0000 7fc7b0c00640 1 -- 172.21.15.31:0/3945539286 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fc7a8056010 con 0x7fc7b40cfcf0 2024-09-15T22:50:48.431 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:50:48.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 msgr2=0x7fc794069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 0x7fc794069d80 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc7b414fed0 tx=0x7fc7a0009040 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 msgr2=0x7fc7b40b4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc7a800e8a0 tx=0x7fc7a800eca0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 shutdown_connections 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc7940678c0 0x7fc794069d80 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc7b415c350 0x7fc7b40d1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc7b4158f30 0x7fc7b4146a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 --2- 172.21.15.31:0/3945539286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc7b40cfcf0 0x7fc7b40b4250 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 >> 172.21.15.31:0/3945539286 conn(0x7fc7b40b2f50 msgr2=0x7fc7b40cf340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 shutdown_connections 2024-09-15T22:50:48.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48.429+0000 7fc7bb800640 1 -- 172.21.15.31:0/3945539286 wait complete. 2024-09-15T22:50:48.456 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:50:48.456 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:50:48.456 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-15T22:50:48.456 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:50:48.457 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:50:48.457 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:50:48.457 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:50:48.457 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:50:48.457 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:50:48.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:48.457 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-15T22:50:48.481 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:48.482 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42424sec preferred_lft 42424sec 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:d8:cd:ab:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:50:48.483 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:48.484 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr flush dev ceph-brx 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set ceph-brx up 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:50:48.485 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:48.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:48.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:48.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:48.640 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:50:48.659 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-15T22:50:48.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:48.662 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:50:48.714 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:50:48.714 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:48.714 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:48.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:50:48.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:50:48.715 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:50:48.715 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:48.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:48.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:48.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:48.851 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:50:48.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:48.901 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-15T22:50:48.952 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:48.952 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:48.952 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:50:48.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-15T22:50:48.953 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:49.043 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:49.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:49.082 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-15T22:50:49.082 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-15T22:50:49.083 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:49.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:49.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:49.224 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:49.224 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:49.224 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-15T22:50:49.225 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:50:49.225 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:49.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:49.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:49 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:49.352 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:49.352 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:50:49.361 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:50:49.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:49.362 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:50:49.418 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:50:49.418 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:49.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:50:49.512 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:50:49.512 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:50:49.512 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:50:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:50:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:50.143 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:50.155 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:50:50.156 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:50:50.156 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:50:50.159 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:50:50.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:50.159 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:50:50.180 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:50.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:50.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:50.283 INFO:teuthology.orchestra.run.smithi031.stdout:client4671 2024-09-15T22:50:50.284 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:50:50.284 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:50.292 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:50.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:50.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:50.393 INFO:teuthology.orchestra.run.smithi031.stdout:client4671 2024-09-15T22:50:50.394 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:50.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:50.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:50.452 INFO:teuthology.orchestra.run.smithi031.stdout:client4671 2024-09-15T22:50:50.453 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e1487968-efb4-47ad-8070-6e7082115957.client4671/status') 2024-09-15T22:50:50.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:50.513 INFO:teuthology.orchestra.run.smithi031.stdout:instance: client.4671 (3)192.168.0.1:0/1535623390 2024-09-15T22:50:50.513 INFO:teuthology.orchestra.run.smithi031.stdout:blocklisted: false 2024-09-15T22:50:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2024-09-15T22:50:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2024-09-15T22:50:50.513 INFO:teuthology.orchestra.run.smithi031.stderr:69 bytes copied, 5.52e-05 s, 1.2 MB/s 2024-09-15T22:50:50.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:50.521 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2024-09-15T22:50:50.521 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:50:50.522 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:50:50.522 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:50:50.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.657+0000 7fbde0000640 1 Processor -- start 2024-09-15T22:50:50.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.657+0000 7fbde0000640 1 -- start start 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbde0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd80d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbde0000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbdd809b830 0x7fbdd80d07a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbde0000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd806e920 con 0x7fbdd806cdd0 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbde0000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd80b4d90 con 0x7fbdd809b830 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbde0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd80d1d20 con 0x7fbdd815e790 2024-09-15T22:50:50.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbdd809b830 0x7fbdd80d07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbdd809b830 0x7fbdd80d07a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53460/0 (socket says 172.21.15.31:53460) 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 -- 172.21.15.31:0/2684734152 learned_addr learned my addr 172.21.15.31:0/2684734152 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddd600640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd80d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 -- 172.21.15.31:0/2684734152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 msgr2=0x7fbdd80d0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd80d0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 -- 172.21.15.31:0/2684734152 >> v1:172.21.15.102:6789/0 conn(0x7fbdd806cdd0 legacy=0x7fbdd81621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 -- 172.21.15.31:0/2684734152 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd806eb90 con 0x7fbdd809b830 2024-09-15T22:50:50.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddd600640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd80d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.661+0000 7fbddcc00640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd80d07a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009870 tx=0x7fbdc401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7753f66a7619aa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbdd7e00640 1 -- 172.21.15.31:0/2684734152 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40b0070 con 0x7fbdd809b830 2024-09-15T22:50:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbdd7e00640 1 -- 172.21.15.31:0/2684734152 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40ab600 con 0x7fbdd809b830 2024-09-15T22:50:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbdd7e00640 1 -- 172.21.15.31:0/2684734152 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40ab9d0 con 0x7fbdd809b830 2024-09-15T22:50:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- 172.21.15.31:0/2684734152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 msgr2=0x7fbdd80d07a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd80d07a0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fbdc4009870 tx=0x7fbdc401c520 comp rx=0 tx=0).stop 2024-09-15T22:50:50.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- 172.21.15.31:0/2684734152 shutdown_connections 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd80d07a0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- 172.21.15.31:0/2684734152 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd80d0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- 172.21.15.31:0/2684734152 >> 172.21.15.31:0/2684734152 conn(0x7fbdd80b3ed0 msgr2=0x7fbdd80b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- 172.21.15.31:0/2684734152 shutdown_connections 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- 172.21.15.31:0/2684734152 wait complete. 2024-09-15T22:50:50.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 Processor -- start 2024-09-15T22:50:50.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- start start 2024-09-15T22:50:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 0x7fbdd81551b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd809f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd816b6c0 con 0x7fbdd809b830 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbdd816b540 con 0x7fbdd806cdd0 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbde0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd816b840 con 0x7fbdd815e790 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbddcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbddcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53466/0 (socket says 172.21.15.31:53466) 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.665+0000 7fbddcc00640 1 -- 172.21.15.31:0/2950462338 learned_addr learned my addr 172.21.15.31:0/2950462338 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:50.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdde000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd809f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 -- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 msgr2=0x7fbdd809f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddd600640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 0x7fbdd81551b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd809f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 -- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 msgr2=0x7fbdd81551b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 0x7fbdd81551b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 -- 172.21.15.31:0/2950462338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8160800 con 0x7fbdd809b830 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdde000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd809f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddd600640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 0x7fbdd81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbddcc00640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ae040 tx=0x7fbdc401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40b0040 con 0x7fbdd809b830 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc40bc070 con 0x7fbdd809b830 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdc40aa8e0 con 0x7fbdd809b830 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd8160ae0 con 0x7fbdd809b830 2024-09-15T22:50:50.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd81610a0 con 0x7fbdd809b830 2024-09-15T22:50:50.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd8162180 con 0x7fbdd809b830 2024-09-15T22:50:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdc40aaa80 con 0x7fbdd809b830 2024-09-15T22:50:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.669+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbdc41206c0 con 0x7fbdd809b830 2024-09-15T22:50:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.673+0000 7fbddd600640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:50.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.673+0000 7fbddd600640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 0x7fbdb8069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8071370 tx=0x7fbdcc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:50.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.673+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbdc4016110 con 0x7fbdd809b830 2024-09-15T22:50:50.881 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbdd80b1fe0 con 0x7fbdd809b830 2024-09-15T22:50:50.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbdd5600640 1 -- 172.21.15.31:0/2950462338 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fbdc40aad70 con 0x7fbdd809b830 2024-09-15T22:50:50.882 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 msgr2=0x7fbdb8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 0x7fbdb8069d80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8071370 tx=0x7fbdcc008040 comp rx=0 tx=0).stop 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 msgr2=0x7fbdd809ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fbdc40ae040 tx=0x7fbdc401ad60 comp rx=0 tx=0).stop 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 shutdown_connections 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbdb80678c0 0x7fbdb8069d80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdd815e790 0x7fbdd809f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdd809b830 0x7fbdd809ec40 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 --2- 172.21.15.31:0/2950462338 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdd806cdd0 0x7fbdd81551b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 >> 172.21.15.31:0/2950462338 conn(0x7fbdd80b3ed0 msgr2=0x7fbdd80b11c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 shutdown_connections 2024-09-15T22:50:50.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:50.877+0000 7fbde0000640 1 -- 172.21.15.31:0/2950462338 wait complete. 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:50:50.903 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:50:50.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:50.904 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-15T22:50:50.913 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:50.913 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:50.913 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:50.913 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:50:50.914 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42421sec preferred_lft 42421sec 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:d8:cd:ab:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.915 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run.smithi031.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link tentative 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:50.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:50.916 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:50:50.978 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-15T22:50:50.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:50.980 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-15T22:50:51.037 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-15T22:50:51.037 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:50:51.037 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:50:51.038 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:50:51.038 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:50:51.038 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:50:51.038 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:51.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:51.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:51.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.176 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:50:51.185 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:50:51.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.185 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list-id 2024-09-15T22:50:51.240 INFO:teuthology.orchestra.run.smithi031.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-15T22:50:51.241 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:51.241 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:51.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:50:51.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-15T22:50:51.241 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:51.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:51.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:51.373 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.374 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:51.395 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ca:18:0b:97:81:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:50:51.396 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:50:51.396 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.396 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c818:bff:fe97:8135/64 scope link 2024-09-15T22:50:51.396 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.397 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-15T22:50:51.460 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:51.460 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:51.460 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:51.460 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout:2: veth0@if10: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ca:18:0b:97:81:35 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c818:bff:fe97:8135/64 scope link 2024-09-15T22:50:51.461 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:51.462 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-15T22:50:51.462 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-15T22:50:51.463 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:51.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:51.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:51.648 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:51.648 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:50:51.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.1 up 2024-09-15T22:50:51.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:50:51.648 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:50:51.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:51.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:51.776 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:51.776 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-15T22:50:51.785 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-15T22:50:51.785 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:51.785 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:50:51.839 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:50:51.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.840 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:50:51.929 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:50:51.929 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:50:51.929 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:51.944 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:50:51.944 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:50:51.944 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:51.944 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:51.944 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:51.953 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:50:51.954 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:50:51.957 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:50:51.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:51.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-15T22:50:51.978 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:52.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:52.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:52.077 INFO:teuthology.orchestra.run.smithi031.stdout:client4680 2024-09-15T22:50:52.077 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:50:52.077 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:52.086 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:52.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:52.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:52.185 INFO:teuthology.orchestra.run.smithi031.stdout:client4680 2024-09-15T22:50:52.185 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:52.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:52.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:52.243 INFO:teuthology.orchestra.run.smithi031.stdout:client4680 2024-09-15T22:50:52.243 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e1487968-efb4-47ad-8070-6e7082115957.client4680/status') 2024-09-15T22:50:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:52.303 INFO:teuthology.orchestra.run.smithi031.stdout:instance: client.4680 (3)192.168.0.2:0/2011354943 2024-09-15T22:50:52.304 INFO:teuthology.orchestra.run.smithi031.stdout:blocklisted: false 2024-09-15T22:50:52.304 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records in 2024-09-15T22:50:52.304 INFO:teuthology.orchestra.run.smithi031.stderr:0+1 records out 2024-09-15T22:50:52.304 INFO:teuthology.orchestra.run.smithi031.stderr:69 bytes copied, 5.2837e-05 s, 1.3 MB/s 2024-09-15T22:50:52.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:52.312 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-15T22:50:52.312 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:50:52.312 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:50:52.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:50:52.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.493+0000 7f6da9000640 1 Processor -- start 2024-09-15T22:50:52.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 -- start start 2024-09-15T22:50:52.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6da4156810 0x7f6da4067c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415fb90 0x7f6da415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6da415d210 0x7f6da40b3be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6da4160b30 con 0x7f6da4156810 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6da4160020 con 0x7f6da415d210 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da9000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6da4160290 con 0x7f6da415fb90 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6da4156810 0x7f6da4067c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6da4156810 0x7f6da4067c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53472/0 (socket says 172.21.15.31:53472) 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 -- 172.21.15.31:0/167407096 learned_addr learned my addr 172.21.15.31:0/167407096 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6d9be00640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415fb90 0x7f6da415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3e00640 1 --2- 172.21.15.31:0/167407096 >> v2:172.21.15.102:3300/0 conn(0x7f6da415d210 0x7f6da40b3be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 -- 172.21.15.31:0/167407096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415fb90 msgr2=0x7f6da415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:52.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415fb90 0x7f6da415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 -- 172.21.15.31:0/167407096 >> v2:172.21.15.102:3300/0 conn(0x7f6da415d210 msgr2=0x7f6da40b3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:52.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 --2- 172.21.15.31:0/167407096 >> v2:172.21.15.102:3300/0 conn(0x7f6da415d210 0x7f6da40b3be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.497+0000 7f6da3400640 1 -- 172.21.15.31:0/167407096 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da4160570 con 0x7f6da4156810 2024-09-15T22:50:52.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da3400640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da4156810 0x7f6da4067c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6da4067b40 tx=0x7f6d9401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1478b42faf1cd55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:52.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da2a00640 1 -- 172.21.15.31:0/167407096 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d940b0070 con 0x7f6da4156810 2024-09-15T22:50:52.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da2a00640 1 -- 172.21.15.31:0/167407096 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d940ab600 con 0x7f6da4156810 2024-09-15T22:50:52.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da2a00640 1 -- 172.21.15.31:0/167407096 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d940ab9d0 con 0x7f6da4156810 2024-09-15T22:50:52.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- 172.21.15.31:0/167407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da4156810 msgr2=0x7f6da4067c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da4156810 0x7f6da4067c80 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f6da4067b40 tx=0x7f6d9401c520 comp rx=0 tx=0).stop 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- 172.21.15.31:0/167407096 shutdown_connections 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 --2- 172.21.15.31:0/167407096 >> v2:172.21.15.102:3300/0 conn(0x7f6da415d210 0x7f6da40b3be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415fb90 0x7f6da415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 --2- 172.21.15.31:0/167407096 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da4156810 0x7f6da4067c80 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- 172.21.15.31:0/167407096 >> 172.21.15.31:0/167407096 conn(0x7f6da40734e0 msgr2=0x7f6da406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- 172.21.15.31:0/167407096 shutdown_connections 2024-09-15T22:50:52.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- 172.21.15.31:0/167407096 wait complete. 2024-09-15T22:50:52.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 Processor -- start 2024-09-15T22:50:52.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.501+0000 7f6da9000640 1 -- start start 2024-09-15T22:50:52.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 0x7f6da41552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415d210 0x7f6da4151770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40cd950 con 0x7f6da415fb90 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6da40cd7d0 con 0x7f6da4156810 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6da40cdad0 con 0x7f6da415d210 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:53484/0 (socket says 172.21.15.31:53484) 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 -- 172.21.15.31:0/2051296860 learned_addr learned my addr 172.21.15.31:0/2051296860 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6d9be00640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415d210 0x7f6da4151770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3400640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 0x7f6da41552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 -- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415d210 msgr2=0x7f6da4151770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415d210 0x7f6da4151770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 -- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 msgr2=0x7f6da41552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 0x7f6da41552a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 -- 172.21.15.31:0/2051296860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6da40d07c0 con 0x7f6da415fb90 2024-09-15T22:50:52.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3400640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 0x7f6da41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:52.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da3e00640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00efc0 tx=0x7f6d9c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:52.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c018020 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d9c014480 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d9c014870 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6da41500b0 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6da4150670 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.505+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6da40b3be0 con 0x7f6da415fb90 2024-09-15T22:50:52.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.509+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6d9c01b020 con 0x7f6da415fb90 2024-09-15T22:50:52.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.509+0000 7f6d9b400640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 0x7f6d80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:52.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.509+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6d9c086df0 con 0x7f6da415fb90 2024-09-15T22:50:52.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.509+0000 7f6da3400640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 0x7f6d80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:52.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.509+0000 7f6da3400640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 0x7f6d80069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d940ad000 tx=0x7f6d94008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:52.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.513+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6d9c022030 con 0x7f6da415fb90 2024-09-15T22:50:52.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.713+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6da4067d30 con 0x7f6da415fb90 2024-09-15T22:50:52.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.713+0000 7f6d9b400640 1 -- 172.21.15.31:0/2051296860 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f6d9c010040 con 0x7f6da415fb90 2024-09-15T22:50:52.719 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:50:52.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 msgr2=0x7f6d80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 0x7f6d80069d80 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6d940ad000 tx=0x7f6d94008040 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 msgr2=0x7f6da40b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6d9c00efc0 tx=0x7f6d9c00c490 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 shutdown_connections 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6d800678c0 0x7f6d80069d80 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6da415fb90 0x7f6da40b0b70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6da415d210 0x7f6da4151770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 --2- 172.21.15.31:0/2051296860 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6da4156810 0x7f6da41552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 >> 172.21.15.31:0/2051296860 conn(0x7f6da40734e0 msgr2=0x7f6da4152570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 shutdown_connections 2024-09-15T22:50:52.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:52.717+0000 7f6da9000640 1 -- 172.21.15.31:0/2051296860 wait complete. 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:50:52.740 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:50:52.741 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:50:52.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:52.741 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-15T22:50:52.750 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:52.750 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:52.751 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42430sec preferred_lft 42430sec 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:73:92:18:d5 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:50:52.752 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:52.753 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-15T22:50:52.753 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:52.753 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:52.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add name ceph-brx type bridge 2024-09-15T22:50:52.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr flush dev ceph-brx 2024-09-15T22:50:52.753 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set ceph-brx up 2024-09-15T22:50:52.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-15T22:50:52.754 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:52.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:52.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:52.912 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:50:52.931 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-15T22:50:52.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:52.933 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T22:50:53.012 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:50:53.013 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:50:53.013 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:53.013 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:53.013 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:53.013 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:50:53.013 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:53.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:53.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:53.147 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:50:53.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:53.156 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-15T22:50:53.211 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:53.211 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:53.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:50:53.211 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-15T22:50:53.211 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:53.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:53.338 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-15T22:50:53.338 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:53.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:53.500 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:53.500 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:53.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.0 up 2024-09-15T22:50:53.500 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.0 master ceph-brx 2024-09-15T22:50:53.500 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:53.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:53.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:53.631 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:53.631 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-15T22:50:53.688 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-15T22:50:53.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:53.688 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:50:53.738 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:50:53.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:53.739 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:50:53.829 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:50:53.830 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:50:53.830 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:54.523 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:54.537 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-15T22:50:54.537 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-15T22:50:54.537 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:54.537 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:54.537 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:54.538 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:50:54.538 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:50:54.538 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:50:54.542 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:50:54.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:54.542 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-15T22:50:54.563 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:54.680 INFO:teuthology.orchestra.run.smithi102.stdout:client4666 2024-09-15T22:50:54.680 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:50:54.680 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:54.689 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:54.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:54.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:54.786 INFO:teuthology.orchestra.run.smithi102.stdout:client4666 2024-09-15T22:50:54.786 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:54.881 INFO:teuthology.orchestra.run.smithi102.stdout:client4666 2024-09-15T22:50:54.881 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e1487968-efb4-47ad-8070-6e7082115957.client4666/status') 2024-09-15T22:50:54.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:54.984 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4666 (3)192.168.0.1:0/3116975290 2024-09-15T22:50:54.984 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-09-15T22:50:54.984 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-09-15T22:50:54.984 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-09-15T22:50:54.985 INFO:teuthology.orchestra.run.smithi102.stderr:69 bytes copied, 4.8468e-05 s, 1.4 MB/s 2024-09-15T22:50:54.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:54.992 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2024-09-15T22:50:54.992 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-15T22:50:54.992 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:50:54.992 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:50:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.137+0000 7f2592c00640 1 Processor -- start 2024-09-15T22:50:55.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.137+0000 7f2592c00640 1 -- start start 2024-09-15T22:50:55.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f2592c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f258c0b47a0 0x7f258c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f2592c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258c072ad0 con 0x7f258c0726a0 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f2592c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258c072d40 con 0x7f258c06f270 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f2592c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f258c15ba60 con 0x7f258c0b47a0 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f258c0b47a0 0x7f258c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f258c0b47a0 0x7f258c072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43884/0 (socket says 172.21.15.31:43884) 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 -- 172.21.15.31:0/2423003566 learned_addr learned my addr 172.21.15.31:0/2423003566 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258be00640 1 --1- 172.21.15.31:0/2423003566 >> v1:172.21.15.102:6789/0 conn(0x7f258c06f270 0x7f258c06f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:46046/0 (socket says 172.21.15.31:46046) 2024-09-15T22:50:55.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f2590c00640 1 --1- 172.21.15.31:0/2423003566 >> v1:172.21.15.31:6789/0 conn(0x7f258c0726a0 0x7f258c15c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35572/0 (socket says 172.21.15.31:35572) 2024-09-15T22:50:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 -- 172.21.15.31:0/2423003566 >> v1:172.21.15.102:6789/0 conn(0x7f258c06f270 legacy=0x7f258c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 -- 172.21.15.31:0/2423003566 >> v1:172.21.15.31:6789/0 conn(0x7f258c0726a0 legacy=0x7f258c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.141+0000 7f258b400640 1 -- 172.21.15.31:0/2423003566 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c073020 con 0x7f258c0b47a0 2024-09-15T22:50:55.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f258b400640 1 --2- 172.21.15.31:0/2423003566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b47a0 0x7f258c072160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2578009870 tx=0x7f257801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bc54f9d5eeeeaf server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f258aa00640 1 -- 172.21.15.31:0/2423003566 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25780b0070 con 0x7f258c0b47a0 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f258aa00640 1 -- 172.21.15.31:0/2423003566 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780ab600 con 0x7f258c0b47a0 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f258aa00640 1 -- 172.21.15.31:0/2423003566 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25780ab9d0 con 0x7f258c0b47a0 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- 172.21.15.31:0/2423003566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b47a0 msgr2=0x7f258c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 --2- 172.21.15.31:0/2423003566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b47a0 0x7f258c072160 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2578009870 tx=0x7f257801c560 comp rx=0 tx=0).stop 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- 172.21.15.31:0/2423003566 shutdown_connections 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 --2- 172.21.15.31:0/2423003566 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0b47a0 0x7f258c072160 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- 172.21.15.31:0/2423003566 >> 172.21.15.31:0/2423003566 conn(0x7f258c067e00 msgr2=0x7f258c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- 172.21.15.31:0/2423003566 shutdown_connections 2024-09-15T22:50:55.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- 172.21.15.31:0/2423003566 wait complete. 2024-09-15T22:50:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 Processor -- start 2024-09-15T22:50:55.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.145+0000 7f2592c00640 1 -- start start 2024-09-15T22:50:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f258c06f270 0x7f258c0ac130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:55.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c0b47a0 0x7f258c165c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f258c0b4c30 con 0x7f258c0726a0 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f258c155a10 con 0x7f258c0b47a0 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f258c0a94a0 con 0x7f258c06f270 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43898/0 (socket says 172.21.15.31:43898) 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 -- 172.21.15.31:0/790883812 learned_addr learned my addr 172.21.15.31:0/790883812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2590c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c0b47a0 0x7f258c165c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258be00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f258c06f270 0x7f258c0ac130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 -- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f258c06f270 msgr2=0x7f258c0ac130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f258c06f270 0x7f258c0ac130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 -- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c0b47a0 msgr2=0x7f258c165c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c0b47a0 0x7f258c165c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 -- 172.21.15.31:0/790883812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c0ac9f0 con 0x7f258c0726a0 2024-09-15T22:50:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f258b400640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f25780ae040 tx=0x7f2578019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25780b0040 con 0x7f258c0726a0 2024-09-15T22:50:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25780b4640 con 0x7f258c0726a0 2024-09-15T22:50:55.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25780b4a30 con 0x7f258c0726a0 2024-09-15T22:50:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f258c0accd0 con 0x7f258c0726a0 2024-09-15T22:50:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f258c0ad290 con 0x7f258c0726a0 2024-09-15T22:50:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f258c0ad4d0 con 0x7f258c0726a0 2024-09-15T22:50:55.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.149+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25780ab4c0 con 0x7f258c0726a0 2024-09-15T22:50:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.153+0000 7f2583e00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 0x7f256c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.153+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f257811fc90 con 0x7f258c0726a0 2024-09-15T22:50:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.153+0000 7f258be00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 0x7f256c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:55.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.153+0000 7f258be00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 0x7f256c069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f257c000f70 tx=0x7f257c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:55.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.157+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2578016150 con 0x7f258c0726a0 2024-09-15T22:50:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f258c072140 con 0x7f258c0726a0 2024-09-15T22:50:55.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2583e00640 1 -- 172.21.15.31:0/790883812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7f25780f0480 con 0x7f258c0726a0 2024-09-15T22:50:55.362 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-15T22:50:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 msgr2=0x7f256c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 0x7f256c069db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f257c000f70 tx=0x7f257c009040 comp rx=0 tx=0).stop 2024-09-15T22:50:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 msgr2=0x7f258c151ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:55.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f25780ae040 tx=0x7f2578019300 comp rx=0 tx=0).stop 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 shutdown_connections 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f256c0678f0 0x7f256c069db0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f258c0b47a0 0x7f258c165c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f258c0726a0 0x7f258c151ef0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 --2- 172.21.15.31:0/790883812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f258c06f270 0x7f258c0ac130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.357+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 >> 172.21.15.31:0/790883812 conn(0x7f258c067e00 msgr2=0x7f258c15c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.361+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 shutdown_connections 2024-09-15T22:50:55.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:55.361+0000 7f2592c00640 1 -- 172.21.15.31:0/790883812 wait complete. 2024-09-15T22:50:55.385 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-15T22:50:55.385 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:50:55.385 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi102.front.sepia.ceph.com 2024-09-15T22:50:55.385 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-15T22:50:55.385 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-15T22:50:55.386 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-15T22:50:55.386 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-15T22:50:55.386 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:50:55.386 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:50:55.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.386 DEBUG:teuthology.orchestra.run.smithi102:> ip addr 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f0 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:d8:d9:dd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.395 INFO:teuthology.orchestra.run.smithi102.stdout: altname enp7s0f1 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:68 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0c:c4:7a:8f:d7:69 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.21.15.102/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft 42428sec preferred_lft 42428sec 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::ec4:7aff:fe8f:d769/64 scope link 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 02:42:73:92:18:d5 brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.396 INFO:teuthology.orchestra.run.smithi102.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:50:55.397 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.398 DEBUG:teuthology.orchestra.run.smithi102:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:50:55.456 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-15T22:50:55.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.458 DEBUG:teuthology.orchestra.run.smithi102:> route 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:Kernel IP routing table 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:55.510 INFO:teuthology.orchestra.run.smithi102.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:55.511 INFO:teuthology.orchestra.run.smithi102.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-09-15T22:50:55.511 INFO:teuthology.orchestra.run.smithi102.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-15T22:50:55.511 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:55.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:55.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:55.648 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.648 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:50:55.703 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:50:55.704 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.704 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list-id 2024-09-15T22:50:55.754 INFO:teuthology.orchestra.run.smithi102.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-15T22:50:55.755 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:55.755 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:55.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:50:55.755 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-15T22:50:55.755 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:55.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:55.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:55.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.881 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.901 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 06:fd:2f:d4:e6:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:50:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:50:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::4fd:2fff:fed4:e6f2/64 scope link 2024-09-15T22:50:55.902 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:55.903 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 ::1/128 scope host 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: link/ether 06:fd:2f:d4:e6:f2 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-15T22:50:55.966 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.967 INFO:teuthology.orchestra.run.smithi102.stdout: inet6 fe80::4fd:2fff:fed4:e6f2/64 scope link 2024-09-15T22:50:55.967 INFO:teuthology.orchestra.run.smithi102.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:50:55.968 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-15T22:50:55.968 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-15T22:50:55.969 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:56.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.147 DEBUG:teuthology.orchestra.run.smithi102:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:50:56.147 DEBUG:teuthology.orchestra.run.smithi102:> set -e 2024-09-15T22:50:56.147 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set brx.1 up 2024-09-15T22:50:56.148 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link set dev brx.1 master ceph-brx 2024-09-15T22:50:56.148 DEBUG:teuthology.orchestra.run.smithi102:> ') 2024-09-15T22:50:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:56.278 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-15T22:50:56.287 INFO:teuthology.orchestra.run.smithi102.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-15T22:50:56.288 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:50:56.288 DEBUG:teuthology.orchestra.run.smithi102:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:50:56.338 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:50:56.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:56.338 DEBUG:teuthology.orchestra.run.smithi102:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:50:56.430 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:50:56.431 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:50:56.431 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:56.445 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:56.446 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:invalid new device string format 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:50:56.456 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:50:56.457 INFO:teuthology.orchestra.run.smithi102.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:50:56.460 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:50:56.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:50:56.460 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-15T22:50:56.525 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:56.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.623 INFO:teuthology.orchestra.run.smithi102.stdout:client4565 2024-09-15T22:50:56.624 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:50:56.624 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:50:56.675 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:56.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.773 INFO:teuthology.orchestra.run.smithi102.stdout:client4565 2024-09-15T22:50:56.774 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:50:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:50:56.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.829 INFO:teuthology.orchestra.run.smithi102.stdout:client4565 2024-09-15T22:50:56.829 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/e1487968-efb4-47ad-8070-6e7082115957.client4565/status') 2024-09-15T22:50:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:50:56.887 INFO:teuthology.orchestra.run.smithi102.stdout:instance: client.4565 (3)192.168.0.2:0/896498311 2024-09-15T22:50:56.887 INFO:teuthology.orchestra.run.smithi102.stdout:blocklisted: false 2024-09-15T22:50:56.887 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records in 2024-09-15T22:50:56.887 INFO:teuthology.orchestra.run.smithi102.stderr:0+1 records out 2024-09-15T22:50:56.888 INFO:teuthology.orchestra.run.smithi102.stderr:68 bytes copied, 9.2963e-05 s, 731 kB/s 2024-09-15T22:50:56.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-15T22:50:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:50:56.895 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-15T22:50:57.021 INFO:tasks.cephfs_test_runner:Starting test: test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) The maximum number of openfiles omap objects keys are now equal to 2024-09-15T22:50:57.021 INFO:tasks.cephfs_test_runner:test_max_items_per_obj (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-09-15T22:50:57.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:50:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.169+0000 7fb585400640 1 Processor -- start 2024-09-15T22:50:57.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.169+0000 7fb585400640 1 -- start start 2024-09-15T22:50:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb585400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb580072160 0x7fb580072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb585400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 0x7fb58006e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb585400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb580072a80 con 0x7fb58013fa40 2024-09-15T22:50:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb585400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb58013f640 con 0x7fb580072160 2024-09-15T22:50:57.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb585400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb5801413c0 con 0x7fb58006e160 2024-09-15T22:50:57.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb580072160 0x7fb580072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb575e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb58013fa40 0x7fb58013fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35576/0 (socket says 172.21.15.31:35576) 2024-09-15T22:50:57.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb575e00640 1 -- 172.21.15.31:0/1339617771 learned_addr learned my addr 172.21.15.31:0/1339617771 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:57.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57e800640 1 -- 172.21.15.31:0/1339617771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 msgr2=0x7fb58006e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57f200640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 0x7fb58006e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57e800640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 0x7fb58006e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57de00640 1 -- 172.21.15.31:0/1339617771 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2732124572 0 0) 0x7fb580072a80 con 0x7fb58013fa40 2024-09-15T22:50:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57e800640 1 -- 172.21.15.31:0/1339617771 >> v1:172.21.15.31:6789/0 conn(0x7fb58013fa40 legacy=0x7fb58013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57e800640 1 -- 172.21.15.31:0/1339617771 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5801407b0 con 0x7fb580072160 2024-09-15T22:50:57.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.173+0000 7fb57f200640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 0x7fb58006e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:57.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb57e800640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580072540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097c0 tx=0x7fb57001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cde78012fe36c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb57de00640 1 -- 172.21.15.31:0/1339617771 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700b0070 con 0x7fb580072160 2024-09-15T22:50:57.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb57de00640 1 -- 172.21.15.31:0/1339617771 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5700ab600 con 0x7fb580072160 2024-09-15T22:50:57.181 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb57de00640 1 -- 172.21.15.31:0/1339617771 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5700ab9d0 con 0x7fb580072160 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- 172.21.15.31:0/1339617771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 msgr2=0x7fb580072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580072540 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb5700097c0 tx=0x7fb57001c410 comp rx=0 tx=0).stop 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- 172.21.15.31:0/1339617771 shutdown_connections 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58006e160 0x7fb58006e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 --2- 172.21.15.31:0/1339617771 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580072540 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- 172.21.15.31:0/1339617771 >> 172.21.15.31:0/1339617771 conn(0x7fb580067e00 msgr2=0x7fb58006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- 172.21.15.31:0/1339617771 shutdown_connections 2024-09-15T22:50:57.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- 172.21.15.31:0/1339617771 wait complete. 2024-09-15T22:50:57.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 Processor -- start 2024-09-15T22:50:57.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.177+0000 7fb585400640 1 -- start start 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb58006e160 0x7fb5800afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 0x7fb580156650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb580168ee0 con 0x7fb580072160 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb580168d60 con 0x7fb58006e160 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb580169060 con 0x7fb58013fa40 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43918/0 (socket says 172.21.15.31:43918) 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 -- 172.21.15.31:0/4248546142 learned_addr learned my addr 172.21.15.31:0/4248546142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb57e800640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb58006e160 0x7fb5800afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb57f200640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 0x7fb580156650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 -- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 msgr2=0x7fb580156650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 0x7fb580156650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 -- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb58006e160 msgr2=0x7fb5800afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb58006e160 0x7fb5800afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 -- 172.21.15.31:0/4248546142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb58013ec80 con 0x7fb580072160 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb57f200640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 0x7fb580156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb575e00640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c4b0 tx=0x7fb56800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568018070 con 0x7fb580072160 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb568007500 con 0x7fb580072160 2024-09-15T22:50:57.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb568004a30 con 0x7fb580072160 2024-09-15T22:50:57.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb580156b90 con 0x7fb580072160 2024-09-15T22:50:57.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb580160020 con 0x7fb580072160 2024-09-15T22:50:57.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb580160260 con 0x7fb580072160 2024-09-15T22:50:57.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.181+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb568004bd0 con 0x7fb580072160 2024-09-15T22:50:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.185+0000 7fb577400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 0x7fb55c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.185+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb568085170 con 0x7fb580072160 2024-09-15T22:50:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.185+0000 7fb57e800640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 0x7fb55c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.185+0000 7fb57e800640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 0x7fb55c069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5700ad000 tx=0x7fb5700a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.189+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb580160260 con 0x7fb580072160 2024-09-15T22:50:57.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.353+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb58006e570 con 0x7fb580072160 2024-09-15T22:50:57.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb577400640 1 -- 172.21.15.31:0/4248546142 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18562 (secure 0 0 0) 0x7fb568055310 con 0x7fb580072160 2024-09-15T22:50:57.361 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:50:57.361 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":25,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:21.710206+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:50:57.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 msgr2=0x7fb55c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 0x7fb55c069d80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5700ad000 tx=0x7fb5700a6000 comp rx=0 tx=0).stop 2024-09-15T22:50:57.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 msgr2=0x7fb580166710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb56800c4b0 tx=0x7fb56800c970 comp rx=0 tx=0).stop 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 shutdown_connections 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb55c0678c0 0x7fb55c069d80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb58013fa40 0x7fb580156650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb580072160 0x7fb580166710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 --2- 172.21.15.31:0/4248546142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb58006e160 0x7fb5800afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 >> 172.21.15.31:0/4248546142 conn(0x7fb580067e00 msgr2=0x7fb580158df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 shutdown_connections 2024-09-15T22:50:57.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.357+0000 7fb585400640 1 -- 172.21.15.31:0/4248546142 wait complete. 2024-09-15T22:50:57.385 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:50:05.613279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-15T22:50:14.449269+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-15T22:50:15.442279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-15T22:50:19.335121+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-15T22:50:57.385 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:50:57.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 Processor -- start 2024-09-15T22:50:57.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 -- start start 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f99880d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998815f1a0 con 0x7f99881522d0 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99880ce310 con 0x7f99880d05b0 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.525+0000 7f998f400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f99880d0a20 con 0x7f998815ed40 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f998ca00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f99881522d0 0x7f99880b4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35580/0 (socket says 172.21.15.31:35580) 2024-09-15T22:50:57.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f998ca00640 1 -- 172.21.15.31:0/2155069549 learned_addr learned my addr 172.21.15.31:0/2155069549 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f99880d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328947549 0 0) 0x7f9978001120 con 0x7f99881522d0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996c003530 con 0x7f99881522d0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1544528486 0 0) 0x7f996c003530 con 0x7f99881522d0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 msgr2=0x7f99880d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f99880d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 >> v1:172.21.15.102:6789/0 conn(0x7f99880d05b0 legacy=0x7f998815baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99880ce5f0 con 0x7f99881522d0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f9978001850 con 0x7f99881522d0 2024-09-15T22:50:57.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 >> v1:172.21.15.31:6789/0 conn(0x7f99881522d0 legacy=0x7f99880b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f996c0039f0 0x7f996c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f996c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f996c0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99880d0a20 con 0x7f996c0039f0 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f996c00ba00 con 0x7f996c0043a0 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f996c00bc00 con 0x7f998815ed40 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f998ca00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f996c0039f0 0x7f996c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f996c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f998d400640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f996c0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 -- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 msgr2=0x7f996c0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f998815ed40 0x7f996c0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 -- 172.21.15.31:0/2155069549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f996c0039f0 msgr2=0x7f996c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f996c0039f0 0x7f996c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.529+0000 7f997fe00640 1 -- 172.21.15.31:0/2155069549 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f996c003530 con 0x7f996c0043a0 2024-09-15T22:50:57.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f997fe00640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f996c004870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9970009ae0 tx=0x7f997001ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08ba9049fdf7ecb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700096b0 con 0x7f996c0043a0 2024-09-15T22:50:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99700a9450 con 0x7f996c0043a0 2024-09-15T22:50:57.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f9987e00640 1 -- 172.21.15.31:0/2155069549 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99700a9840 con 0x7f996c0043a0 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 msgr2=0x7f996c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 --2- 172.21.15.31:0/2155069549 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f996c004870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9970009ae0 tx=0x7f997001ca70 comp rx=0 tx=0).stop 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998d400640 1 -- 172.21.15.31:0/2155069549 reap_dead start 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- 172.21.15.31:0/2155069549 shutdown_connections 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- 172.21.15.31:0/2155069549 >> 172.21.15.31:0/2155069549 conn(0x7f998806be90 msgr2=0x7f998806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- 172.21.15.31:0/2155069549 shutdown_connections 2024-09-15T22:50:57.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- 172.21.15.31:0/2155069549 wait complete. 2024-09-15T22:50:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 Processor -- start 2024-09-15T22:50:57.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.533+0000 7f998f400640 1 -- start start 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f9988151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880aeb40 0x7f9988160bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 0x7f99881610f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99880b3230 con 0x7f99880aefc0 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f99880cdfe0 con 0x7f996c0043a0 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f99880b33b0 con 0x7f99880aeb40 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 0x7f99881610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 0x7f99881610f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43936/0 (socket says 172.21.15.31:43936) 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998d400640 1 -- 172.21.15.31:0/1316818515 learned_addr learned my addr 172.21.15.31:0/1316818515 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f9988151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f997fe00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880aeb40 0x7f9988160bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 -- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880aeb40 msgr2=0x7f9988160bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880aeb40 0x7f9988160bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 -- 172.21.15.31:0/1316818515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 msgr2=0x7f99881610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 0x7f99881610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 -- 172.21.15.31:0/1316818515 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f998806ffd0 con 0x7f996c0043a0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998ca00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f9988151680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9978004e20 tx=0x7f9978007430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800f7b0 con 0x7f996c0043a0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9978018070 con 0x7f996c0043a0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99881508c0 con 0x7f996c0043a0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f997800fb70 con 0x7f996c0043a0 2024-09-15T22:50:57.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9988150e80 con 0x7f996c0043a0 2024-09-15T22:50:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99880cfc90 con 0x7f996c0043a0 2024-09-15T22:50:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.537+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f997800fd10 con 0x7f996c0043a0 2024-09-15T22:50:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.541+0000 7f9985600640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 0x7f9964069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.541+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9978085e00 con 0x7f996c0043a0 2024-09-15T22:50:57.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.541+0000 7f997fe00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 0x7f9964069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.541+0000 7f997fe00640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 0x7f9964069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99700ae000 tx=0x7f99700046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.545+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f998815f1a0 con 0x7f996c0043a0 2024-09-15T22:50:57.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f998806ced0 con 0x7f996c0043a0 2024-09-15T22:50:57.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f9985600640 1 -- 172.21.15.31:0/1316818515 <== mon.1 v2:172.21.15.102:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f9978055f10 con 0x7f996c0043a0 2024-09-15T22:50:57.717 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-15T22:50:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 msgr2=0x7f9964069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 0x7f9964069d80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f99700ae000 tx=0x7f99700046d0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 msgr2=0x7f9988151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f9988151680 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f9978004e20 tx=0x7f9978007430 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 shutdown_connections 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99640678c0 0x7f9964069d80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f99880aefc0 0x7f99881610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f99880aeb40 0x7f9988160bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 --2- 172.21.15.31:0/1316818515 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f996c0043a0 0x7f9988151680 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 >> 172.21.15.31:0/1316818515 conn(0x7f998806be90 msgr2=0x7f99880b4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 shutdown_connections 2024-09-15T22:50:57.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.713+0000 7f998f400640 1 -- 172.21.15.31:0/1316818515 wait complete. 2024-09-15T22:50:57.739 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-15T22:50:57.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 Processor -- start 2024-09-15T22:50:57.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 -- start start 2024-09-15T22:50:57.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f7009bb10 0x7f4f7009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f7009af80 0x7f4f700ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f700b1b60 con 0x7f4f700b1780 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4f7009b3f0 con 0x7f4f7009bb10 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f75800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4f701601a0 con 0x7f4f7009af80 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f7009bb10 0x7f4f7009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f7009bb10 0x7f4f7009aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43942/0 (socket says 172.21.15.31:43942) 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 -- 172.21.15.31:0/1637899098 learned_addr learned my addr 172.21.15.31:0/1637899098 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:57.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6f400640 1 --2- 172.21.15.31:0/1637899098 >> v2:172.21.15.102:3300/0 conn(0x7f4f7009af80 0x7f4f700ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 -- 172.21.15.31:0/1637899098 >> v2:172.21.15.102:3300/0 conn(0x7f4f7009af80 msgr2=0x7f4f700ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:57.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 --2- 172.21.15.31:0/1637899098 >> v2:172.21.15.102:3300/0 conn(0x7f4f7009af80 0x7f4f700ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 -- 172.21.15.31:0/1637899098 >> v1:172.21.15.102:6789/0 conn(0x7f4f700b1780 legacy=0x7f4f70071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.885+0000 7f4f6e000640 1 -- 172.21.15.31:0/1637899098 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f70160440 con 0x7f4f7009bb10 2024-09-15T22:50:57.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f6e000640 1 --2- 172.21.15.31:0/1637899098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009bb10 0x7f4f7009aa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f700c9360 tx=0x7f4f5c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e755057363c2a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f6d600640 1 -- 172.21.15.31:0/1637899098 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0ab610 con 0x7f4f7009bb10 2024-09-15T22:50:57.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f6d600640 1 -- 172.21.15.31:0/1637899098 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0b0070 con 0x7f4f7009bb10 2024-09-15T22:50:57.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f6d600640 1 -- 172.21.15.31:0/1637899098 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c0ab9d0 con 0x7f4f7009bb10 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 -- 172.21.15.31:0/1637899098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009bb10 msgr2=0x7f4f7009aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 --2- 172.21.15.31:0/1637899098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009bb10 0x7f4f7009aa40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4f700c9360 tx=0x7f4f5c01c490 comp rx=0 tx=0).stop 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 -- 172.21.15.31:0/1637899098 shutdown_connections 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 --2- 172.21.15.31:0/1637899098 >> v2:172.21.15.102:3300/0 conn(0x7f4f7009af80 0x7f4f700ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 --2- 172.21.15.31:0/1637899098 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009bb10 0x7f4f7009aa40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 -- 172.21.15.31:0/1637899098 >> 172.21.15.31:0/1637899098 conn(0x7f4f700b3df0 msgr2=0x7f4f700b4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:57.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 -- 172.21.15.31:0/1637899098 shutdown_connections 2024-09-15T22:50:57.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.889+0000 7f4f75800640 1 -- 172.21.15.31:0/1637899098 wait complete. 2024-09-15T22:50:57.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 Processor -- start 2024-09-15T22:50:57.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- start start 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 0x7f4f700708f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 0x7f4f700b2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700cdb40 con 0x7f4f7009af80 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f700cd9c0 con 0x7f4f7009bb10 2024-09-15T22:50:57.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4f700cdcc0 con 0x7f4f700b1780 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43954/0 (socket says 172.21.15.31:43954) 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 -- 172.21.15.31:0/335079739 learned_addr learned my addr 172.21.15.31:0/335079739 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6e000640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 0x7f4f700708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6f400640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 0x7f4f700b2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 -- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 msgr2=0x7f4f700b2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 0x7f4f700b2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 -- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 msgr2=0x7f4f700708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 0x7f4f700708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 -- 172.21.15.31:0/335079739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7015d120 con 0x7f4f7009af80 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6e000640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 0x7f4f700708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:57.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6f400640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 0x7f4f700b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f6ea00640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c390 tx=0x7f4f6000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60017070 con 0x7f4f7009af80 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600052f0 con 0x7f4f7009af80 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7015d400 con 0x7f4f7009af80 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f60003840 con 0x7f4f7009af80 2024-09-15T22:50:57.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7015d9c0 con 0x7f4f7009af80 2024-09-15T22:50:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.893+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f700ccc70 con 0x7f4f7009af80 2024-09-15T22:50:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.897+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f6001a070 con 0x7f4f7009af80 2024-09-15T22:50:57.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.897+0000 7f4f66a00640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 0x7f4f50069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.897+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f600853c0 con 0x7f4f7009af80 2024-09-15T22:50:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.897+0000 7f4f6e000640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 0x7f4f50069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:57.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.897+0000 7f4f6e000640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 0x7f4f50069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0af000 tx=0x7f4f5c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:57.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:57.901+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f60055b20 con 0x7f4f7009af80 2024-09-15T22:50:58.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f700b4ac0 con 0x7f4f7009af80 2024-09-15T22:50:58.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f66a00640 1 -- 172.21.15.31:0/335079739 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f4f60055420 con 0x7f4f7009af80 2024-09-15T22:50:58.070 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-09-15T22:50:58.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 msgr2=0x7f4f50069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 0x7f4f50069d80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c0af000 tx=0x7f4f5c008040 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 msgr2=0x7f4f7015ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.065+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c390 tx=0x7f4f6000c850 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 shutdown_connections 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f500678c0 0x7f4f50069d80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f700b1780 0x7f4f700b2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f7009bb10 0x7f4f700708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 --2- 172.21.15.31:0/335079739 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f7009af80 0x7f4f7015ca50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 >> 172.21.15.31:0/335079739 conn(0x7f4f700b3df0 msgr2=0x7f4f700af0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 shutdown_connections 2024-09-15T22:50:58.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.069+0000 7f4f75800640 1 -- 172.21.15.31:0/335079739 wait complete. 2024-09-15T22:50:58.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-15T22:50:58.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.229+0000 7f8e72c00640 1 Processor -- start 2024-09-15T22:50:58.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.229+0000 7f8e72c00640 1 -- start start 2024-09-15T22:50:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f8e6c071b60 0x7f8e6c071f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e6c0cfef0 con 0x7f8e6c071780 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6c0d01d0 con 0x7f8e6c0b5760 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f8e6c0d04b0 con 0x7f8e6c071b60 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43960/0 (socket says 172.21.15.31:43960) 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 -- 172.21.15.31:0/87061459 learned_addr learned my addr 172.21.15.31:0/87061459 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e72200640 1 --2- 172.21.15.31:0/87061459 >> v2:172.21.15.102:3300/0 conn(0x7f8e6c071b60 0x7f8e6c071f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 -- 172.21.15.31:0/87061459 >> v2:172.21.15.102:3300/0 conn(0x7f8e6c071b60 msgr2=0x7f8e6c071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 --2- 172.21.15.31:0/87061459 >> v2:172.21.15.102:3300/0 conn(0x7f8e6c071b60 0x7f8e6c071f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 -- 172.21.15.31:0/87061459 >> v1:172.21.15.102:6789/0 conn(0x7f8e6c071780 legacy=0x7f8e6c0d0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.233+0000 7f8e70e00640 1 -- 172.21.15.31:0/87061459 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c0d0790 con 0x7f8e6c0b5760 2024-09-15T22:50:58.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e70e00640 1 --2- 172.21.15.31:0/87061459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c071030 tx=0x7f8e5801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e3ce30d05cb0214 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e6be00640 1 -- 172.21.15.31:0/87061459 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580b0070 con 0x7f8e6c0b5760 2024-09-15T22:50:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e6be00640 1 -- 172.21.15.31:0/87061459 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e580ab600 con 0x7f8e6c0b5760 2024-09-15T22:50:58.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e6be00640 1 -- 172.21.15.31:0/87061459 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580ab9d0 con 0x7f8e6c0b5760 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- 172.21.15.31:0/87061459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c0b5760 msgr2=0x7f8e6c0b79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 --2- 172.21.15.31:0/87061459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f8e6c071030 tx=0x7f8e5801c520 comp rx=0 tx=0).stop 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- 172.21.15.31:0/87061459 shutdown_connections 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 --2- 172.21.15.31:0/87061459 >> v2:172.21.15.102:3300/0 conn(0x7f8e6c071b60 0x7f8e6c071f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 --2- 172.21.15.31:0/87061459 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c0b5760 0x7f8e6c0b79e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- 172.21.15.31:0/87061459 >> 172.21.15.31:0/87061459 conn(0x7f8e6c06ff90 msgr2=0x7f8e6c0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- 172.21.15.31:0/87061459 shutdown_connections 2024-09-15T22:50:58.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- 172.21.15.31:0/87061459 wait complete. 2024-09-15T22:50:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 Processor -- start 2024-09-15T22:50:58.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.237+0000 7f8e72c00640 1 -- start start 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e6c071780 0x7f8e6c1479f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 0x7f8e6c06d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c168bf0 con 0x7f8e6c071b60 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c15cfe0 con 0x7f8e6c071780 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c168d70 con 0x7f8e6c0b5760 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43970/0 (socket says 172.21.15.31:43970) 2024-09-15T22:50:58.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 -- 172.21.15.31:0/2625108622 learned_addr learned my addr 172.21.15.31:0/2625108622 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e71800640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e6c071780 0x7f8e6c1479f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72200640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 0x7f8e6c06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 -- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 msgr2=0x7f8e6c06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 0x7f8e6c06d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 -- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e6c071780 msgr2=0x7f8e6c1479f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e6c071780 0x7f8e6c1479f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 -- 172.21.15.31:0/2625108622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c149b70 con 0x7f8e6c071b60 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72200640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 0x7f8e6c06d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e70e00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ae040 tx=0x7f8e580192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580b8020 con 0x7f8e6c071b60 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e580b4410 con 0x7f8e6c071b60 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c149e50 con 0x7f8e6c071b60 2024-09-15T22:50:58.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e580b0040 con 0x7f8e6c071b60 2024-09-15T22:50:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c157cc0 con 0x7f8e6c071b60 2024-09-15T22:50:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c071f60 con 0x7f8e6c071b60 2024-09-15T22:50:58.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.241+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e580bb020 con 0x7f8e6c071b60 2024-09-15T22:50:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.245+0000 7f8e69600640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 0x7f8e4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.245+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e5811f6b0 con 0x7f8e6c071b60 2024-09-15T22:50:58.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.245+0000 7f8e71800640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 0x7f8e4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.245+0000 7f8e71800640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 0x7f8e4c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e60001770 tx=0x7f8e60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.249+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e580c2070 con 0x7f8e6c071b60 2024-09-15T22:50:58.421 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.417+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e6c147570 con 0x7f8e6c071b60 2024-09-15T22:50:58.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.421+0000 7f8e69600640 1 -- 172.21.15.31:0/2625108622 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f8e58016110 con 0x7f8e6c071b60 2024-09-15T22:50:58.432 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 64 2024-09-15T22:50:58.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 msgr2=0x7f8e4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 0x7f8e4c069d80 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8e60001770 tx=0x7f8e60009040 comp rx=0 tx=0).stop 2024-09-15T22:50:58.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 msgr2=0x7f8e6c06ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8e580ae040 tx=0x7f8e580192c0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 shutdown_connections 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e4c0678c0 0x7f8e4c069d80 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e6c0b5760 0x7f8e6c06d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e6c071b60 0x7f8e6c06ce00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 --2- 172.21.15.31:0/2625108622 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e6c071780 0x7f8e6c1479f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 >> 172.21.15.31:0/2625108622 conn(0x7f8e6c06ff90 msgr2=0x7f8e6c159d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 shutdown_connections 2024-09-15T22:50:58.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.429+0000 7f8e72c00640 1 -- 172.21.15.31:0/2625108622 wait complete. 2024-09-15T22:50:58.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-15T22:50:58.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 Processor -- start 2024-09-15T22:50:58.599 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 -- start start 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 0x7fc44015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4400b4ba0 0x7fc4400d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4400ce310 con 0x7fc4400d05b0 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc4401526b0 con 0x7fc4400b4ba0 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc447800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400ce5f0 con 0x7fc4401522d0 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc43fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4400b4ba0 0x7fc4400d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc43fe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4400b4ba0 0x7fc4400d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43976/0 (socket says 172.21.15.31:43976) 2024-09-15T22:50:58.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc445800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc4400d05b0 0x7fc44015baa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35588/0 (socket says 172.21.15.31:35588) 2024-09-15T22:50:58.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.593+0000 7fc43fe00640 1 -- 172.21.15.31:0/1744732760 learned_addr learned my addr 172.21.15.31:0/1744732760 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:58.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc444e00640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 0x7fc44015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43fe00640 1 -- 172.21.15.31:0/1744732760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 msgr2=0x7fc44015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:58.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43fe00640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 0x7fc44015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43fe00640 1 -- 172.21.15.31:0/1744732760 >> v1:172.21.15.31:6789/0 conn(0x7fc4400d05b0 legacy=0x7fc44015baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43fe00640 1 -- 172.21.15.31:0/1744732760 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4400ce8d0 con 0x7fc4400b4ba0 2024-09-15T22:50:58.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc444e00640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 0x7fc44015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:58.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43fe00640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400b4ba0 0x7fc4400d0070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009870 tx=0x7fc42c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdd13ae18fb7235 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43f400640 1 -- 172.21.15.31:0/1744732760 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0ab650 con 0x7fc4400b4ba0 2024-09-15T22:50:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43f400640 1 -- 172.21.15.31:0/1744732760 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc42c0b0070 con 0x7fc4400b4ba0 2024-09-15T22:50:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc43f400640 1 -- 172.21.15.31:0/1744732760 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc42c0aba10 con 0x7fc4400b4ba0 2024-09-15T22:50:58.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc447800640 1 -- 172.21.15.31:0/1744732760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400b4ba0 msgr2=0x7fc4400d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc447800640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400b4ba0 0x7fc4400d0070 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc42c009870 tx=0x7fc42c01c560 comp rx=0 tx=0).stop 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.597+0000 7fc447800640 1 -- 172.21.15.31:0/1744732760 shutdown_connections 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4400b4ba0 0x7fc4400d0070 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 --2- 172.21.15.31:0/1744732760 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4401522d0 0x7fc44015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- 172.21.15.31:0/1744732760 >> 172.21.15.31:0/1744732760 conn(0x7fc44006be90 msgr2=0x7fc44006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- 172.21.15.31:0/1744732760 shutdown_connections 2024-09-15T22:50:58.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- 172.21.15.31:0/1744732760 wait complete. 2024-09-15T22:50:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 Processor -- start 2024-09-15T22:50:58.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- start start 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 0x7fc44015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 0x7fc44014ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400b3230 con 0x7fc4401522d0 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4400b5000 con 0x7fc4400b4ba0 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4400b33b0 con 0x7fc4400d05b0 2024-09-15T22:50:58.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43978/0 (socket says 172.21.15.31:43978) 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 -- 172.21.15.31:0/4240834236 learned_addr learned my addr 172.21.15.31:0/4240834236 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc444e00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 0x7fc44015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 -- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 msgr2=0x7fc44014ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc43fe00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 0x7fc44014ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 0x7fc44014ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 -- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 msgr2=0x7fc44015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 0x7fc44015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 -- 172.21.15.31:0/4240834236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44014d370 con 0x7fc4401522d0 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc444e00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 0x7fc44015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc43fe00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 0x7fc44014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc445800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c700 tx=0x7fc43800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc438017070 con 0x7fc4401522d0 2024-09-15T22:50:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc43800ce10 con 0x7fc4401522d0 2024-09-15T22:50:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc43800a840 con 0x7fc4401522d0 2024-09-15T22:50:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4400afcc0 con 0x7fc4401522d0 2024-09-15T22:50:58.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.601+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc44015d430 con 0x7fc4401522d0 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc44015c5c0 con 0x7fc4401522d0 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc43801a070 con 0x7fc4401522d0 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc43cc00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 0x7fc420069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7fc4380855d0 con 0x7fc4401522d0 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc444e00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 0x7fc420069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.605+0000 7fc444e00640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 0x7fc420069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc434008930 tx=0x7fc434008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.609+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc438055670 con 0x7fc4401522d0 2024-09-15T22:50:58.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.773+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fc44014d670 con 0x7fc4401522d0 2024-09-15T22:50:58.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.773+0000 7fc43cc00640 1 -- 172.21.15.31:0/4240834236 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fc438059970 con 0x7fc4401522d0 2024-09-15T22:50:58.779 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 32 2024-09-15T22:50:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 msgr2=0x7fc420069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 0x7fc420069d80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc434008930 tx=0x7fc434008040 comp rx=0 tx=0).stop 2024-09-15T22:50:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 msgr2=0x7fc44015c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc43800c700 tx=0x7fc43800cbc0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 shutdown_connections 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4200678c0 0x7fc420069d80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4401522d0 0x7fc44015c7d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4400d05b0 0x7fc44014ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 --2- 172.21.15.31:0/4240834236 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4400b4ba0 0x7fc44015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 >> 172.21.15.31:0/4240834236 conn(0x7fc44006be90 msgr2=0x7fc4400b0b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 shutdown_connections 2024-09-15T22:50:58.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.777+0000 7fc447800640 1 -- 172.21.15.31:0/4240834236 wait complete. 2024-09-15T22:50:58.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-09-15T22:50:58.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 Processor -- start 2024-09-15T22:50:58.941 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 -- start start 2024-09-15T22:50:58.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 0x7f35640cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3564070630 con 0x7f35640d0ba0 2024-09-15T22:50:58.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3564070910 con 0x7f356409aa40 2024-09-15T22:50:58.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3563200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3564070bf0 con 0x7f35640700c0 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3559400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f35640d0ba0 0x7f35640716d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35596/0 (socket says 172.21.15.31:35596) 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3559400640 1 -- 172.21.15.31:0/2948927909 learned_addr learned my addr 172.21.15.31:0/2948927909 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3562800640 1 --2- 172.21.15.31:0/2948927909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 0x7f35640cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024054837 0 0) 0x7f3564070630 con 0x7f35640d0ba0 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3548003530 con 0x7f35640d0ba0 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066398014 0 0) 0x7f3564070910 con 0x7f356409aa40 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3564070630 con 0x7f356409aa40 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3562800640 1 -- 172.21.15.31:0/2948927909 >> v1:172.21.15.102:6789/0 conn(0x7f356409aa40 legacy=0x7f356409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3562800640 1 -- 172.21.15.31:0/2948927909 >> v1:172.21.15.31:6789/0 conn(0x7f35640d0ba0 legacy=0x7f35640716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.937+0000 7f3562800640 1 -- 172.21.15.31:0/2948927909 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3564070ed0 con 0x7f35640700c0 2024-09-15T22:50:58.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3562800640 1 --2- 172.21.15.31:0/2948927909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 0x7f35640cc940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f355c009dc0 tx=0x7f355c01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b68834b2f6599d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0b4070 con 0x7f35640700c0 2024-09-15T22:50:58.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c0af600 con 0x7f35640700c0 2024-09-15T22:50:58.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3561400640 1 -- 172.21.15.31:0/2948927909 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0af9d0 con 0x7f35640700c0 2024-09-15T22:50:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 -- 172.21.15.31:0/2948927909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 msgr2=0x7f35640cc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 --2- 172.21.15.31:0/2948927909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 0x7f35640cc940 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f355c009dc0 tx=0x7f355c01f170 comp rx=0 tx=0).stop 2024-09-15T22:50:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 -- 172.21.15.31:0/2948927909 shutdown_connections 2024-09-15T22:50:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 --2- 172.21.15.31:0/2948927909 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f35640700c0 0x7f35640cc940 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 -- 172.21.15.31:0/2948927909 >> 172.21.15.31:0/2948927909 conn(0x7f35640b3ca0 msgr2=0x7f35640b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 -- 172.21.15.31:0/2948927909 shutdown_connections 2024-09-15T22:50:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.941+0000 7f3563200640 1 -- 172.21.15.31:0/2948927909 wait complete. 2024-09-15T22:50:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 Processor -- start 2024-09-15T22:50:58.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- start start 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 0x7f356415dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f356409aa40 0x7f3564149550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3564071f60 con 0x7f35640d0ba0 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3564071de0 con 0x7f35640700c0 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f356415c530 con 0x7f356409aa40 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43984/0 (socket says 172.21.15.31:43984) 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 -- 172.21.15.31:0/2033309303 learned_addr learned my addr 172.21.15.31:0/2033309303 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3559400640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f356409aa40 0x7f3564149550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3561e00640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 0x7f356415dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 -- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f356409aa40 msgr2=0x7f3564149550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f356409aa40 0x7f3564149550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 -- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 msgr2=0x7f356415dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 0x7f356415dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 -- 172.21.15.31:0/2033309303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35640b7fc0 con 0x7f35640d0ba0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3561e00640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 0x7f356415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3562800640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f355c01bd80 tx=0x7f355c01bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0bf020 con 0x7f35640d0ba0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f355c0afe10 con 0x7f35640d0ba0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0b4040 con 0x7f35640d0ba0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356415e280 con 0x7f35640d0ba0 2024-09-15T22:50:58.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35641e5f70 con 0x7f35640d0ba0 2024-09-15T22:50:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.945+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f356409ba10 con 0x7f35640d0ba0 2024-09-15T22:50:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.949+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f355c0c2020 con 0x7f35640d0ba0 2024-09-15T22:50:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.949+0000 7f355aa00640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 0x7f3540069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:58.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.949+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6793+0+0 (secure 0 0 0) 0x7f355c1241c0 con 0x7f35640d0ba0 2024-09-15T22:50:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.949+0000 7f3561e00640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 0x7f3540069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:58.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.949+0000 7f3561e00640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 0x7f3540069db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3554001740 tx=0x7f3554009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:58.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:58.953+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f355c0ca020 con 0x7f35640d0ba0 2024-09-15T22:50:59.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.173+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) -- 0x7f356406f970 con 0x7f35640d0ba0 2024-09-15T22:50:59.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.429+0000 7f355aa00640 1 -- 172.21.15.31:0/2033309303 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v56) ==== 150+0+0 (secure 0 0 0) 0x7f355c018cd0 con 0x7f35640d0ba0 2024-09-15T22:50:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.429+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 msgr2=0x7f3540069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.429+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 0x7f3540069db0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3554001740 tx=0x7f3554009040 comp rx=0 tx=0).stop 2024-09-15T22:50:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.429+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 msgr2=0x7f356415ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.429+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f355c01bd80 tx=0x7f355c01bf10 comp rx=0 tx=0).stop 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 shutdown_connections 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f35400678f0 0x7f3540069db0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f35640d0ba0 0x7f356415ea30 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f356409aa40 0x7f3564149550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 --2- 172.21.15.31:0/2033309303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f35640700c0 0x7f356415dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 >> 172.21.15.31:0/2033309303 conn(0x7f35640b3ca0 msgr2=0x7f35640b4110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 shutdown_connections 2024-09-15T22:50:59.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.433+0000 7f3563200640 1 -- 172.21.15.31:0/2033309303 wait complete. 2024-09-15T22:50:59.460 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:50:59.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 Processor -- start 2024-09-15T22:50:59.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 -- start start 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb1f01522d0 0x7fb1f015ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f00d0780 0x7fb1f015baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1f00ce310 con 0x7fb1f00b4ba0 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f01526b0 con 0x7fb1f00d0780 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1f5000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb1f00ce5f0 con 0x7fb1f01522d0 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f00d0780 0x7fb1f015baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb1f00d0780 0x7fb1f015baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43992/0 (socket says 172.21.15.31:43992) 2024-09-15T22:50:59.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 -- 172.21.15.31:0/701638966 learned_addr learned my addr 172.21.15.31:0/701638966 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:59.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ede00640 1 --2- 172.21.15.31:0/701638966 >> v2:172.21.15.102:3300/0 conn(0x7fb1f01522d0 0x7fb1f015ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 -- 172.21.15.31:0/701638966 >> v2:172.21.15.102:3300/0 conn(0x7fb1f01522d0 msgr2=0x7fb1f015ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 --2- 172.21.15.31:0/701638966 >> v2:172.21.15.102:3300/0 conn(0x7fb1f01522d0 0x7fb1f015ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 -- 172.21.15.31:0/701638966 >> v1:172.21.15.102:6789/0 conn(0x7fb1f00b4ba0 legacy=0x7fb1f00d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:50:59.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.601+0000 7fb1ee800640 1 -- 172.21.15.31:0/701638966 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00ce8d0 con 0x7fb1f00d0780 2024-09-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1ee800640 1 --2- 172.21.15.31:0/701638966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f00d0780 0x7fb1f015baa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d0e40 tx=0x7fb1e801c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3619dde2e0060769 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1ed400640 1 -- 172.21.15.31:0/701638966 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80a5740 con 0x7fb1f00d0780 2024-09-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1ed400640 1 -- 172.21.15.31:0/701638966 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80a58e0 con 0x7fb1f00d0780 2024-09-15T22:50:59.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1ed400640 1 -- 172.21.15.31:0/701638966 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80a5cb0 con 0x7fb1f00d0780 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- 172.21.15.31:0/701638966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f00d0780 msgr2=0x7fb1f015baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 --2- 172.21.15.31:0/701638966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f00d0780 0x7fb1f015baa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fb1f00d0e40 tx=0x7fb1e801c980 comp rx=0 tx=0).stop 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- 172.21.15.31:0/701638966 shutdown_connections 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 --2- 172.21.15.31:0/701638966 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f00d0780 0x7fb1f015baa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 --2- 172.21.15.31:0/701638966 >> v2:172.21.15.102:3300/0 conn(0x7fb1f01522d0 0x7fb1f015ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- 172.21.15.31:0/701638966 >> 172.21.15.31:0/701638966 conn(0x7fb1f006be90 msgr2=0x7fb1f006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- 172.21.15.31:0/701638966 shutdown_connections 2024-09-15T22:50:59.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- 172.21.15.31:0/701638966 wait complete. 2024-09-15T22:50:59.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 Processor -- start 2024-09-15T22:50:59.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.605+0000 7fb1f5000640 1 -- start start 2024-09-15T22:50:59.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f00b4ba0 0x7fb1f01472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 0x7fb1f006f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b3230 con 0x7fb1f01522d0 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f00b5030 con 0x7fb1f00d0780 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb1f00b33b0 con 0x7fb1f00b4ba0 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:43998/0 (socket says 172.21.15.31:43998) 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ede00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f00b4ba0 0x7fb1f01472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 -- 172.21.15.31:0/1411672913 learned_addr learned my addr 172.21.15.31:0/1411672913 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e5400640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 0x7fb1f006f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 -- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f00b4ba0 msgr2=0x7fb1f01472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f00b4ba0 0x7fb1f01472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 -- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 msgr2=0x7fb1f006f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 0x7fb1f006f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 -- 172.21.15.31:0/1411672913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f00aeb60 con 0x7fb1f01522d0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e5400640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 0x7fb1f006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1ee800640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80af040 tx=0x7fb1e8019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80b8470 con 0x7fb1f01522d0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80b8610 con 0x7fb1f01522d0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f00aee40 con 0x7fb1f01522d0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1e80b8a00 con 0x7fb1f01522d0 2024-09-15T22:50:59.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f00af400 con 0x7fb1f01522d0 2024-09-15T22:50:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f015baa0 con 0x7fb1f01522d0 2024-09-15T22:50:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.609+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb1e80c0020 con 0x7fb1f01522d0 2024-09-15T22:50:59.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.613+0000 7fb1e6a00640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 0x7fb1cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:50:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.613+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7fb1e81209e0 con 0x7fb1f01522d0 2024-09-15T22:50:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.613+0000 7fb1ede00640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 0x7fb1cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:50:59.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.613+0000 7fb1ede00640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 0x7fb1cc069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00079c0 tx=0x7fb1e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:50:59.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.617+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb1e80c7020 con 0x7fb1f01522d0 2024-09-15T22:50:59.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.781+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb1f006c480 con 0x7fb1f01522d0 2024-09-15T22:50:59.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.785+0000 7fb1e6a00640 1 -- 172.21.15.31:0/1411672913 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb1e80165a0 con 0x7fb1f01522d0 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 msgr2=0x7fb1cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 0x7fb1cc069d80 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb1e00079c0 tx=0x7fb1e0008040 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 msgr2=0x7fb1f006fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fb1e80af040 tx=0x7fb1e8019720 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 shutdown_connections 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb1cc0678c0 0x7fb1cc069d80 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb1f01522d0 0x7fb1f006fbb0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb1f00d0780 0x7fb1f006f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 --2- 172.21.15.31:0/1411672913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb1f00b4ba0 0x7fb1f01472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 >> 172.21.15.31:0/1411672913 conn(0x7fb1f006be90 msgr2=0x7fb1f00b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:50:59.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 shutdown_connections 2024-09-15T22:50:59.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:50:59.789+0000 7fb1f5000640 1 -- 172.21.15.31:0/1411672913 wait complete. 2024-09-15T22:50:59.814 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:50:59.814 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:50:59.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:50:59.998 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:50:59.998 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:50:59.998 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.007 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:00.007 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.057 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:00.057 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:51:00.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 Processor -- start 2024-09-15T22:51:00.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 -- start start 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 0x7efe1c09ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1c09b360 con 0x7efe1c0d0ca0 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7efe1c06ff90 con 0x7efe1c09bb10 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe22200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c070b10 con 0x7efe1c09aa40 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe20e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe13e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 0x7efe1c09ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe21800640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7efe1c0d0ca0 0x7efe1c161f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:46100/0 (socket says 172.21.15.31:46100) 2024-09-15T22:51:00.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe21800640 1 -- 172.21.15.31:0/2899935606 learned_addr learned my addr 172.21.15.31:0/2899935606 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:00.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe1be00640 1 -- 172.21.15.31:0/2899935606 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 200826710 0 0) 0x7efe1c09b360 con 0x7efe1c0d0ca0 2024-09-15T22:51:00.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe1be00640 1 -- 172.21.15.31:0/2899935606 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe00003530 con 0x7efe1c0d0ca0 2024-09-15T22:51:00.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe20e00640 1 -- 172.21.15.31:0/2899935606 >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 msgr2=0x7efe1c09ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:00.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe20e00640 1 --2- 172.21.15.31:0/2899935606 >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 0x7efe1c09ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.289+0000 7efe20e00640 1 -- 172.21.15.31:0/2899935606 >> v1:172.21.15.102:6789/0 conn(0x7efe1c0d0ca0 legacy=0x7efe1c161f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe20e00640 1 -- 172.21.15.31:0/2899935606 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c0701e0 con 0x7efe1c09aa40 2024-09-15T22:51:00.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe13e00640 1 --2- 172.21.15.31:0/2899935606 >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 0x7efe1c09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:00.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe20e00640 1 --2- 172.21.15.31:0/2899935606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c070fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097f0 tx=0x7efe0c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=831ed7b12f4c3e34 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe1be00640 1 -- 172.21.15.31:0/2899935606 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0a7070 con 0x7efe1c09aa40 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe1be00640 1 -- 172.21.15.31:0/2899935606 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0c0b0070 con 0x7efe1c09aa40 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe1be00640 1 -- 172.21.15.31:0/2899935606 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0c0ab890 con 0x7efe1c09aa40 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 -- 172.21.15.31:0/2899935606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 msgr2=0x7efe1c070fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 --2- 172.21.15.31:0/2899935606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c070fa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097f0 tx=0x7efe0c01c470 comp rx=0 tx=0).stop 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 -- 172.21.15.31:0/2899935606 shutdown_connections 2024-09-15T22:51:00.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 --2- 172.21.15.31:0/2899935606 >> v2:172.21.15.102:3300/0 conn(0x7efe1c09bb10 0x7efe1c09ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 --2- 172.21.15.31:0/2899935606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c070fa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 -- 172.21.15.31:0/2899935606 >> 172.21.15.31:0/2899935606 conn(0x7efe1c0d2140 msgr2=0x7efe1c0d2550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 -- 172.21.15.31:0/2899935606 shutdown_connections 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.293+0000 7efe22200640 1 -- 172.21.15.31:0/2899935606 wait complete. 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 Processor -- start 2024-09-15T22:51:00.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 -- start start 2024-09-15T22:51:00.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 0x7efe1c156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c16b280 con 0x7efe1c09bb10 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efe1c15e8a0 con 0x7efe1c0d0ca0 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe1c16b400 con 0x7efe1c09aa40 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe20e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe20e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:33366/0 (socket says 172.21.15.31:33366) 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe20e00640 1 -- 172.21.15.31:0/3446325546 learned_addr learned my addr 172.21.15.31:0/3446325546 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44008/0 (socket says 172.21.15.31:44008) 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe21800640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 0x7efe1c156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 -- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 msgr2=0x7efe1c157ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 -- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 msgr2=0x7efe1c156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 0x7efe1c156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 -- 172.21.15.31:0/3446325546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1c158400 con 0x7efe1c09bb10 2024-09-15T22:51:00.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe21800640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 0x7efe1c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:00.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe20e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:00.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe13e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe1c071f50 tx=0x7efe0400ee10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe04017070 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe0400c910 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe1c0b0370 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.297+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe0400cce0 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe1c0b0930 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1c0d2d60 con 0x7efe1c09bb10 2024-09-15T22:51:00.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe0401a070 con 0x7efe1c09bb10 2024-09-15T22:51:00.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe19600640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 0x7efdf8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7efe04086300 con 0x7efe1c09bb10 2024-09-15T22:51:00.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe20e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 0x7efdf8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.301+0000 7efe20e00640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 0x7efdf8069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097f0 tx=0x7efe0c0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.305+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe04056290 con 0x7efe1c09bb10 2024-09-15T22:51:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7efe1c0b1450 con 0x7efe1c09bb10 2024-09-15T22:51:00.489 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe19600640 1 -- 172.21.15.31:0/3446325546 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7efe0405a590 con 0x7efe1c09bb10 2024-09-15T22:51:00.490 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 msgr2=0x7efdf8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 0x7efdf8069d80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7efe0c0097f0 tx=0x7efe0c0a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 msgr2=0x7efe1c0cd8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7efe1c071f50 tx=0x7efe0400ee10 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 shutdown_connections 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf80678c0 0x7efdf8069d80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe1c0d0ca0 0x7efe1c156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1c09bb10 0x7efe1c0cd8c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 --2- 172.21.15.31:0/3446325546 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe1c09aa40 0x7efe1c157ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 >> 172.21.15.31:0/3446325546 conn(0x7efe1c0d2140 msgr2=0x7efe1c0cc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:00.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 shutdown_connections 2024-09-15T22:51:00.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.485+0000 7efe22200640 1 -- 172.21.15.31:0/3446325546 wait complete. 2024-09-15T22:51:00.512 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:51:00.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:00.512 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-09-15T22:51:00.546 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:51:00.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:00.547 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:51:00.601 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:00.601 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.610 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:00.610 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.659 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:00.659 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:00.711 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:51:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 Processor -- start 2024-09-15T22:51:00.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 -- start start 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff88015e6d0 0x7ff88015f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff8800d04b0 0x7ff88009aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8800d0c70 con 0x7ff88009af80 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ff88015fcb0 con 0x7ff88015e6d0 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff885e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff880160040 con 0x7ff8800d04b0 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff88015e6d0 0x7ff88015f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ff88015e6d0 0x7ff88015f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44012/0 (socket says 172.21.15.31:44012) 2024-09-15T22:51:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 -- 172.21.15.31:0/3221084667 learned_addr learned my addr 172.21.15.31:0/3221084667 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87e000640 1 --2- 172.21.15.31:0/3221084667 >> v2:172.21.15.102:3300/0 conn(0x7ff8800d04b0 0x7ff88009aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 -- 172.21.15.31:0/3221084667 >> v2:172.21.15.102:3300/0 conn(0x7ff8800d04b0 msgr2=0x7ff88009aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 --2- 172.21.15.31:0/3221084667 >> v2:172.21.15.102:3300/0 conn(0x7ff8800d04b0 0x7ff88009aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 -- 172.21.15.31:0/3221084667 >> v1:172.21.15.31:6789/0 conn(0x7ff88009af80 legacy=0x7ff880161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.856 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.849+0000 7ff87ea00640 1 -- 172.21.15.31:0/3221084667 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8800d0f50 con 0x7ff88015e6d0 2024-09-15T22:51:00.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff87ea00640 1 --2- 172.21.15.31:0/3221084667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88015e6d0 0x7ff88015f770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff8800a04a0 tx=0x7ff87001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab3e37c25688279 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff87d600640 1 -- 172.21.15.31:0/3221084667 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700ab610 con 0x7ff88015e6d0 2024-09-15T22:51:00.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff87d600640 1 -- 172.21.15.31:0/3221084667 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8700b0070 con 0x7ff88015e6d0 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff87d600640 1 -- 172.21.15.31:0/3221084667 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700ab9d0 con 0x7ff88015e6d0 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- 172.21.15.31:0/3221084667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88015e6d0 msgr2=0x7ff88015f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 --2- 172.21.15.31:0/3221084667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88015e6d0 0x7ff88015f770 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff8800a04a0 tx=0x7ff87001c520 comp rx=0 tx=0).stop 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- 172.21.15.31:0/3221084667 shutdown_connections 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 --2- 172.21.15.31:0/3221084667 >> v2:172.21.15.102:3300/0 conn(0x7ff8800d04b0 0x7ff88009aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 --2- 172.21.15.31:0/3221084667 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88015e6d0 0x7ff88015f770 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- 172.21.15.31:0/3221084667 >> 172.21.15.31:0/3221084667 conn(0x7ff8800d23b0 msgr2=0x7ff8800d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- 172.21.15.31:0/3221084667 shutdown_connections 2024-09-15T22:51:00.859 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- 172.21.15.31:0/3221084667 wait complete. 2024-09-15T22:51:00.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 Processor -- start 2024-09-15T22:51:00.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.853+0000 7ff885e00640 1 -- start start 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 0x7ff88015c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff88015e6d0 0x7ff8800d2790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff880161f30 con 0x7ff88009af80 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff8800d17f0 con 0x7ff88015e6d0 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff8800d0890 con 0x7ff8800d04b0 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44026/0 (socket says 172.21.15.31:44026) 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 -- 172.21.15.31:0/1954178603 learned_addr learned my addr 172.21.15.31:0/1954178603 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87f400640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff88015e6d0 0x7ff8800d2790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87e000640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 0x7ff88015c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 -- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 msgr2=0x7ff88015c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 0x7ff88015c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 -- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff88015e6d0 msgr2=0x7ff8800d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff88015e6d0 0x7ff8800d2790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 -- 172.21.15.31:0/1954178603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88015cae0 con 0x7ff88009af80 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87e000640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 0x7ff88015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:00.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff87ea00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff870019130 tx=0x7ff87001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700abd80 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8700be3f0 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88015cdc0 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8700be7e0 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88015d380 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.857+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88009aa40 con 0x7ff88009af80 2024-09-15T22:51:00.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.861+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff8700b43f0 con 0x7ff88009af80 2024-09-15T22:51:00.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.861+0000 7ff877400640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 0x7ff860069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:00.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.861+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7ff870120390 con 0x7ff88009af80 2024-09-15T22:51:00.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.861+0000 7ff87e000640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 0x7ff860069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:00.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.861+0000 7ff87e000640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 0x7ff860069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8801faeb0 tx=0x7ff86c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:00.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:00.865+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff8700c4060 con 0x7ff88009af80 2024-09-15T22:51:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.041+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff88009b570 con 0x7ff88009af80 2024-09-15T22:51:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.041+0000 7ff877400640 1 -- 172.21.15.31:0/1954178603 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7ff8700a8050 con 0x7ff88009af80 2024-09-15T22:51:01.046 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 msgr2=0x7ff860069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 0x7ff860069d80 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8801faeb0 tx=0x7ff86c008040 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 msgr2=0x7ff880156620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ff870019130 tx=0x7ff87001ad60 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 shutdown_connections 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff8600678c0 0x7ff860069d80 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff88015e6d0 0x7ff8800d2790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff8800d04b0 0x7ff88015c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 --2- 172.21.15.31:0/1954178603 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff88009af80 0x7ff880156620 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 >> 172.21.15.31:0/1954178603 conn(0x7ff8800d23b0 msgr2=0x7ff8800cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 shutdown_connections 2024-09-15T22:51:01.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.045+0000 7ff885e00640 1 -- 172.21.15.31:0/1954178603 wait complete. 2024-09-15T22:51:01.068 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-15T22:51:01.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:01.069 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-09-15T22:51:01.102 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:51:01.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:01.103 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-15T22:51:01.160 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:01.160 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.169 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:01.170 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.220 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:01.220 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.272 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:51:01.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.453+0000 7f001ba00640 1 Processor -- start 2024-09-15T22:51:01.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.453+0000 7f001ba00640 1 -- start start 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f001ba00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 0x7f0014070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f001ba00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00140b04e0 0x7f00140add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f001ba00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00140af440 con 0x7f001415f5a0 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f001ba00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f00140b0050 con 0x7f00140b04e0 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f001ba00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f00140af720 con 0x7f001415c080 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00140b04e0 0x7f00140add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f00140b04e0 0x7f00140add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44036/0 (socket says 172.21.15.31:44036) 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 -- 172.21.15.31:0/2472913882 learned_addr learned my addr 172.21.15.31:0/2472913882 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0019a00640 1 --1- 172.21.15.31:0/2472913882 >> v1:172.21.15.31:6789/0 conn(0x7f001415f5a0 0x7f0014161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35614/0 (socket says 172.21.15.31:35614) 2024-09-15T22:51:01.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0019000640 1 --2- 172.21.15.31:0/2472913882 >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 0x7f0014070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 -- 172.21.15.31:0/2472913882 >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 msgr2=0x7f0014070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 --2- 172.21.15.31:0/2472913882 >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 0x7f0014070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 -- 172.21.15.31:0/2472913882 >> v1:172.21.15.31:6789/0 conn(0x7f001415f5a0 legacy=0x7f0014161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0013e00640 1 -- 172.21.15.31:0/2472913882 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00140afa00 con 0x7f00140b04e0 2024-09-15T22:51:01.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.457+0000 7f0019000640 1 --2- 172.21.15.31:0/2472913882 >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 0x7f0014070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f0013e00640 1 --2- 172.21.15.31:0/2472913882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00140b04e0 0x7f00140add60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0014074340 tx=0x7f000001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a52f0a08d47e67 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f0013400640 1 -- 172.21.15.31:0/2472913882 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000b0070 con 0x7f00140b04e0 2024-09-15T22:51:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f0013400640 1 -- 172.21.15.31:0/2472913882 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00000ab600 con 0x7f00140b04e0 2024-09-15T22:51:01.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f0013400640 1 -- 172.21.15.31:0/2472913882 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00000ab9d0 con 0x7f00140b04e0 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- 172.21.15.31:0/2472913882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00140b04e0 msgr2=0x7f00140add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 --2- 172.21.15.31:0/2472913882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00140b04e0 0x7f00140add60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0014074340 tx=0x7f000001c520 comp rx=0 tx=0).stop 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- 172.21.15.31:0/2472913882 shutdown_connections 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 --2- 172.21.15.31:0/2472913882 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f00140b04e0 0x7f00140add60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 --2- 172.21.15.31:0/2472913882 >> v2:172.21.15.102:3300/0 conn(0x7f001415c080 0x7f0014070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- 172.21.15.31:0/2472913882 >> 172.21.15.31:0/2472913882 conn(0x7f001406bcc0 msgr2=0x7f001406c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- 172.21.15.31:0/2472913882 shutdown_connections 2024-09-15T22:51:01.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- 172.21.15.31:0/2472913882 wait complete. 2024-09-15T22:51:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 Processor -- start 2024-09-15T22:51:01.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.461+0000 7f001ba00640 1 -- start start 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00140b04e0 0x7f0014147830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f001415c080 0x7f00140b6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f001416b4b0 con 0x7f001415f5a0 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f001416b330 con 0x7f001415c080 2024-09-15T22:51:01.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f001416b630 con 0x7f00140b04e0 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44052/0 (socket says 172.21.15.31:44052) 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 -- 172.21.15.31:0/2127524666 learned_addr learned my addr 172.21.15.31:0/2127524666 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0013e00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f001415c080 0x7f00140b6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019000640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00140b04e0 0x7f0014147830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 -- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00140b04e0 msgr2=0x7f0014147830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00140b04e0 0x7f0014147830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 -- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f001415c080 msgr2=0x7f00140b6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f001415c080 0x7f00140b6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 -- 172.21.15.31:0/2127524666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001415e740 con 0x7f001415f5a0 2024-09-15T22:51:01.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0019a00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c700 tx=0x7f000c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c017070 con 0x7f001415f5a0 2024-09-15T22:51:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f000c00ce10 con 0x7f001415f5a0 2024-09-15T22:51:01.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f000c00a840 con 0x7f001415f5a0 2024-09-15T22:51:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f001415fa70 con 0x7f001415f5a0 2024-09-15T22:51:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f001415ecc0 con 0x7f001415f5a0 2024-09-15T22:51:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00140add60 con 0x7f001415f5a0 2024-09-15T22:51:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.465+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f000c01a070 con 0x7f001415f5a0 2024-09-15T22:51:01.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.469+0000 7f0010c00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 0x7efff4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.469+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f000c0855b0 con 0x7f001415f5a0 2024-09-15T22:51:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.469+0000 7f0019000640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 0x7efff4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:01.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.469+0000 7f0019000640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 0x7efff4069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f000800c900 tx=0x7f0008008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:01.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.473+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f000c055650 con 0x7f001415f5a0 2024-09-15T22:51:01.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f001406d280 con 0x7f001415f5a0 2024-09-15T22:51:01.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f0010c00640 1 -- 172.21.15.31:0/2127524666 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f000c059950 con 0x7f001415f5a0 2024-09-15T22:51:01.654 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 msgr2=0x7efff4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 0x7efff4069d80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f000800c900 tx=0x7f0008008040 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 msgr2=0x7f00140b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f000c00c700 tx=0x7f000c00cbc0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 shutdown_connections 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efff40678c0 0x7efff4069d80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f001415f5a0 0x7f00140b6670 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f001415c080 0x7f00140b6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 --2- 172.21.15.31:0/2127524666 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f00140b04e0 0x7f0014147830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 >> 172.21.15.31:0/2127524666 conn(0x7f001406bcc0 msgr2=0x7f00141521f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:01.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 shutdown_connections 2024-09-15T22:51:01.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:01.649+0000 7f001ba00640 1 -- 172.21.15.31:0/2127524666 wait complete. 2024-09-15T22:51:01.674 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-09-15T22:51:01.674 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:01.674 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-09-15T22:51:01.698 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:51:01.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:01.698 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-15T22:51:01.753 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:01.753 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.762 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:01.763 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.815 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:51:01.815 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:01.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:51:02.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 Processor -- start 2024-09-15T22:51:02.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 -- start start 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b415e730 0x7f91b415f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b40b1c70 con 0x7f91b406d990 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91b409b1e0 con 0x7f91b40b1890 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91ba600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f91b409b4c0 con 0x7f91b415e730 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91b3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b415e730 0x7f91b415f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91aaa00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f91b406d990 0x7f91b415e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35616/0 (socket says 172.21.15.31:35616) 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91b3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f91b415e730 0x7f91b415f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44064/0 (socket says 172.21.15.31:44064) 2024-09-15T22:51:02.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.005+0000 7f91aaa00640 1 -- 172.21.15.31:0/2875954376 learned_addr learned my addr 172.21.15.31:0/2875954376 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:02.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b3e00640 1 -- 172.21.15.31:0/2875954376 >> v1:172.21.15.102:6789/0 conn(0x7f91b40b1890 legacy=0x7f91b406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b3e00640 1 -- 172.21.15.31:0/2875954376 >> v1:172.21.15.31:6789/0 conn(0x7f91b406d990 legacy=0x7f91b415e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b3e00640 1 -- 172.21.15.31:0/2875954376 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b409b7a0 con 0x7f91b415e730 2024-09-15T22:51:02.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b3e00640 1 --2- 172.21.15.31:0/2875954376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b415f810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c749320a0fc6f1cc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b2a00640 1 -- 172.21.15.31:0/2875954376 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0b2070 con 0x7f91b415e730 2024-09-15T22:51:02.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b2a00640 1 -- 172.21.15.31:0/2875954376 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac0a5910 con 0x7f91b415e730 2024-09-15T22:51:02.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91b2a00640 1 -- 172.21.15.31:0/2875954376 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0a5ce0 con 0x7f91b415e730 2024-09-15T22:51:02.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 -- 172.21.15.31:0/2875954376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 msgr2=0x7f91b415f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 --2- 172.21.15.31:0/2875954376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b415f810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009d90 tx=0x7f91ac01c940 comp rx=0 tx=0).stop 2024-09-15T22:51:02.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 -- 172.21.15.31:0/2875954376 shutdown_connections 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 --2- 172.21.15.31:0/2875954376 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b415f810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 -- 172.21.15.31:0/2875954376 >> 172.21.15.31:0/2875954376 conn(0x7f91b40d23b0 msgr2=0x7f91b40d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 -- 172.21.15.31:0/2875954376 shutdown_connections 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.009+0000 7f91ba600640 1 -- 172.21.15.31:0/2875954376 wait complete. 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 Processor -- start 2024-09-15T22:51:02.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- start start 2024-09-15T22:51:02.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91b406d990 0x7f91b4158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b40b1890 0x7f91b41566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f91b40d1520 con 0x7f91b415e730 2024-09-15T22:51:02.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f91b40d13a0 con 0x7f91b40b1890 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f91b40d16a0 con 0x7f91b406d990 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44078/0 (socket says 172.21.15.31:44078) 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 -- 172.21.15.31:0/2973159095 learned_addr learned my addr 172.21.15.31:0/2973159095 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91aaa00640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b40b1890 0x7f91b41566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3400640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91b406d990 0x7f91b4158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 -- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91b406d990 msgr2=0x7f91b4158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91b406d990 0x7f91b4158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 -- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b40b1890 msgr2=0x7f91b41566c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b40b1890 0x7f91b41566c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 -- 172.21.15.31:0/2973159095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91b4159130 con 0x7f91b415e730 2024-09-15T22:51:02.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91b3e00640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0b0040 tx=0x7f91ac0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0bd020 con 0x7f91b415e730 2024-09-15T22:51:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ac0ad740 con 0x7f91b415e730 2024-09-15T22:51:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac0b2040 con 0x7f91b415e730 2024-09-15T22:51:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b40b5450 con 0x7f91b415e730 2024-09-15T22:51:02.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.013+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91b40b7e00 con 0x7f91b415e730 2024-09-15T22:51:02.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91b415f810 con 0x7f91b415e730 2024-09-15T22:51:02.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f91ac0c0020 con 0x7f91b415e730 2024-09-15T22:51:02.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91abe00640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f91ac121250 con 0x7f91b415e730 2024-09-15T22:51:02.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91b3400640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.017+0000 7f91b3400640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 0x7f9190069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91b4157a90 tx=0x7f91a4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.021+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f91ac0c7030 con 0x7f91b415e730 2024-09-15T22:51:02.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.197+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f91b40d2120 con 0x7f91b415e730 2024-09-15T22:51:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91abe00640 1 -- 172.21.15.31:0/2973159095 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f91ac016560 con 0x7f91b415e730 2024-09-15T22:51:02.205 INFO:teuthology.orchestra.run.smithi031.stderr:listed 0 entries 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 msgr2=0x7f9190069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 0x7f9190069d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f91b4157a90 tx=0x7f91a4009040 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 msgr2=0x7f91b4156c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f91ac0b0040 tx=0x7f91ac0196e0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 shutdown_connections 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f91900678c0 0x7f9190069d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f91b415e730 0x7f91b4156c00 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f91b40b1890 0x7f91b41566c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 --2- 172.21.15.31:0/2973159095 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f91b406d990 0x7f91b4158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 >> 172.21.15.31:0/2973159095 conn(0x7f91b40d23b0 msgr2=0x7f91b40b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 shutdown_connections 2024-09-15T22:51:02.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.201+0000 7f91ba600640 1 -- 172.21.15.31:0/2973159095 wait complete. 2024-09-15T22:51:02.225 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-09-15T22:51:02.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:02.226 DEBUG:teuthology.orchestra.run.smithi102:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-09-15T22:51:02.250 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:51:02.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:02.251 DEBUG:teuthology.orchestra.run.smithi102:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-15T22:51:02.308 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:51:02.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.441+0000 7fc48bc00640 1 Processor -- start 2024-09-15T22:51:02.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 -- start start 2024-09-15T22:51:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc48415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4840d04b0 0x7fc48409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc48409af80 0x7fc484161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc48415fcb0 con 0x7fc48409af80 2024-09-15T22:51:02.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc484160040 con 0x7fc4840d04b0 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc48bc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4840d0c70 con 0x7fc48415e6d0 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc48409af80 0x7fc484161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc48409af80 0x7fc484161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44094/0 (socket says 172.21.15.31:44094) 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 -- 172.21.15.31:0/219324867 learned_addr learned my addr 172.21.15.31:0/219324867 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489200640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc48415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc47be00640 1 --2- 172.21.15.31:0/219324867 >> v2:172.21.15.102:3300/0 conn(0x7fc4840d04b0 0x7fc48409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 -- 172.21.15.31:0/219324867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 msgr2=0x7fc48415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc48415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 -- 172.21.15.31:0/219324867 >> v2:172.21.15.102:3300/0 conn(0x7fc4840d04b0 msgr2=0x7fc48409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 --2- 172.21.15.31:0/219324867 >> v2:172.21.15.102:3300/0 conn(0x7fc4840d04b0 0x7fc48409aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.445+0000 7fc489c00640 1 -- 172.21.15.31:0/219324867 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4840d0f50 con 0x7fc48409af80 2024-09-15T22:51:02.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc489c00640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc484161410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009e50 tx=0x7fc47c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa6eb949ed0c8d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc483e00640 1 -- 172.21.15.31:0/219324867 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0a5760 con 0x7fc48409af80 2024-09-15T22:51:02.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc483e00640 1 -- 172.21.15.31:0/219324867 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47c0a5900 con 0x7fc48409af80 2024-09-15T22:51:02.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc483e00640 1 -- 172.21.15.31:0/219324867 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47c0a5cd0 con 0x7fc48409af80 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- 172.21.15.31:0/219324867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 msgr2=0x7fc484161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc484161410 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fc47c009e50 tx=0x7fc47c01c9f0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- 172.21.15.31:0/219324867 shutdown_connections 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc484161410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 --2- 172.21.15.31:0/219324867 >> v2:172.21.15.102:3300/0 conn(0x7fc4840d04b0 0x7fc48409aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 --2- 172.21.15.31:0/219324867 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc48415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- 172.21.15.31:0/219324867 >> 172.21.15.31:0/219324867 conn(0x7fc4840d23b0 msgr2=0x7fc4840d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:02.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- 172.21.15.31:0/219324867 shutdown_connections 2024-09-15T22:51:02.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- 172.21.15.31:0/219324867 wait complete. 2024-09-15T22:51:02.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 Processor -- start 2024-09-15T22:51:02.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.449+0000 7fc48bc00640 1 -- start start 2024-09-15T22:51:02.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4840d04b0 0x7fc4840cde40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc4841f7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840d0890 con 0x7fc48409af80 2024-09-15T22:51:02.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4840d17f0 con 0x7fc4840d04b0 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4840d0a10 con 0x7fc48415e6d0 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44104/0 (socket says 172.21.15.31:44104) 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 -- 172.21.15.31:0/4234942175 learned_addr learned my addr 172.21.15.31:0/4234942175 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489c00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc4841f7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc47be00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4840d04b0 0x7fc4840cde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 -- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 msgr2=0x7fc4841f7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc4841f7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 -- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4840d04b0 msgr2=0x7fc4840cde40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4840d04b0 0x7fc4840cde40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.458 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 -- 172.21.15.31:0/4234942175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4841f85a0 con 0x7fc48409af80 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc489200640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc47400e960 tx=0x7fc47400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc474017070 con 0x7fc48409af80 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc47400ca00 con 0x7fc48409af80 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc47400cdb0 con 0x7fc48409af80 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4841f8880 con 0x7fc48409af80 2024-09-15T22:51:02.459 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4841fb5e0 con 0x7fc48409af80 2024-09-15T22:51:02.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48409aa40 con 0x7fc48409af80 2024-09-15T22:51:02.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.453+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc47401a070 con 0x7fc48409af80 2024-09-15T22:51:02.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.457+0000 7fc481600640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 0x7fc460069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.457+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7fc474086060 con 0x7fc48409af80 2024-09-15T22:51:02.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.457+0000 7fc47be00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 0x7fc460069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.462 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.457+0000 7fc47be00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 0x7fc460069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4840ce870 tx=0x7fc46c009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.465 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.461+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc474056100 con 0x7fc48409af80 2024-09-15T22:51:02.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.661+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc48409b570 con 0x7fc48409af80 2024-09-15T22:51:02.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.661+0000 7fc481600640 1 -- 172.21.15.31:0/4234942175 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7fc47405a400 con 0x7fc48409af80 2024-09-15T22:51:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:02.668 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:51:02.668 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 msgr2=0x7fc460069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 0x7fc460069d80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc4840ce870 tx=0x7fc46c009190 comp rx=0 tx=0).stop 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 msgr2=0x7fc4841fbae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc47400e960 tx=0x7fc47400ee20 comp rx=0 tx=0).stop 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 shutdown_connections 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4600678c0 0x7fc460069d80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc48415e6d0 0x7fc4841f7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4840d04b0 0x7fc4840cde40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 --2- 172.21.15.31:0/4234942175 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc48409af80 0x7fc4841fbae0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 >> 172.21.15.31:0/4234942175 conn(0x7fc4840d23b0 msgr2=0x7fc484156c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:02.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 shutdown_connections 2024-09-15T22:51:02.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.665+0000 7fc48bc00640 1 -- 172.21.15.31:0/4234942175 wait complete. 2024-09-15T22:51:02.690 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:02.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 Processor -- start 2024-09-15T22:51:02.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 -- start start 2024-09-15T22:51:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f680ae470 0x7f4f68169110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680af440 con 0x7f4f680b04e0 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680af720 con 0x7f4f6815c080 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6f200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4f680b0050 con 0x7f4f680ae470 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f680ae470 0x7f4f68169110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4f680ae470 0x7f4f68169110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44108/0 (socket says 172.21.15.31:44108) 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f67400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4f680b04e0 0x7f4f680add60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35630/0 (socket says 172.21.15.31:35630) 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 -- 172.21.15.31:0/641414345 learned_addr learned my addr 172.21.15.31:0/641414345 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 -- 172.21.15.31:0/641414345 >> v1:172.21.15.102:6789/0 conn(0x7f4f6815c080 legacy=0x7f4f68070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 -- 172.21.15.31:0/641414345 >> v1:172.21.15.31:6789/0 conn(0x7f4f680b04e0 legacy=0x7f4f680add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.825+0000 7f4f6d200640 1 -- 172.21.15.31:0/641414345 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f680afa00 con 0x7f4f680ae470 2024-09-15T22:51:02.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6d200640 1 --2- 172.21.15.31:0/641414345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680ae470 0x7f4f68169110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009e50 tx=0x7f4f6001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cefa474fe8ac27 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f66a00640 1 -- 172.21.15.31:0/641414345 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600a5700 con 0x7f4f680ae470 2024-09-15T22:51:02.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f66a00640 1 -- 172.21.15.31:0/641414345 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f600a58a0 con 0x7f4f680ae470 2024-09-15T22:51:02.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f66a00640 1 -- 172.21.15.31:0/641414345 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f600a5c70 con 0x7f4f680ae470 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 -- 172.21.15.31:0/641414345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680ae470 msgr2=0x7f4f68169110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 --2- 172.21.15.31:0/641414345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680ae470 0x7f4f68169110 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4f60009e50 tx=0x7f4f6001ca30 comp rx=0 tx=0).stop 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 -- 172.21.15.31:0/641414345 shutdown_connections 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 --2- 172.21.15.31:0/641414345 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680ae470 0x7f4f68169110 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 -- 172.21.15.31:0/641414345 >> 172.21.15.31:0/641414345 conn(0x7f4f6806bcc0 msgr2=0x7f4f6806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 -- 172.21.15.31:0/641414345 shutdown_connections 2024-09-15T22:51:02.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.829+0000 7f4f6f200640 1 -- 172.21.15.31:0/641414345 wait complete. 2024-09-15T22:51:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 Processor -- start 2024-09-15T22:51:02.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- start start 2024-09-15T22:51:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f680ae470 0x7f4f680ce6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f6815c080 0x7f4f6814df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6816c200 con 0x7f4f680b04e0 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6816c080 con 0x7f4f680ae470 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4f6816c380 con 0x7f4f6815c080 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44114/0 (socket says 172.21.15.31:44114) 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 -- 172.21.15.31:0/1127437392 learned_addr learned my addr 172.21.15.31:0/1127437392 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67e00640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f680ae470 0x7f4f680ce6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6d200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f6815c080 0x7f4f6814df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 -- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f6815c080 msgr2=0x7f4f6814df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f6815c080 0x7f4f6814df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 -- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f680ae470 msgr2=0x7f4f680ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f680ae470 0x7f4f680ce6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 -- 172.21.15.31:0/1127437392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f680aea00 con 0x7f4f680b04e0 2024-09-15T22:51:02.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f67400640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4c0 tx=0x7f4f5400c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f54018070 con 0x7f4f680b04e0 2024-09-15T22:51:02.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f54007480 con 0x7f4f680b04e0 2024-09-15T22:51:02.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f540047f0 con 0x7f4f680b04e0 2024-09-15T22:51:02.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f680ae2a0 con 0x7f4f680b04e0 2024-09-15T22:51:02.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.833+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6815cc40 con 0x7f4f680b04e0 2024-09-15T22:51:02.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.837+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f680add60 con 0x7f4f680b04e0 2024-09-15T22:51:02.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.837+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f54004990 con 0x7f4f680b04e0 2024-09-15T22:51:02.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.837+0000 7f4f5fe00640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 0x7f4f48069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:02.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.837+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f4f540852d0 con 0x7f4f680b04e0 2024-09-15T22:51:02.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.837+0000 7f4f67e00640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 0x7f4f48069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:02.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.841+0000 7f4f67e00640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 0x7f4f48069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f68150f40 tx=0x7f4f58009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:02.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:02.841+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f54055370 con 0x7f4f680b04e0 2024-09-15T22:51:03.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.041+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4f6806c1b0 con 0x7f4f680b04e0 2024-09-15T22:51:03.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.041+0000 7f4f5fe00640 1 -- 172.21.15.31:0/1127437392 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7f4f54059670 con 0x7f4f680b04e0 2024-09-15T22:51:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:03.047 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:51:03.047 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 msgr2=0x7f4f48069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 0x7f4f48069d80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f68150f40 tx=0x7f4f58009040 comp rx=0 tx=0).stop 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 msgr2=0x7f4f6815c460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400c4c0 tx=0x7f4f5400c980 comp rx=0 tx=0).stop 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 shutdown_connections 2024-09-15T22:51:03.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f480678c0 0x7f4f48069d80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f6815c080 0x7f4f6814df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f680b04e0 0x7f4f6815c460 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 --2- 172.21.15.31:0/1127437392 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f680ae470 0x7f4f680ce6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 >> 172.21.15.31:0/1127437392 conn(0x7f4f6806bcc0 msgr2=0x7f4f6806c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 shutdown_connections 2024-09-15T22:51:03.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.045+0000 7f4f6f200640 1 -- 172.21.15.31:0/1127437392 wait complete. 2024-09-15T22:51:03.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:51:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 Processor -- start 2024-09-15T22:51:03.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 -- start start 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5768072160 0x7f5768072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f576813fa40 0x7f576813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5768072a80 con 0x7f5768141980 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f576813f640 con 0x7f576813fa40 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f576d200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f57681413c0 con 0x7f5768072160 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f576813fa40 0x7f576813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f576813fa40 0x7f576813fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44128/0 (socket says 172.21.15.31:44128) 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 -- 172.21.15.31:0/344397011 learned_addr learned my addr 172.21.15.31:0/344397011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765e00640 1 --2- 172.21.15.31:0/344397011 >> v2:172.21.15.102:3300/0 conn(0x7f5768072160 0x7f5768072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 -- 172.21.15.31:0/344397011 >> v2:172.21.15.102:3300/0 conn(0x7f5768072160 msgr2=0x7f5768072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 --2- 172.21.15.31:0/344397011 >> v2:172.21.15.102:3300/0 conn(0x7f5768072160 0x7f5768072540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 -- 172.21.15.31:0/344397011 >> v1:172.21.15.102:6789/0 conn(0x7f5768141980 legacy=0x7f5768141df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.211 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.205+0000 7f5765400640 1 -- 172.21.15.31:0/344397011 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57681407b0 con 0x7f576813fa40 2024-09-15T22:51:03.213 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f5765400640 1 --2- 172.21.15.31:0/344397011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f576813fa40 0x7f576813fea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57680b5880 tx=0x7f575401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad028be5d055e124 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f5764a00640 1 -- 172.21.15.31:0/344397011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540b2070 con 0x7f576813fa40 2024-09-15T22:51:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f5764a00640 1 -- 172.21.15.31:0/344397011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57540ad680 con 0x7f576813fa40 2024-09-15T22:51:03.214 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f5764a00640 1 -- 172.21.15.31:0/344397011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57540ada50 con 0x7f576813fa40 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- 172.21.15.31:0/344397011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f576813fa40 msgr2=0x7f576813fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 --2- 172.21.15.31:0/344397011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f576813fa40 0x7f576813fea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f57680b5880 tx=0x7f575401c490 comp rx=0 tx=0).stop 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- 172.21.15.31:0/344397011 shutdown_connections 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 --2- 172.21.15.31:0/344397011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f576813fa40 0x7f576813fea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 --2- 172.21.15.31:0/344397011 >> v2:172.21.15.102:3300/0 conn(0x7f5768072160 0x7f5768072540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- 172.21.15.31:0/344397011 >> 172.21.15.31:0/344397011 conn(0x7f5768067e00 msgr2=0x7f576806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- 172.21.15.31:0/344397011 shutdown_connections 2024-09-15T22:51:03.215 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- 172.21.15.31:0/344397011 wait complete. 2024-09-15T22:51:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 Processor -- start 2024-09-15T22:51:03.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.209+0000 7f576d200640 1 -- start start 2024-09-15T22:51:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 0x7f57680aed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 0x7f57680af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5768140560 con 0x7f5768072160 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f57681403e0 con 0x7f5768141980 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f576806f170 con 0x7f576813fa40 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44134/0 (socket says 172.21.15.31:44134) 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 -- 172.21.15.31:0/1940483792 learned_addr learned my addr 172.21.15.31:0/1940483792 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5766800640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 0x7f57680af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765400640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 0x7f57680aed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 -- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 msgr2=0x7f57680aed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 0x7f57680aed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 -- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 msgr2=0x7f57680af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 0x7f57680af280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 -- 172.21.15.31:0/1940483792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5768159130 con 0x7f5768072160 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5766800640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 0x7f57680af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765400640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 0x7f57680aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f5765e00640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f575800e960 tx=0x7f575800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x7f5768072160 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f575800ca00 con 0x7f5768072160 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5768159410 con 0x7f5768072160 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f575800cdb0 con 0x7f5768072160 2024-09-15T22:51:03.220 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57681599d0 con 0x7f5768072160 2024-09-15T22:51:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.213+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5768072540 con 0x7f5768072160 2024-09-15T22:51:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.217+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f575801a070 con 0x7f5768072160 2024-09-15T22:51:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.217+0000 7f575e000640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 0x7f5748069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.217+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f5758086460 con 0x7f5768072160 2024-09-15T22:51:03.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.217+0000 7f5765400640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 0x7f5748069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.217+0000 7f5765400640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 0x7f5748069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57540af000 tx=0x7f5754008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.225 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.221+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5758056bf0 con 0x7f5768072160 2024-09-15T22:51:03.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.385+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5768156dc0 con 0x7f5768072160 2024-09-15T22:51:03.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.385+0000 7f575e000640 1 -- 172.21.15.31:0/1940483792 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19044 (secure 0 0 0) 0x7f57580564f0 con 0x7f5768072160 2024-09-15T22:51:03.392 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:03.392 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:59.420579+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:51:03.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 msgr2=0x7f5748069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 0x7f5748069d80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f57540af000 tx=0x7f5754008040 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 msgr2=0x7f57681518e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f575800e960 tx=0x7f575800ee20 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 shutdown_connections 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f57480678c0 0x7f5748069d80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5768141980 0x7f57680af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f576813fa40 0x7f57680aed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 --2- 172.21.15.31:0/1940483792 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5768072160 0x7f57681518e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 >> 172.21.15.31:0/1940483792 conn(0x7f5768067e00 msgr2=0x7f576806f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 shutdown_connections 2024-09-15T22:51:03.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.389+0000 7f576d200640 1 -- 172.21.15.31:0/1940483792 wait complete. 2024-09-15T22:51:03.414 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:51:03.414 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:03.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.549+0000 7f96a9c00640 1 Processor -- start 2024-09-15T22:51:03.556 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.549+0000 7f96a9c00640 1 -- start start 2024-09-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96a413fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a9c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f96a406e160 0x7f96a406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a9c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96a41407b0 con 0x7f96a4072160 2024-09-15T22:51:03.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a9c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f96a413f640 con 0x7f96a406e160 2024-09-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96a41413c0 con 0x7f96a413fa40 2024-09-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f96a4072160 0x7f96a4072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:35638/0 (socket says 172.21.15.31:35638) 2024-09-15T22:51:03.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2a00640 1 -- 172.21.15.31:0/689410951 learned_addr learned my addr 172.21.15.31:0/689410951 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:03.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a3400640 1 --2- 172.21.15.31:0/689410951 >> v2:172.21.15.102:3300/0 conn(0x7f96a406e160 0x7f96a406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.560 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96a413fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965792455 0 0) 0x7f96a41407b0 con 0x7f96a4072160 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003530 con 0x7f96a4072160 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 162186483 0 0) 0x7f9688003530 con 0x7f96a4072160 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 msgr2=0x7f96a413fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96a413fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 >> v2:172.21.15.102:3300/0 conn(0x7f96a406e160 msgr2=0x7f96a406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 --2- 172.21.15.31:0/689410951 >> v2:172.21.15.102:3300/0 conn(0x7f96a406e160 0x7f96a406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a4140a90 con 0x7f96a4072160 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f9694001680 con 0x7f96a4072160 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 >> v1:172.21.15.31:6789/0 conn(0x7f96a4072160 legacy=0x7f96a4072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96880039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9688003f40 0x7f9688004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.561 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688004d50 0x7f96880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96a413f640 con 0x7f9688003f40 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96a41413c0 con 0x7f9688004d50 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f968800ba20 con 0x7f96a413fa40 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9688003f40 0x7f9688004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a3400640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688004d50 0x7f96880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2a00640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96880039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 -- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 msgr2=0x7f96880039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96880039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 -- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688004d50 msgr2=0x7f96880051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688004d50 0x7f96880051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f969a000640 1 -- 172.21.15.31:0/689410951 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9688003530 con 0x7f9688003f40 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a3400640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688004d50 0x7f96880051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:03.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.553+0000 7f96a2a00640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a413fa40 0x7f96880039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:03.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f969a000640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9688003f40 0x7f9688004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f968c009ae0 tx=0x7f968c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f54e38edefc45b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0096b0 con 0x7f9688003f40 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f968c0a6410 con 0x7f9688003f40 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a2000640 1 -- 172.21.15.31:0/689410951 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f968c0a6800 con 0x7f9688003f40 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 -- 172.21.15.31:0/689410951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9688003f40 msgr2=0x7f9688004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 --2- 172.21.15.31:0/689410951 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9688003f40 0x7f9688004810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f968c009ae0 tx=0x7f968c01ca30 comp rx=0 tx=0).stop 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a3400640 1 -- 172.21.15.31:0/689410951 reap_dead start 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 -- 172.21.15.31:0/689410951 shutdown_connections 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 -- 172.21.15.31:0/689410951 >> 172.21.15.31:0/689410951 conn(0x7f96a4067e00 msgr2=0x7f96a406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 -- 172.21.15.31:0/689410951 shutdown_connections 2024-09-15T22:51:03.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.557+0000 7f96a9c00640 1 -- 172.21.15.31:0/689410951 wait complete. 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 Processor -- start 2024-09-15T22:51:03.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- start start 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688003f40 0x7f96a413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a4143ac0 0x7f96a40b1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406ef20 con 0x7f96a4143f40 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f96a406eda0 con 0x7f9688003f40 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f96a406f0a0 con 0x7f96a4143ac0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44156/0 (socket says 172.21.15.31:44156) 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 -- 172.21.15.31:0/3148000597 learned_addr learned my addr 172.21.15.31:0/3148000597 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a2a00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688003f40 0x7f96a413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f969a000640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a4143ac0 0x7f96a40b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 -- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a4143ac0 msgr2=0x7f96a40b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a4143ac0 0x7f96a40b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 -- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688003f40 msgr2=0x7f96a413b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688003f40 0x7f96a413b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 -- 172.21.15.31:0/3148000597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96a4144510 con 0x7f96a4143f40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a3400640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b3590 tx=0x7f969c010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c01a030 con 0x7f96a4143f40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f969c010d80 con 0x7f96a4143f40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96a41447f0 con 0x7f96a4143f40 2024-09-15T22:51:03.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f969c007ea0 con 0x7f96a4143f40 2024-09-15T22:51:03.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96a4158450 con 0x7f96a4143f40 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.561+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96a4158650 con 0x7f96a4143f40 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.565+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f969c01d070 con 0x7f96a4143f40 2024-09-15T22:51:03.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.565+0000 7f969b400640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.565+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f969c086610 con 0x7f96a4143f40 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.565+0000 7f96a2a00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.572 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.565+0000 7f96a2a00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f96a41454f0 tx=0x7f9694007040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.569+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f96a4158650 con 0x7f96a4143f40 2024-09-15T22:51:03.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.769+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96a40af4d0 con 0x7f96a4143f40 2024-09-15T22:51:03.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.769+0000 7f969b400640 1 -- 172.21.15.31:0/3148000597 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7f969c056d00 con 0x7f96a4143f40 2024-09-15T22:51:03.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:03.777 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:51:03.777 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:51:03.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 msgr2=0x7f9680069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 0x7f9680069d80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f96a41454f0 tx=0x7f9694007040 comp rx=0 tx=0).stop 2024-09-15T22:51:03.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 msgr2=0x7f96a40b1b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f96a40b3590 tx=0x7f969c010590 comp rx=0 tx=0).stop 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 shutdown_connections 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96800678c0 0x7f9680069d80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f96a4143f40 0x7f96a40b1b90 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f96a4143ac0 0x7f96a40b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 --2- 172.21.15.31:0/3148000597 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9688003f40 0x7f96a413b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 >> 172.21.15.31:0/3148000597 conn(0x7f96a4067e00 msgr2=0x7f96a40b4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 shutdown_connections 2024-09-15T22:51:03.779 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.773+0000 7f96a9c00640 1 -- 172.21.15.31:0/3148000597 wait complete. 2024-09-15T22:51:03.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.933+0000 7fd8b0e00640 1 Processor -- start 2024-09-15T22:51:03.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 -- start start 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8ac155560 0x7fd8ac06ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 0x7fd8ac06ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 0x7fd8ac161f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ac06f3e0 con 0x7fd8ac155560 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd8ac06f6c0 con 0x7fd8ac06d210 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8b0e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac06f9a0 con 0x7fd8ac15f5e0 2024-09-15T22:51:03.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8ac155560 0x7fd8ac06ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8ac155560 0x7fd8ac06ea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44166/0 (socket says 172.21.15.31:44166) 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 -- 172.21.15.31:0/1804337662 learned_addr learned my addr 172.21.15.31:0/1804337662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a1400640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 0x7fd8ac06ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8aa800640 1 --2- 172.21.15.31:0/1804337662 >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 0x7fd8ac161f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 -- 172.21.15.31:0/1804337662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 msgr2=0x7fd8ac06ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 0x7fd8ac06ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 -- 172.21.15.31:0/1804337662 >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 msgr2=0x7fd8ac161f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/1804337662 >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 0x7fd8ac161f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a9e00640 1 -- 172.21.15.31:0/1804337662 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac06fc80 con 0x7fd8ac155560 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8aa800640 1 --2- 172.21.15.31:0/1804337662 >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 0x7fd8ac161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:03.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.937+0000 7fd8a1400640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 0x7fd8ac06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac06ea70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0ccec0 tx=0x7fd89c01c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e7d0468899b5d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8a9400640 1 -- 172.21.15.31:0/1804337662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0b0070 con 0x7fd8ac155560 2024-09-15T22:51:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8a9400640 1 -- 172.21.15.31:0/1804337662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd89c0ab600 con 0x7fd8ac155560 2024-09-15T22:51:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8a9400640 1 -- 172.21.15.31:0/1804337662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89c0ab9d0 con 0x7fd8ac155560 2024-09-15T22:51:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- 172.21.15.31:0/1804337662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 msgr2=0x7fd8ac06ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac06ea70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac0ccec0 tx=0x7fd89c01c260 comp rx=0 tx=0).stop 2024-09-15T22:51:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- 172.21.15.31:0/1804337662 shutdown_connections 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/1804337662 >> v2:172.21.15.102:3300/0 conn(0x7fd8ac06d210 0x7fd8ac161f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac15f5e0 0x7fd8ac06ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/1804337662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac06ea70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- 172.21.15.31:0/1804337662 >> 172.21.15.31:0/1804337662 conn(0x7fd8ac072790 msgr2=0x7fd8ac072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- 172.21.15.31:0/1804337662 shutdown_connections 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- 172.21.15.31:0/1804337662 wait complete. 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 Processor -- start 2024-09-15T22:51:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.941+0000 7fd8b0e00640 1 -- start start 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 0x7fd8ac0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 0x7fd8ac15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac0b4150 con 0x7fd8ac155560 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8ac06f1c0 con 0x7fd8ac15f5e0 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8ac0b42d0 con 0x7fd8ac06d210 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44172/0 (socket says 172.21.15.31:44172) 2024-09-15T22:51:03.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 -- 172.21.15.31:0/2383842430 learned_addr learned my addr 172.21.15.31:0/2383842430 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 0x7fd8ac0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 -- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 msgr2=0x7fd8ac0b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8aa800640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 0x7fd8ac15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 0x7fd8ac0b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 -- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 msgr2=0x7fd8ac15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 0x7fd8ac15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 -- 172.21.15.31:0/2383842430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8ac14c5a0 con 0x7fd8ac155560 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 0x7fd8ac0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8aa800640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 0x7fd8ac15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a1400640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c7f0 tx=0x7fd89400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894015070 con 0x7fd8ac155560 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd894007820 con 0x7fd8ac155560 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894007c10 con 0x7fd8ac155560 2024-09-15T22:51:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8ac0b0af0 con 0x7fd8ac155560 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8ac0b10b0 con 0x7fd8ac155560 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8ac06ea70 con 0x7fd8ac155560 2024-09-15T22:51:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.945+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd894018070 con 0x7fd8ac155560 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.949+0000 7fd8a2a00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 0x7fd888069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.949+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7fd894086210 con 0x7fd8ac155560 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.949+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 0x7fd888069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:03.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.949+0000 7fd8a9e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 0x7fd888069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0ad000 tx=0x7fd89c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:03.953+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd894056900 con 0x7fd8ac155560 2024-09-15T22:51:04.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8ac161e50 con 0x7fd8ac155560 2024-09-15T22:51:04.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8a2a00640 1 -- 172.21.15.31:0/2383842430 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5222 (secure 0 0 0) 0x7fd894056200 con 0x7fd8ac155560 2024-09-15T22:51:04.162 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:04.162 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":8,"btime":"2024-09-15T22:50:38:350776+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/2145345559","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2145345559},{"type":"v1","addr":"172.21.15.31:6835","nonce":2145345559}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4238,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/769669885","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":769669885},{"type":"v1","addr":"172.21.15.102:6836","nonce":769669885}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4273,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/3574076588","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":3574076588},{"type":"v1","addr":"172.21.15.102:6837","nonce":3574076588}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:50:16.436200+0000","modified":"2024-09-15T22:50:37.749651+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4281},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4281":{"gid":4281,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6834/2632823405","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":2632823405},{"type":"v1","addr":"172.21.15.31:6834","nonce":2632823405}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4281,"qdb_cluster":[4281]},"id":1}]} 2024-09-15T22:51:04.163 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 8 2024-09-15T22:51:04.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 msgr2=0x7fd888069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 0x7fd888069d80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd89c0ad000 tx=0x7fd89c008040 comp rx=0 tx=0).stop 2024-09-15T22:51:04.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 msgr2=0x7fd8ac15c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd89400c7f0 tx=0x7fd89400ccb0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 shutdown_connections 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8880678c0 0x7fd888069d80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8ac15f5e0 0x7fd8ac15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8ac155560 0x7fd8ac15c4c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 --2- 172.21.15.31:0/2383842430 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8ac06d210 0x7fd8ac0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 >> 172.21.15.31:0/2383842430 conn(0x7fd8ac072790 msgr2=0x7fd8ac160220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 shutdown_connections 2024-09-15T22:51:04.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.157+0000 7fd8b0e00640 1 -- 172.21.15.31:0/2383842430 wait complete. 2024-09-15T22:51:04.183 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:51:04.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.317+0000 7f59f1200640 1 Processor -- start 2024-09-15T22:51:04.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.317+0000 7f59f1200640 1 -- start start 2024-09-15T22:51:04.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59f1200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ec06f270 0x7f59ec06f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59f1200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f59ec0b47a0 0x7f59ec072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59f1200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec072aa0 con 0x7f59ec0726a0 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59f1200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec15ba60 con 0x7f59ec06f270 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59f1200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f59ec0affa0 con 0x7f59ec0b47a0 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ec06f270 0x7f59ec06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ec06f270 0x7f59ec06f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44186/0 (socket says 172.21.15.31:44186) 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 -- 172.21.15.31:0/4147805121 learned_addr learned my addr 172.21.15.31:0/4147805121 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:04.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e1400640 1 --2- 172.21.15.31:0/4147805121 >> v2:172.21.15.102:3300/0 conn(0x7f59ec0b47a0 0x7f59ec072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 -- 172.21.15.31:0/4147805121 >> v2:172.21.15.102:3300/0 conn(0x7f59ec0b47a0 msgr2=0x7f59ec072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:04.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 --2- 172.21.15.31:0/4147805121 >> v2:172.21.15.102:3300/0 conn(0x7f59ec0b47a0 0x7f59ec072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 -- 172.21.15.31:0/4147805121 >> v1:172.21.15.31:6789/0 conn(0x7f59ec0726a0 legacy=0x7f59ec15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9e00640 1 -- 172.21.15.31:0/4147805121 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec06fb90 con 0x7f59ec06f270 2024-09-15T22:51:04.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.321+0000 7f59e9400640 1 -- 172.21.15.31:0/4147805121 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1996605347 0 0) 0x7f59ec072aa0 con 0x7f59ec0726a0 2024-09-15T22:51:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59e9e00640 1 --2- 172.21.15.31:0/4147805121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec06f270 0x7f59ec06f650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59ec073580 tx=0x7f59dc01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620a004075067f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59e9400640 1 -- 172.21.15.31:0/4147805121 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0b4070 con 0x7f59ec06f270 2024-09-15T22:51:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59e9400640 1 -- 172.21.15.31:0/4147805121 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59dc0a7ad0 con 0x7f59ec06f270 2024-09-15T22:51:04.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59e9400640 1 -- 172.21.15.31:0/4147805121 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59dc0af440 con 0x7f59ec06f270 2024-09-15T22:51:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- 172.21.15.31:0/4147805121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec06f270 msgr2=0x7f59ec06f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 --2- 172.21.15.31:0/4147805121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec06f270 0x7f59ec06f650 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f59ec073580 tx=0x7f59dc01ebf0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- 172.21.15.31:0/4147805121 shutdown_connections 2024-09-15T22:51:04.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 --2- 172.21.15.31:0/4147805121 >> v2:172.21.15.102:3300/0 conn(0x7f59ec0b47a0 0x7f59ec072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 --2- 172.21.15.31:0/4147805121 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec06f270 0x7f59ec06f650 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- 172.21.15.31:0/4147805121 >> 172.21.15.31:0/4147805121 conn(0x7f59ec067e00 msgr2=0x7f59ec06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- 172.21.15.31:0/4147805121 shutdown_connections 2024-09-15T22:51:04.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- 172.21.15.31:0/4147805121 wait complete. 2024-09-15T22:51:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 Processor -- start 2024-09-15T22:51:04.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.325+0000 7f59f1200640 1 -- start start 2024-09-15T22:51:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ec06f270 0x7f59ec0a9f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ec0b47a0 0x7f59ec15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0b3fa0 con 0x7f59ec0726a0 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0b3cc0 con 0x7f59ec0b47a0 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec155a10 con 0x7f59ec06f270 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44192/0 (socket says 172.21.15.31:44192) 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 -- 172.21.15.31:0/3411487834 learned_addr learned my addr 172.21.15.31:0/3411487834 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e9e00640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ec06f270 0x7f59ec0a9f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59ea800640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ec0b47a0 0x7f59ec15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 -- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ec06f270 msgr2=0x7f59ec0a9f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ec06f270 0x7f59ec0a9f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 -- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ec0b47a0 msgr2=0x7f59ec15c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ec0b47a0 0x7f59ec15c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 -- 172.21.15.31:0/3411487834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec0aacd0 con 0x7f59ec0726a0 2024-09-15T22:51:04.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e1400640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59d400e9b0 tx=0x7f59d400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d4017070 con 0x7f59ec0726a0 2024-09-15T22:51:04.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d400c9a0 con 0x7f59ec0726a0 2024-09-15T22:51:04.335 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d400cd70 con 0x7f59ec0726a0 2024-09-15T22:51:04.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec0aafb0 con 0x7f59ec0726a0 2024-09-15T22:51:04.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec0ab570 con 0x7f59ec0726a0 2024-09-15T22:51:04.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec0b4bb0 con 0x7f59ec0726a0 2024-09-15T22:51:04.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.329+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59d401a070 con 0x7f59ec0726a0 2024-09-15T22:51:04.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.333+0000 7f59e2a00640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 0x7f59c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.333+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f59d4086520 con 0x7f59ec0726a0 2024-09-15T22:51:04.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.333+0000 7f59e9e00640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 0x7f59c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.333+0000 7f59e9e00640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 0x7f59c8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b1000 tx=0x7f59dc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.337+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59d4056c10 con 0x7f59ec0726a0 2024-09-15T22:51:04.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.501+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59ec15e610 con 0x7f59ec0726a0 2024-09-15T22:51:04.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59e2a00640 1 -- 172.21.15.31:0/3411487834 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+19044 (secure 0 0 0) 0x7f59d4056510 con 0x7f59ec0726a0 2024-09-15T22:51:04.509 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:04.509 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":27,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:50:59.420579+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:50:14.449269+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-15T22:50:15.442279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-15T22:50:19.335121+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.5","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.21","mappings":[{"from":5,"to":1}]},{"pgid":"3.38","mappings":[{"from":3,"to":2}]},{"pgid":"3.3b","mappings":[{"from":7,"to":1}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1f","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:51:04.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 msgr2=0x7f59c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 0x7f59c8069d80 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f59dc0b1000 tx=0x7f59dc008040 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 msgr2=0x7f59ec15bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f59d400e9b0 tx=0x7f59d400ee70 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 shutdown_connections 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59c80678c0 0x7f59c8069d80 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ec0b47a0 0x7f59ec15c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ec0726a0 0x7f59ec15bc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 --2- 172.21.15.31:0/3411487834 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ec06f270 0x7f59ec0a9f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 >> 172.21.15.31:0/3411487834 conn(0x7f59ec067e00 msgr2=0x7f59ec15d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 shutdown_connections 2024-09-15T22:51:04.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.505+0000 7f59f1200640 1 -- 172.21.15.31:0/3411487834 wait complete. 2024-09-15T22:51:04.531 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:51:04.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 Processor -- start 2024-09-15T22:51:04.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 -- start start 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f555813fa40 0x7f555813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555806e160 0x7f555806e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55581407b0 con 0x7f5558072160 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f555813f640 con 0x7f555806e160 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f555d400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f55581413c0 con 0x7f555813fa40 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f5557200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555806e160 0x7f555806e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f5557200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f555806e160 0x7f555806e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44208/0 (socket says 172.21.15.31:44208) 2024-09-15T22:51:04.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f5557200640 1 -- 172.21.15.31:0/646378196 learned_addr learned my addr 172.21.15.31:0/646378196 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:04.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.669+0000 7f5555e00640 1 --2- 172.21.15.31:0/646378196 >> v2:172.21.15.102:3300/0 conn(0x7f555813fa40 0x7f555813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5557200640 1 -- 172.21.15.31:0/646378196 >> v2:172.21.15.102:3300/0 conn(0x7f555813fa40 msgr2=0x7f555813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:04.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5557200640 1 --2- 172.21.15.31:0/646378196 >> v2:172.21.15.102:3300/0 conn(0x7f555813fa40 0x7f555813fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5557200640 1 -- 172.21.15.31:0/646378196 >> v1:172.21.15.102:6789/0 conn(0x7f5558072160 legacy=0x7f5558072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5557200640 1 -- 172.21.15.31:0/646378196 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5558140a90 con 0x7f555806e160 2024-09-15T22:51:04.679 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5557200640 1 --2- 172.21.15.31:0/646378196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555806e160 0x7f555806e5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f55580d03b0 tx=0x7f555001c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=452d633d38e83430 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5555400640 1 -- 172.21.15.31:0/646378196 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500a5710 con 0x7f555806e160 2024-09-15T22:51:04.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5555400640 1 -- 172.21.15.31:0/646378196 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55500a58b0 con 0x7f555806e160 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f5555400640 1 -- 172.21.15.31:0/646378196 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500a5c80 con 0x7f555806e160 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 -- 172.21.15.31:0/646378196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555806e160 msgr2=0x7f555806e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 --2- 172.21.15.31:0/646378196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555806e160 0x7f555806e5f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f55580d03b0 tx=0x7f555001c960 comp rx=0 tx=0).stop 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 -- 172.21.15.31:0/646378196 shutdown_connections 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 --2- 172.21.15.31:0/646378196 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555806e160 0x7f555806e5f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 --2- 172.21.15.31:0/646378196 >> v2:172.21.15.102:3300/0 conn(0x7f555813fa40 0x7f555813fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 -- 172.21.15.31:0/646378196 >> 172.21.15.31:0/646378196 conn(0x7f5558067e00 msgr2=0x7f555806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 -- 172.21.15.31:0/646378196 shutdown_connections 2024-09-15T22:51:04.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.673+0000 7f555d400640 1 -- 172.21.15.31:0/646378196 wait complete. 2024-09-15T22:51:04.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 Processor -- start 2024-09-15T22:51:04.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 -- start start 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 0x7f5558156770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5558072160 0x7f5558156de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5558168ee0 con 0x7f555813fa40 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5558168d60 con 0x7f5558072160 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5558169060 con 0x7f555806e160 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44218/0 (socket says 172.21.15.31:44218) 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 -- 172.21.15.31:0/1153657623 learned_addr learned my addr 172.21.15.31:0/1153657623 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:04.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5555e00640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5558072160 0x7f5558156de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5556800640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 0x7f5558156770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 -- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 msgr2=0x7f5558156770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 0x7f5558156770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 -- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5558072160 msgr2=0x7f5558156de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5558072160 0x7f5558156de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 -- 172.21.15.31:0/1153657623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55580af360 con 0x7f555813fa40 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5556800640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 0x7f5558156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f5557200640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5550019570 tx=0x7f5550019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500bc020 con 0x7f555813fa40 2024-09-15T22:51:04.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55500b8690 con 0x7f555813fa40 2024-09-15T22:51:04.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500b8a80 con 0x7f555813fa40 2024-09-15T22:51:04.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.677+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555815a220 con 0x7f555813fa40 2024-09-15T22:51:04.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f555815a7e0 con 0x7f555813fa40 2024-09-15T22:51:04.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f555815a040 con 0x7f555813fa40 2024-09-15T22:51:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f55500bf020 con 0x7f555813fa40 2024-09-15T22:51:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f554ea00640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 0x7f5538069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6793+0+0 (secure 0 0 0) 0x7f5550121190 con 0x7f555813fa40 2024-09-15T22:51:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.681+0000 7f5556800640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 0x7f5538069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:04.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.685+0000 7f5556800640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 0x7f5538069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5548001710 tx=0x7f5548009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:04.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.685+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f555815a040 con 0x7f555813fa40 2024-09-15T22:51:04.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.885+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f555806e5f0 con 0x7f555813fa40 2024-09-15T22:51:04.892 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-15T22:51:04.889+0000 7f89b4600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:51:04.895 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.889+0000 7f554ea00640 1 -- 172.21.15.31:0/1153657623 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) ==== 161+0+0 (secure 0 0 0) 0x7f55500c6030 con 0x7f555813fa40 2024-09-15T22:51:04.895 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 msgr2=0x7f5538069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 0x7f5538069d80 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5548001710 tx=0x7f5548009040 comp rx=0 tx=0).stop 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 msgr2=0x7f5558157320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5550019570 tx=0x7f5550019700 comp rx=0 tx=0).stop 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 shutdown_connections 2024-09-15T22:51:04.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f55380678c0 0x7f5538069d80 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f555813fa40 0x7f5558157320 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5558072160 0x7f5558156de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 --2- 172.21.15.31:0/1153657623 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f555806e160 0x7f5558156770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 >> 172.21.15.31:0/1153657623 conn(0x7f5558067e00 msgr2=0x7f55580b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 shutdown_connections 2024-09-15T22:51:04.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:04.893+0000 7f555d400640 1 -- 172.21.15.31:0/1153657623 wait complete. 2024-09-15T22:51:04.906 INFO:tasks.ceph.mds.c.smithi031.stderr: -4450> 2024-09-15T22:50:21.010+0000 7f54ac200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:51:04.922 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:51:04.960 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:51:05.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.061+0000 7f04e9200640 1 Processor -- start 2024-09-15T22:51:05.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.061+0000 7f04e9200640 1 -- start start 2024-09-15T22:51:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e9200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f04e40b6f90 0x7f04e40d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e9200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f04e40b73f0 0x7f04e40d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e9200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04e40d13a0 con 0x7f04e4159c10 2024-09-15T22:51:05.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e9200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f04e4159ff0 con 0x7f04e40b73f0 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e9200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f04e4071f60 con 0x7f04e40b6f90 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e3400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f04e4159c10 0x7f04e40717a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42240/0 (socket says 172.21.15.31:42240) 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e3400640 1 -- 172.21.15.31:0/3888642811 learned_addr learned my addr 172.21.15.31:0/3888642811 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3888642811 >> v2:172.21.15.102:3300/0 conn(0x7f04e40b6f90 0x7f04e40d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e3e00640 1 --2- 172.21.15.31:0/3888642811 >> v2:172.21.15.31:3300/0 conn(0x7f04e40b73f0 0x7f04e40d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2000640 1 -- 172.21.15.31:0/3888642811 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526957705 0 0) 0x7f04e40d13a0 con 0x7f04e4159c10 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2000640 1 -- 172.21.15.31:0/3888642811 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04c8003530 con 0x7f04e4159c10 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2a00640 1 -- 172.21.15.31:0/3888642811 >> v2:172.21.15.31:3300/0 conn(0x7f04e40b73f0 msgr2=0x7f04e40d0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3888642811 >> v2:172.21.15.31:3300/0 conn(0x7f04e40b73f0 0x7f04e40d0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2a00640 1 -- 172.21.15.31:0/3888642811 >> v1:172.21.15.31:6789/0 conn(0x7f04e4159c10 legacy=0x7f04e40717a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.065+0000 7f04e2a00640 1 -- 172.21.15.31:0/3888642811 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e4072240 con 0x7f04e40b6f90 2024-09-15T22:51:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3888642811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e40d0920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04e40d20d0 tx=0x7f04d001c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17b1f9acec360cf7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e2000640 1 -- 172.21.15.31:0/3888642811 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b1070 con 0x7f04e40b6f90 2024-09-15T22:51:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e2000640 1 -- 172.21.15.31:0/3888642811 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00ac5f0 con 0x7f04e40b6f90 2024-09-15T22:51:05.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e2000640 1 -- 172.21.15.31:0/3888642811 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00ac9a0 con 0x7f04e40b6f90 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- 172.21.15.31:0/3888642811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 msgr2=0x7f04e40d0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 --2- 172.21.15.31:0/3888642811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e40d0920 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04e40d20d0 tx=0x7f04d001c480 comp rx=0 tx=0).stop 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- 172.21.15.31:0/3888642811 shutdown_connections 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 --2- 172.21.15.31:0/3888642811 >> v2:172.21.15.31:3300/0 conn(0x7f04e40b73f0 0x7f04e40d0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 --2- 172.21.15.31:0/3888642811 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e40d0920 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- 172.21.15.31:0/3888642811 >> 172.21.15.31:0/3888642811 conn(0x7f04e406ffb0 msgr2=0x7f04e40703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:05.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- 172.21.15.31:0/3888642811 shutdown_connections 2024-09-15T22:51:05.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- 172.21.15.31:0/3888642811 wait complete. 2024-09-15T22:51:05.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 Processor -- start 2024-09-15T22:51:05.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.069+0000 7f04e9200640 1 -- start start 2024-09-15T22:51:05.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e4150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 0x7f04e4153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f04e415d130 con 0x7f04e40b73f0 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f04e415cfb0 con 0x7f04e40b6f90 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f04e415d2b0 con 0x7f04e4159c10 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38846/0 (socket says 172.21.15.31:38846) 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 -- 172.21.15.31:0/3508188578 learned_addr learned my addr 172.21.15.31:0/3508188578 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e3400640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e4150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 -- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 msgr2=0x7f04e4153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e3e00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 0x7f04e4153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 0x7f04e4153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 -- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 msgr2=0x7f04e4150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e4150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 -- 172.21.15.31:0/3508188578 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04e4153590 con 0x7f04e40b73f0 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e3e00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 0x7f04e4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e3400640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e4150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e2a00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c10 tx=0x7f04d0019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:05.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00bb070 con 0x7f04e40b73f0 2024-09-15T22:51:05.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04d00ac9a0 con 0x7f04e40b73f0 2024-09-15T22:51:05.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d00b1040 con 0x7f04e40b73f0 2024-09-15T22:51:05.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 -- 172.21.15.31:0/3508188578 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04e4150c20 con 0x7f04e40b73f0 2024-09-15T22:51:05.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04e9200640 1 -- 172.21.15.31:0/3508188578 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04e41511e0 con 0x7f04e40b73f0 2024-09-15T22:51:05.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e40717a0 con 0x7f04e40b73f0 2024-09-15T22:51:05.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.073+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f04d00ac470 con 0x7f04e40b73f0 2024-09-15T22:51:05.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.077+0000 7f04db400640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:05.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.077+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6879+0+0 (secure 0 0 0) 0x7f04d011ef80 con 0x7f04e40b73f0 2024-09-15T22:51:05.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.077+0000 7f04e3400640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:05.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.077+0000 7f04e3400640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 0x7f04c4069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f04d4005890 tx=0x7f04d4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:05.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.081+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f04d00a9070 con 0x7f04e40b73f0 2024-09-15T22:51:05.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.281+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f04e4070d80 con 0x7f04e40b73f0 2024-09-15T22:51:05.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04db400640 1 -- 172.21.15.31:0/3508188578 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) ==== 104+0+0 (secure 0 0 0) 0x7f04d0016070 con 0x7f04e40b73f0 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 msgr2=0x7f04c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 0x7f04c4069d80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f04d4005890 tx=0x7f04d4009040 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 msgr2=0x7f04e415bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f04d0000c10 tx=0x7f04d0019220 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 shutdown_connections 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f04c40678c0 0x7f04c4069d80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f04e4159c10 0x7f04e4153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f04e40b73f0 0x7f04e415bce0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 --2- 172.21.15.31:0/3508188578 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f04e40b6f90 0x7f04e4150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:05.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.893+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 >> 172.21.15.31:0/3508188578 conn(0x7f04e406ffb0 msgr2=0x7f04e4155bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:05.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.897+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 shutdown_connections 2024-09-15T22:51:05.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:05.897+0000 7f04d8c00640 1 -- 172.21.15.31:0/3508188578 wait complete. 2024-09-15T22:51:05.925 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:51:06.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 Processor -- start 2024-09-15T22:51:06.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 -- start start 2024-09-15T22:51:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f242415ed40 0x7f24240d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24240ce310 con 0x7f24241522d0 2024-09-15T22:51:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f24240d0a00 con 0x7f242415ed40 2024-09-15T22:51:06.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.117+0000 7f242ae00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f242415f1d0 con 0x7f24240d05b0 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:44852/0 (socket says 172.21.15.31:44852) 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 -- 172.21.15.31:0/1652290361 learned_addr learned my addr 172.21.15.31:0/1652290361 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f241be00640 1 --2- 172.21.15.31:0/1652290361 >> v2:172.21.15.102:3300/0 conn(0x7f242415ed40 0x7f24240d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 -- 172.21.15.31:0/1652290361 >> v2:172.21.15.102:3300/0 conn(0x7f242415ed40 msgr2=0x7f24240d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 --2- 172.21.15.31:0/1652290361 >> v2:172.21.15.102:3300/0 conn(0x7f242415ed40 0x7f24240d0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 -- 172.21.15.31:0/1652290361 >> v1:172.21.15.102:6789/0 conn(0x7f24241522d0 legacy=0x7f24240b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 -- 172.21.15.31:0/1652290361 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24240ce5f0 con 0x7f24240d05b0 2024-09-15T22:51:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.121+0000 7f2428e00640 1 --2- 172.21.15.31:0/1652290361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f241c00d150 tx=0x7f241c01ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e4ae992d72e80b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f2423400640 1 -- 172.21.15.31:0/1652290361 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c00b2d0 con 0x7f24240d05b0 2024-09-15T22:51:06.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f2423400640 1 -- 172.21.15.31:0/1652290361 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f241c00b470 con 0x7f24240d05b0 2024-09-15T22:51:06.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f2423400640 1 -- 172.21.15.31:0/1652290361 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f241c0a7b10 con 0x7f24240d05b0 2024-09-15T22:51:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- 172.21.15.31:0/1652290361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 msgr2=0x7f242415baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- 172.21.15.31:0/1652290361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f241c00d150 tx=0x7f241c01ec30 comp rx=0 tx=0).stop 2024-09-15T22:51:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- 172.21.15.31:0/1652290361 shutdown_connections 2024-09-15T22:51:06.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- 172.21.15.31:0/1652290361 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f242415baa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- 172.21.15.31:0/1652290361 >> v2:172.21.15.102:3300/0 conn(0x7f242415ed40 0x7f24240d0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- 172.21.15.31:0/1652290361 >> 172.21.15.31:0/1652290361 conn(0x7f242406be90 msgr2=0x7f242406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- 172.21.15.31:0/1652290361 shutdown_connections 2024-09-15T22:51:06.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- 172.21.15.31:0/1652290361 wait complete. 2024-09-15T22:51:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 Processor -- start 2024-09-15T22:51:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- start start 2024-09-15T22:51:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f24240ad030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f242415ed40 0x7f24240ae760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f24240b3230 con 0x7f24241522d0 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f24240cdfe0 con 0x7f242415ed40 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f242ae00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24240b33b0 con 0x7f24240d05b0 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f241be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f241be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38860/0 (socket says 172.21.15.31:38860) 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f2423e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f24240ad030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f241be00640 1 -- 172.21.15.31:0/1232622252 learned_addr learned my addr 172.21.15.31:0/1232622252 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.125+0000 7f2428e00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f242415ed40 0x7f24240ae760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 -- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 msgr2=0x7f24240ad030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f24240ad030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 -- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f242415ed40 msgr2=0x7f24240ae760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f242415ed40 0x7f24240ae760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 -- 172.21.15.31:0/1232622252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24240ad6c0 con 0x7f24241522d0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2423e00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f24240ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f241be00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f240c00e930 tx=0x7f240c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c017070 con 0x7f24241522d0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f240c00ca00 con 0x7f24241522d0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24240ad9a0 con 0x7f24241522d0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f240c00cdb0 con 0x7f24241522d0 2024-09-15T22:51:06.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24240adf60 con 0x7f24241522d0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242415baa0 con 0x7f24241522d0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f240c01a070 con 0x7f24241522d0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 0x7f2400069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6879+0+0 (secure 0 0 0) 0x7f240c086520 con 0x7f24241522d0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.129+0000 7f2423e00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 0x7f2400069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.133+0000 7f2423e00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 0x7f2400069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2414001c00 tx=0x7f2414009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:06.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.133+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f240c0565a0 con 0x7f24241522d0 2024-09-15T22:51:06.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.305+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f24240cfc90 con 0x7f24241522d0 2024-09-15T22:51:06.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f2420c00640 1 -- 172.21.15.31:0/1232622252 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f240c05a8a0 con 0x7f24241522d0 2024-09-15T22:51:06.901 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:51:06.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 msgr2=0x7f2400069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 0x7f2400069d80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2414001c00 tx=0x7f2414009040 comp rx=0 tx=0).stop 2024-09-15T22:51:06.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 msgr2=0x7f242414cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f240c00e930 tx=0x7f240c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 shutdown_connections 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f24000678c0 0x7f2400069d80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f242415ed40 0x7f24240ae760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f24241522d0 0x7f242414cc60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 --2- 172.21.15.31:0/1232622252 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f24240d05b0 0x7f24240ad030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 >> 172.21.15.31:0/1232622252 conn(0x7f242406be90 msgr2=0x7f24241505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 shutdown_connections 2024-09-15T22:51:06.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:06.897+0000 7f242ae00640 1 -- 172.21.15.31:0/1232622252 wait complete. 2024-09-15T22:51:06.929 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:51:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 Processor -- start 2024-09-15T22:51:07.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 -- start start 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0c8c06ff20 0x7f0c8c166e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c156d20 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c8c0b40c0 con 0x7f0c8c0d0010 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c93e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0c8c0b43a0 con 0x7f0c8c06ff20 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0c8c15c8d0 0x7f0c8c0b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42256/0 (socket says 172.21.15.31:42256) 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91400640 1 -- 172.21.15.31:0/1519197395 learned_addr learned my addr 172.21.15.31:0/1519197395 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:07.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91e00640 1 --2- 172.21.15.31:0/1519197395 >> v2:172.21.15.31:3300/0 conn(0x7f0c8c06ff20 0x7f0c8c166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c8be00640 1 -- 172.21.15.31:0/1519197395 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 58397980 0 0) 0x7f0c8c156d20 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c8be00640 1 -- 172.21.15.31:0/1519197395 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c74003530 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91e00640 1 -- 172.21.15.31:0/1519197395 >> v1:172.21.15.102:6789/0 conn(0x7f0c8c0d0010 legacy=0x7f0c8c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91e00640 1 -- 172.21.15.31:0/1519197395 >> v1:172.21.15.31:6789/0 conn(0x7f0c8c15c8d0 legacy=0x7f0c8c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.073+0000 7f0c91e00640 1 -- 172.21.15.31:0/1519197395 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0b4680 con 0x7f0c8c06ff20 2024-09-15T22:51:07.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c91e00640 1 --2- 172.21.15.31:0/1519197395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c06ff20 0x7f0c8c166e90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49c4cbaf07549a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c8be00640 1 -- 172.21.15.31:0/1519197395 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840b2070 con 0x7f0c8c06ff20 2024-09-15T22:51:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c8be00640 1 -- 172.21.15.31:0/1519197395 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c840a5910 con 0x7f0c8c06ff20 2024-09-15T22:51:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c8be00640 1 -- 172.21.15.31:0/1519197395 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840a5cc0 con 0x7f0c8c06ff20 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- 172.21.15.31:0/1519197395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c06ff20 msgr2=0x7f0c8c166e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 --2- 172.21.15.31:0/1519197395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c06ff20 0x7f0c8c166e90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401c940 comp rx=0 tx=0).stop 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- 172.21.15.31:0/1519197395 shutdown_connections 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 --2- 172.21.15.31:0/1519197395 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c06ff20 0x7f0c8c166e90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- 172.21.15.31:0/1519197395 >> 172.21.15.31:0/1519197395 conn(0x7f0c8c06be90 msgr2=0x7f0c8c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- 172.21.15.31:0/1519197395 shutdown_connections 2024-09-15T22:51:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- 172.21.15.31:0/1519197395 wait complete. 2024-09-15T22:51:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 Processor -- start 2024-09-15T22:51:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.077+0000 7f0c93e00640 1 -- start start 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 0x7f0c8c14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c8c0d0010 0x7f0c8c0add50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c169f80 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c8c169e00 con 0x7f0c8c0d0010 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c8c16a100 con 0x7f0c8c06ff20 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38866/0 (socket says 172.21.15.31:38866) 2024-09-15T22:51:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 -- 172.21.15.31:0/3946200722 learned_addr learned my addr 172.21.15.31:0/3946200722 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91400640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 0x7f0c8c14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c90a00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c8c0d0010 0x7f0c8c0add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 -- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 msgr2=0x7f0c8c14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 0x7f0c8c14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 -- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c8c0d0010 msgr2=0x7f0c8c0add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c8c0d0010 0x7f0c8c0add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 -- 172.21.15.31:0/3946200722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c8c0ae6c0 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91400640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 0x7f0c8c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c91e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c840b0040 tx=0x7f0c840196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840b2050 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c840b3040 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c840ad850 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c8c09c5d0 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c8c09cb90 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.081+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c8c15ccb0 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.085+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c840c0020 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.085+0000 7f0c89600640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.085+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6441+0+0 (secure 0 0 0) 0x7f0c84120830 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.085+0000 7f0c91400640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.085+0000 7f0c91400640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 0x7f0c6c069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c80005890 tx=0x7f0c80009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.089+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c84016560 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.252+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0c8c0b2540 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.896+0000 7f0c89600640 1 -- 172.21.15.31:0/3946200722 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f0c840f11a0 con 0x7f0c8c15c8d0 2024-09-15T22:51:07.903 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 msgr2=0x7f0c6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 0x7f0c6c069d80 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0c80005890 tx=0x7f0c80009040 comp rx=0 tx=0).stop 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 msgr2=0x7f0c8c155330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0c840b0040 tx=0x7f0c840196e0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 shutdown_connections 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c6c0678c0 0x7f0c6c069d80 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c8c15c8d0 0x7f0c8c155330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c8c0d0010 0x7f0c8c0add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 --2- 172.21.15.31:0/3946200722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c8c06ff20 0x7f0c8c14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:07.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 >> 172.21.15.31:0/3946200722 conn(0x7f0c8c06be90 msgr2=0x7f0c8c06f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:07.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 shutdown_connections 2024-09-15T22:51:07.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:07.900+0000 7f0c93e00640 1 -- 172.21.15.31:0/3946200722 wait complete. 2024-09-15T22:51:07.928 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-15T22:51:08.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 Processor -- start 2024-09-15T22:51:08.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 -- start start 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbac815abd0 0x7fbac80b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 0x7fbac80ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac80cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fbac80b3fe0 con 0x7fbac815abd0 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbac80b3050 con 0x7fbac8071ef0 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbace600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbac80b3610 con 0x7fbac8072330 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbac7400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbac815abd0 0x7fbac80b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbac7400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fbac815abd0 0x7fbac80b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38876/0 (socket says 172.21.15.31:38876) 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.068+0000 7fbac7400640 1 -- 172.21.15.31:0/4291023346 learned_addr learned my addr 172.21.15.31:0/4291023346 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:08.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7e00640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac80cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 -- 172.21.15.31:0/4291023346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 msgr2=0x7fbac80cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac80cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 -- 172.21.15.31:0/4291023346 >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 msgr2=0x7fbac80ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbabea00640 1 --2- 172.21.15.31:0/4291023346 >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 0x7fbac80ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 --2- 172.21.15.31:0/4291023346 >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 0x7fbac80ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 -- 172.21.15.31:0/4291023346 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac8073a50 con 0x7fbac815abd0 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7e00640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:08.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbabea00640 1 --2- 172.21.15.31:0/4291023346 >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 0x7fbac80ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:08.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac7400640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac815abd0 0x7fbac80b3aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbac80cfcc0 tx=0x7fbab801d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b85d59870fd2577 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac6a00640 1 -- 172.21.15.31:0/4291023346 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80ac650 con 0x7fbac815abd0 2024-09-15T22:51:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac6a00640 1 -- 172.21.15.31:0/4291023346 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab80b1070 con 0x7fbac815abd0 2024-09-15T22:51:08.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbac6a00640 1 -- 172.21.15.31:0/4291023346 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80aca10 con 0x7fbac815abd0 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 -- 172.21.15.31:0/4291023346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac815abd0 msgr2=0x7fbac80b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac815abd0 0x7fbac80b3aa0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fbac80cfcc0 tx=0x7fbab801d630 comp rx=0 tx=0).stop 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 -- 172.21.15.31:0/4291023346 shutdown_connections 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac80cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 --2- 172.21.15.31:0/4291023346 >> v2:172.21.15.102:3300/0 conn(0x7fbac8071ef0 0x7fbac80ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 --2- 172.21.15.31:0/4291023346 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac815abd0 0x7fbac80b3aa0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.072+0000 7fbace600640 1 -- 172.21.15.31:0/4291023346 >> 172.21.15.31:0/4291023346 conn(0x7fbac806be90 msgr2=0x7fbac806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- 172.21.15.31:0/4291023346 shutdown_connections 2024-09-15T22:51:08.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- 172.21.15.31:0/4291023346 wait complete. 2024-09-15T22:51:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 Processor -- start 2024-09-15T22:51:08.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- start start 2024-09-15T22:51:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac81faf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac815abd0 0x7fbac8153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbac80b4f30 con 0x7fbac8071ef0 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbac80b4db0 con 0x7fbac815abd0 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbac806de70 con 0x7fbac8072330 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38886/0 (socket says 172.21.15.31:38886) 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 -- 172.21.15.31:0/1361340516 learned_addr learned my addr 172.21.15.31:0/1361340516 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 -- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 msgr2=0x7fbac81faf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:08.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac81faf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 -- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac815abd0 msgr2=0x7fbac8153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac815abd0 0x7fbac8153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 -- 172.21.15.31:0/1361340516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac81fb480 con 0x7fbac8071ef0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbac7400640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbab80ae040 tx=0x7fbab801a3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80b5620 con 0x7fbac8071ef0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbab80bc070 con 0x7fbac8071ef0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac80add80 con 0x7fbac8071ef0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.076+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80b5a20 con 0x7fbac8071ef0 2024-09-15T22:51:08.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac80ae340 con 0x7fbac8071ef0 2024-09-15T22:51:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac80b3aa0 con 0x7fbac8071ef0 2024-09-15T22:51:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbab80b5bc0 con 0x7fbac8071ef0 2024-09-15T22:51:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbabfe00640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 0x7fbaa4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7fbab81200d0 con 0x7fbac8071ef0 2024-09-15T22:51:08.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbabea00640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 0x7fbaa4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:08.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.080+0000 7fbabea00640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 0x7fbaa4069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbac81fa4e0 tx=0x7fbab0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:08.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.084+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbab8017220 con 0x7fbac8071ef0 2024-09-15T22:51:08.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.252+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbac806f230 con 0x7fbac8071ef0 2024-09-15T22:51:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.904+0000 7fbabfe00640 1 -- 172.21.15.31:0/1361340516 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7fbab80f0ae0 con 0x7fbac8071ef0 2024-09-15T22:51:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data_ec' removed 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 msgr2=0x7fbaa4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 0x7fbaa4069d80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbac81fa4e0 tx=0x7fbab0008040 comp rx=0 tx=0).stop 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 msgr2=0x7fbac81f6970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbab80ae040 tx=0x7fbab801a3d0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 shutdown_connections 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbaa40678c0 0x7fbaa4069d80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbac815abd0 0x7fbac8153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbac8072330 0x7fbac81faf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 --2- 172.21.15.31:0/1361340516 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbac8071ef0 0x7fbac81f6970 secure :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbab80ae040 tx=0x7fbab801a3d0 comp rx=0 tx=0).stop 2024-09-15T22:51:08.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 >> 172.21.15.31:0/1361340516 conn(0x7fbac806be90 msgr2=0x7fbac806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:08.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 shutdown_connections 2024-09-15T22:51:08.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:08.908+0000 7fbace600640 1 -- 172.21.15.31:0/1361340516 wait complete. 2024-09-15T22:51:08.938 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:51:08.939 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:51:08.939 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:51:08.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:08.939 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:51:08.939 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:51:08.939 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:51:08.940 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:08.940 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:51:08.940 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:51:08.940 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:51:08.940 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:08.940 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:51:08.940 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:51:08.941 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:51:08.941 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:08.953 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:51:08.953 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:51:08.955 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:51:08.955 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:51:08.957 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:51:08.957 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:51:08.958 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:51:08.958 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:51:08.999 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:51:08.999 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:09.000 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:51:09.001 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:09.006 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:51:09.006 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:09.007 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:51:09.007 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:09.008 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:51:09.097 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:51:09.098 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:51:09.099 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-15T22:51:09.100 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-15T22:51:09.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 Processor -- start 2024-09-15T22:51:09.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 -- start start 2024-09-15T22:51:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcb4c0b47a0 0x7fcb4c072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb4c072ad0 con 0x7fcb4c06f270 2024-09-15T22:51:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcb4c15ba60 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb54800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c0affa0 con 0x7fcb4c0726a0 2024-09-15T22:51:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb51400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcb4c0b47a0 0x7fcb4c072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb51e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fcb4c06f270 0x7fcb4c06f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:52660/0 (socket says 172.21.15.31:52660) 2024-09-15T22:51:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb51e00640 1 -- 172.21.15.31:0/412556286 learned_addr learned my addr 172.21.15.31:0/412556286 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:09.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.156+0000 7fcb52800640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb50a00640 1 -- 172.21.15.31:0/412556286 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231473222 0 0) 0x7fcb4c072ad0 con 0x7fcb4c06f270 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb51400640 1 -- 172.21.15.31:0/412556286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 msgr2=0x7fcb4c15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb51400640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c15c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb51400640 1 -- 172.21.15.31:0/412556286 >> v1:172.21.15.102:6789/0 conn(0x7fcb4c06f270 legacy=0x7fcb4c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb51400640 1 -- 172.21.15.31:0/412556286 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c072d40 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb52800640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb51400640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c072160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097c0 tx=0x7fcb3c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=741bfa0b610be92b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb50a00640 1 -- 172.21.15.31:0/412556286 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0b2070 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb50a00640 1 -- 172.21.15.31:0/412556286 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb3c0ad640 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb50a00640 1 -- 172.21.15.31:0/412556286 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c0ada10 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 -- 172.21.15.31:0/412556286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c0b47a0 msgr2=0x7fcb4c072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c072160 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0097c0 tx=0x7fcb3c01c4a0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 -- 172.21.15.31:0/412556286 shutdown_connections 2024-09-15T22:51:09.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c15c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 --2- 172.21.15.31:0/412556286 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c072160 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 -- 172.21.15.31:0/412556286 >> 172.21.15.31:0/412556286 conn(0x7fcb4c067e00 msgr2=0x7fcb4c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 -- 172.21.15.31:0/412556286 shutdown_connections 2024-09-15T22:51:09.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.160+0000 7fcb54800640 1 -- 172.21.15.31:0/412556286 wait complete. 2024-09-15T22:51:09.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 Processor -- start 2024-09-15T22:51:09.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 -- start start 2024-09-15T22:51:09.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c0b4c30 con 0x7fcb4c06f270 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4c155a10 con 0x7fcb4c0b47a0 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcb4c1fa8f0 con 0x7fcb4c0726a0 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38944/0 (socket says 172.21.15.31:38944) 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 -- 172.21.15.31:0/1922868962 learned_addr learned my addr 172.21.15.31:0/1922868962 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51400640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb52800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 -- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 msgr2=0x7fcb4c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 -- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4c0b47a0 msgr2=0x7fcb4c145500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c145500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 -- 172.21.15.31:0/1922868962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c1fab40 con 0x7fcb4c06f270 2024-09-15T22:51:09.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb51e00640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c410 tx=0x7fcb4000c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40017070 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb40005d10 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb40007310 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.164+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb4c1fae20 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb4c1fb3e0 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb4c15d190 con 0x7fcb4c06f270 2024-09-15T22:51:09.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcb4001a070 con 0x7fcb4c06f270 2024-09-15T22:51:09.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb46000640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 0x7fcb30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:09.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5335+0+0 (secure 0 0 0) 0x7fcb40084e40 con 0x7fcb4c06f270 2024-09-15T22:51:09.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.168+0000 7fcb51400640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 0x7fcb30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:09.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.172+0000 7fcb51400640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 0x7fcb30069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0af000 tx=0x7fcb3c0a7070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:09.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.172+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcb40055400 con 0x7fcb4c06f270 2024-09-15T22:51:09.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.352+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fcb4c0b2110 con 0x7fcb4c06f270 2024-09-15T22:51:09.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.920+0000 7fcb46000640 1 -- 172.21.15.31:0/1922868962 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) ==== 97+0+0 (secure 0 0 0) 0x7fcb40059700 con 0x7fcb4c06f270 2024-09-15T22:51:09.923 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-15T22:51:09.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 msgr2=0x7fcb30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 0x7fcb30069d80 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c0af000 tx=0x7fcb3c0a7070 comp rx=0 tx=0).stop 2024-09-15T22:51:09.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 msgr2=0x7fcb4c15a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcb4000c410 tx=0x7fcb4000c810 comp rx=0 tx=0).stop 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 shutdown_connections 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcb300678c0 0x7fcb30069d80 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcb4c0b47a0 0x7fcb4c145500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcb4c0726a0 0x7fcb4c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 --2- 172.21.15.31:0/1922868962 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcb4c06f270 0x7fcb4c15a800 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 >> 172.21.15.31:0/1922868962 conn(0x7fcb4c067e00 msgr2=0x7fcb4c15e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 shutdown_connections 2024-09-15T22:51:09.927 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:09.924+0000 7fcb54800640 1 -- 172.21.15.31:0/1922868962 wait complete. 2024-09-15T22:51:09.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:51:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 Processor -- start 2024-09-15T22:51:10.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 -- start start 2024-09-15T22:51:10.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 0x7fd2d80d0300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d80718b0 con 0x7fd2d80d09c0 2024-09-15T22:51:10.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d8071b90 con 0x7fd2d815e530 2024-09-15T22:51:10.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d815e910 con 0x7fd2d80d1540 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2de000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2d80d09c0 0x7fd2d806fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42274/0 (socket says 172.21.15.31:42274) 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2de000640 1 -- 172.21.15.31:0/2673073240 learned_addr learned my addr 172.21.15.31:0/2673073240 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dcc00640 1 --2- 172.21.15.31:0/2673073240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 0x7fd2d80d0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411423796 0 0) 0x7fd2d80718b0 con 0x7fd2d80d09c0 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2c0003530 con 0x7fd2d80d09c0 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3271641338 0 0) 0x7fd2d8071b90 con 0x7fd2d815e530 2024-09-15T22:51:10.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dcc00640 1 -- 172.21.15.31:0/2673073240 >> v1:172.21.15.102:6789/0 conn(0x7fd2d815e530 legacy=0x7fd2d80d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dcc00640 1 -- 172.21.15.31:0/2673073240 >> v1:172.21.15.31:6789/0 conn(0x7fd2d80d09c0 legacy=0x7fd2d806fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.096+0000 7fd2dcc00640 1 -- 172.21.15.31:0/2673073240 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8071e70 con 0x7fd2d80d1540 2024-09-15T22:51:10.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dcc00640 1 --2- 172.21.15.31:0/2673073240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 0x7fd2d80d0300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097f0 tx=0x7fd2c401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=719879275c13f8af server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40ab640 con 0x7fd2d80d1540 2024-09-15T22:51:10.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c40b0070 con 0x7fd2d80d1540 2024-09-15T22:51:10.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2d7e00640 1 -- 172.21.15.31:0/2673073240 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40aba00 con 0x7fd2d80d1540 2024-09-15T22:51:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 -- 172.21.15.31:0/2673073240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 msgr2=0x7fd2d80d0300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 --2- 172.21.15.31:0/2673073240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 0x7fd2d80d0300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097f0 tx=0x7fd2c401c4b0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 -- 172.21.15.31:0/2673073240 shutdown_connections 2024-09-15T22:51:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 --2- 172.21.15.31:0/2673073240 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d80d1540 0x7fd2d80d0300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 -- 172.21.15.31:0/2673073240 >> 172.21.15.31:0/2673073240 conn(0x7fd2d80b3f20 msgr2=0x7fd2d80b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 -- 172.21.15.31:0/2673073240 shutdown_connections 2024-09-15T22:51:10.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.100+0000 7fd2dea00640 1 -- 172.21.15.31:0/2673073240 wait complete. 2024-09-15T22:51:10.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 Processor -- start 2024-09-15T22:51:10.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- start start 2024-09-15T22:51:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d80d09c0 0x7fd2d8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815e530 0x7fd2d815d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d816bf60 con 0x7fd2d80d1540 2024-09-15T22:51:10.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d816bde0 con 0x7fd2d80d09c0 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d816c0e0 con 0x7fd2d815e530 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38952/0 (socket says 172.21.15.31:38952) 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 -- 172.21.15.31:0/3064548398 learned_addr learned my addr 172.21.15.31:0/3064548398 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2de000640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815e530 0x7fd2d815d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dd600640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d80d09c0 0x7fd2d8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 -- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815e530 msgr2=0x7fd2d815d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815e530 0x7fd2d815d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 -- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d80d09c0 msgr2=0x7fd2d8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d80d09c0 0x7fd2d8157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 -- 172.21.15.31:0/3064548398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d815ffb0 con 0x7fd2d80d1540 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dcc00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097f0 tx=0x7fd2c401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40abe60 con 0x7fd2d80d1540 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c4004020 con 0x7fd2d80d1540 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c4004410 con 0x7fd2d80d1540 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d8160290 con 0x7fd2d80d1540 2024-09-15T22:51:10.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d8160850 con 0x7fd2d80d1540 2024-09-15T22:51:10.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.104+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d80d0300 con 0x7fd2d80d1540 2024-09-15T22:51:10.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.108+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2c40bd030 con 0x7fd2d80d1540 2024-09-15T22:51:10.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.108+0000 7fd2d5600640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.108+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd2c411fe30 con 0x7fd2d80d1540 2024-09-15T22:51:10.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.108+0000 7fd2dd600640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.108+0000 7fd2dd600640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc000f70 tx=0x7fd2cc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.114 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.112+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2c40160d0 con 0x7fd2d80d1540 2024-09-15T22:51:10.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.332+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fd2d80b7500 con 0x7fd2d80d1540 2024-09-15T22:51:10.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2d5600640 1 -- 172.21.15.31:0/3064548398 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) ==== 80+0+6645 (secure 0 0 0) 0x7fd2c40f04d0 con 0x7fd2d80d1540 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdm9BbzFBAAh2krY1L9Wkr95inp5Aq6bg==", 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmhB0FIRAA3mEZDlQgVAwlFjGHz574fA==", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:51:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmRk8cHBAAeqI7fUCoJV3gJg9Oioc5Tg==", 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-15T22:51:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmUJQsKBAAJ3V6BnnIR6KNLPHZE/DDwg==", 2024-09-15T22:51:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBvZOdmx3vuLhAA7zs4BxFmuT8des6sufICgg==", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzZOdmVDxwChAAQu6SLevRyCQETBSsTxQ5dA==", 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB2ZOdm7WMnIBAA0d3cDV8zSeyZYMz980Onug==", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB6ZOdmoV/nChAA3ATYaJdz/3xyw7fRhXUPRQ==", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCAZOdmMamwDxAAvnLbvnUZouVSVp/Ga8akcg==", 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-15T22:51:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCDZOdmicPoJhAA+L3TkVT/ou/gTr/l3oewUQ==", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCGZOdmXnN5OhAA9yDDXVneKaH4xm9sV06sZQ==", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCKZOdmK/adFBAAEPOZtpFn//S8b6bSnd+u6A==", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg==", 2024-09-15T22:51:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmhs+UNRAAaXrMB5Y6bgHy3AjQj15MAg==", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:51:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmCeb6MRAAE7MMgVGIePOdK09iw/Ktfw==", 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:51:10.348 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmYLZ2OxAAkWX7K+9kTnOFWCNklDBCzQ==", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBrZOdm5W5PNBAAibGzoYys78utbVT7wdYKJg==", 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mds", 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmmqeGHhAAWelUKCq/D4gr+pCwMt8FOg==", 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mds" 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-mgr", 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmQ7KGHhAAqt0OfZR8AAD3HvueHiBH5w==", 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-osd", 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmH7uGHhAAvGAafRLPzmRY1/6+fDRSPA==", 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-osd" 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd", 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmt8OGHhAAqFJFvHOetWaq3ZODfH4LXw==", 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmZMyGHhAAm8o0Tyxt7M5Xn4XgkBrqHw==", 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.bootstrap-rgw", 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCQZOdmetWGHhAAICv3v03ldHeuheEe69IZCA==", 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmw9CDEBAAb7U4j7o6ZSig5nbXE52GCQ==", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmVYbJDBAAUAngBLy5hl9+p7TNGVLXPw==", 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:51:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-15T22:51:10.355 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 msgr2=0x7fd2b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc000f70 tx=0x7fd2cc009040 comp rx=0 tx=0).stop 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 msgr2=0x7fd2d81f7110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40097f0 tx=0x7fd2c401acf0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 shutdown_connections 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815e530 0x7fd2d815d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80d1540 0x7fd2d81f7110 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 --2- 172.21.15.31:0/3064548398 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d80d09c0 0x7fd2d8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 >> 172.21.15.31:0/3064548398 conn(0x7fd2d80b3f20 msgr2=0x7fd2d80b4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 shutdown_connections 2024-09-15T22:51:10.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.336+0000 7fd2dea00640 1 -- 172.21.15.31:0/3064548398 wait complete. 2024-09-15T22:51:10.358 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-15T22:51:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.496+0000 7feaaaa00640 1 Processor -- start 2024-09-15T22:51:10.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.496+0000 7feaaaa00640 1 -- start start 2024-09-15T22:51:10.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaaaa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feaa4073100 0x7feaa415b920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaaaa00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40b4fa0 con 0x7feaa40cfda0 2024-09-15T22:51:10.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaaaa00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaa40b3950 con 0x7feaa40b34e0 2024-09-15T22:51:10.501 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaaaa00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feaa406e320 con 0x7feaa4073100 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa3e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feaa40cfda0 0x7feaa40b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42282/0 (socket says 172.21.15.31:42282) 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa3e00640 1 -- 172.21.15.31:0/2944115553 learned_addr learned my addr 172.21.15.31:0/2944115553 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa8a00640 1 --2- 172.21.15.31:0/2944115553 >> v2:172.21.15.31:3300/0 conn(0x7feaa4073100 0x7feaa415b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa8a00640 1 -- 172.21.15.31:0/2944115553 >> v1:172.21.15.102:6789/0 conn(0x7feaa40b34e0 legacy=0x7feaa40729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa8a00640 1 -- 172.21.15.31:0/2944115553 >> v1:172.21.15.31:6789/0 conn(0x7feaa40cfda0 legacy=0x7feaa40b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa3400640 1 -- 172.21.15.31:0/2944115553 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723570036 0 0) 0x7feaa40b4fa0 con 0x7feaa40cfda0 2024-09-15T22:51:10.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.500+0000 7feaa8a00640 1 -- 172.21.15.31:0/2944115553 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa40b4480 con 0x7feaa4073100 2024-09-15T22:51:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaa8a00640 1 --2- 172.21.15.31:0/2944115553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa4073100 0x7feaa415b920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009d90 tx=0x7fea9c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa11413a9d61deb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaa3400640 1 -- 172.21.15.31:0/2944115553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0b2070 con 0x7feaa4073100 2024-09-15T22:51:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaa3400640 1 -- 172.21.15.31:0/2944115553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c0a5810 con 0x7feaa4073100 2024-09-15T22:51:10.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaa3400640 1 -- 172.21.15.31:0/2944115553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0a5be0 con 0x7feaa4073100 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- 172.21.15.31:0/2944115553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa4073100 msgr2=0x7feaa415b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 --2- 172.21.15.31:0/2944115553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa4073100 0x7feaa415b920 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009d90 tx=0x7fea9c01c8e0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- 172.21.15.31:0/2944115553 shutdown_connections 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 --2- 172.21.15.31:0/2944115553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa4073100 0x7feaa415b920 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- 172.21.15.31:0/2944115553 >> 172.21.15.31:0/2944115553 conn(0x7feaa4067e00 msgr2=0x7feaa406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- 172.21.15.31:0/2944115553 shutdown_connections 2024-09-15T22:51:10.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- 172.21.15.31:0/2944115553 wait complete. 2024-09-15T22:51:10.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 Processor -- start 2024-09-15T22:51:10.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- start start 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaa4073100 0x7feaa415c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feaa40b34e0 0x7feaa414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feaa406e7b0 con 0x7feaa40cfda0 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feaa40b41a0 con 0x7feaa4073100 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.504+0000 7feaaaa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feaa406e930 con 0x7feaa40b34e0 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:38978/0 (socket says 172.21.15.31:38978) 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 -- 172.21.15.31:0/1486734884 learned_addr learned my addr 172.21.15.31:0/1486734884 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa3e00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaa4073100 0x7feaa415c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7fea9b400640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feaa40b34e0 0x7feaa414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 -- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feaa40b34e0 msgr2=0x7feaa414f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feaa40b34e0 0x7feaa414f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 -- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaa4073100 msgr2=0x7feaa415c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaa4073100 0x7feaa415c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 -- 172.21.15.31:0/1486734884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaa414fa40 con 0x7feaa40cfda0 2024-09-15T22:51:10.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa8a00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009d90 tx=0x7fea9c019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0bd020 con 0x7feaa40cfda0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea9c0b3040 con 0x7feaa40cfda0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaa414fd20 con 0x7feaa40cfda0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea9c0b2050 con 0x7feaa40cfda0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaa4150000 con 0x7feaa40cfda0 2024-09-15T22:51:10.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaa415b920 con 0x7feaa40cfda0 2024-09-15T22:51:10.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fea9c0adca0 con 0x7feaa40cfda0 2024-09-15T22:51:10.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 0x7fea80069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.508+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fea9c120850 con 0x7feaa40cfda0 2024-09-15T22:51:10.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.512+0000 7feaa3e00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 0x7fea80069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.512+0000 7feaa3e00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 0x7fea80069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea94000f70 tx=0x7fea94007d10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.516+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fea9c0c7060 con 0x7feaa40cfda0 2024-09-15T22:51:10.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.736+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7feaa40b50c0 con 0x7feaa40cfda0 2024-09-15T22:51:10.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaa0c00640 1 -- 172.21.15.31:0/1486734884 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7fea9c016560 con 0x7feaa40cfda0 2024-09-15T22:51:10.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 msgr2=0x7fea80069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 0x7fea80069d80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fea94000f70 tx=0x7fea94007d10 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 msgr2=0x7feaa414b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fea9c009d90 tx=0x7fea9c019680 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 shutdown_connections 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fea800678c0 0x7fea80069d80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feaa40cfda0 0x7feaa414b850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feaa40b34e0 0x7feaa414f060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 --2- 172.21.15.31:0/1486734884 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feaa4073100 0x7feaa415c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.740+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 >> 172.21.15.31:0/1486734884 conn(0x7feaa4067e00 msgr2=0x7feaa415a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.744+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 shutdown_connections 2024-09-15T22:51:10.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.744+0000 7feaaaa00640 1 -- 172.21.15.31:0/1486734884 wait complete. 2024-09-15T22:51:10.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-15T22:51:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 Processor -- start 2024-09-15T22:51:10.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 -- start start 2024-09-15T22:51:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd1d409b150 0x7fd1d4161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d40d0c70 con 0x7fd1d415e6d0 2024-09-15T22:51:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1d40d0f50 con 0x7fd1d415f770 2024-09-15T22:51:10.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d9800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd1d4160040 con 0x7fd1d409b150 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd1d415e6d0 0x7fd1d40d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42294/0 (socket says 172.21.15.31:42294) 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2a00640 1 -- 172.21.15.31:0/1664341259 learned_addr learned my addr 172.21.15.31:0/1664341259 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d3400640 1 --2- 172.21.15.31:0/1664341259 >> v2:172.21.15.102:3300/0 conn(0x7fd1d409b150 0x7fd1d4161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1780849839 0 0) 0x7fd1d40d0c70 con 0x7fd1d415e6d0 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1b8003530 con 0x7fd1d415e6d0 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1695549197 0 0) 0x7fd1b8003530 con 0x7fd1d415e6d0 2024-09-15T22:51:10.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 >> v2:172.21.15.102:3300/0 conn(0x7fd1d409b150 msgr2=0x7fd1d4161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 --2- 172.21.15.31:0/1664341259 >> v2:172.21.15.102:3300/0 conn(0x7fd1d409b150 0x7fd1d4161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 >> v1:172.21.15.102:6789/0 conn(0x7fd1d415f770 legacy=0x7fd1d409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d40d1230 con 0x7fd1d415e6d0 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7fd1c4001680 con 0x7fd1d415e6d0 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 >> v1:172.21.15.31:6789/0 conn(0x7fd1d415e6d0 legacy=0x7fd1d40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8003a10 0x7fd1b8003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.904+0000 7fd1d2000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1b80051d0 0x7fd1b800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b800c0a0 con 0x7fd1b8004810 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1b800c250 con 0x7fd1b8003a10 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1b800c450 con 0x7fd1b80051d0 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2a00640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8003a10 0x7fd1b8003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d3400640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1b80051d0 0x7fd1b800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 -- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1b80051d0 msgr2=0x7fd1b800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1b80051d0 0x7fd1b800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 -- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8003a10 msgr2=0x7fd1b8003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1b8003a10 0x7fd1b8003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 -- 172.21.15.31:0/1664341259 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1b8003530 con 0x7fd1b8004810 2024-09-15T22:51:10.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d3400640 1 -- 172.21.15.31:0/1664341259 reap_dead start 2024-09-15T22:51:10.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1ca000640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001780 tx=0x7fd1bc01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d65bbd40e876f54 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0013a0 con 0x7fd1b8004810 2024-09-15T22:51:10.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1bc0052f0 con 0x7fd1b8004810 2024-09-15T22:51:10.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.908+0000 7fd1d2000640 1 -- 172.21.15.31:0/1664341259 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc003840 con 0x7fd1b8004810 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 msgr2=0x7fd1b8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001780 tx=0x7fd1bc01c420 comp rx=0 tx=0).stop 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- 172.21.15.31:0/1664341259 shutdown_connections 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 --2- 172.21.15.31:0/1664341259 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1b8004c90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- 172.21.15.31:0/1664341259 >> 172.21.15.31:0/1664341259 conn(0x7fd1d40d23b0 msgr2=0x7fd1d40d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- 172.21.15.31:0/1664341259 shutdown_connections 2024-09-15T22:51:10.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- 172.21.15.31:0/1664341259 wait complete. 2024-09-15T22:51:10.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 Processor -- start 2024-09-15T22:51:10.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- start start 2024-09-15T22:51:10.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d40c9480 0x7fd1d40b2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1d415b490 0x7fd1d415b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d415eab0 con 0x7fd1b8004810 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd1d415fbb0 con 0x7fd1d40c9480 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d9800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd1d40d17f0 con 0x7fd1d415b490 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39000/0 (socket says 172.21.15.31:39000) 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 -- 172.21.15.31:0/2013316831 learned_addr learned my addr 172.21.15.31:0/2013316831 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d3400640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1d415b490 0x7fd1d415b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1ca000640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d40c9480 0x7fd1d40b2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 -- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1d415b490 msgr2=0x7fd1d415b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1d415b490 0x7fd1d415b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 -- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d40c9480 msgr2=0x7fd1d40b2510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d40c9480 0x7fd1d40b2510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.912+0000 7fd1d2a00640 1 -- 172.21.15.31:0/2013316831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1d40ca800 con 0x7fd1b8004810 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1d2a00640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40017f0 tx=0x7fd1c4012920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c401c070 con 0x7fd1b8004810 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1c4014810 con 0x7fd1b8004810 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1d40c9c20 con 0x7fd1b8004810 2024-09-15T22:51:10.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1c4014c00 con 0x7fd1b8004810 2024-09-15T22:51:10.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1d40ca1e0 con 0x7fd1b8004810 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1d40ca9d0 con 0x7fd1b8004810 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd1c401f070 con 0x7fd1b8004810 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 0x7fd1b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.916+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fd1c40884d0 con 0x7fd1b8004810 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.920+0000 7fd1ca000640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 0x7fd1b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:10.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.920+0000 7fd1ca000640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 0x7fd1b0069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001750 tx=0x7fd1bc0011a0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:10.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:10.920+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd1c4058b70 con 0x7fd1b8004810 2024-09-15T22:51:11.147 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.144+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7fd1d409b570 con 0x7fd1b8004810 2024-09-15T22:51:11.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1cb400640 1 -- 172.21.15.31:0/2013316831 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7fd1c405ce70 con 0x7fd1b8004810 2024-09-15T22:51:11.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 msgr2=0x7fd1b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 0x7fd1b0069d80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc001750 tx=0x7fd1bc0011a0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 msgr2=0x7fd1d40b7c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40017f0 tx=0x7fd1c4012920 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 shutdown_connections 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd1b00678c0 0x7fd1b0069d80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd1d415b490 0x7fd1d415b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd1d40c9480 0x7fd1d40b2510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 --2- 172.21.15.31:0/2013316831 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd1b8004810 0x7fd1d40b7c80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.148+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 >> 172.21.15.31:0/2013316831 conn(0x7fd1d40d23b0 msgr2=0x7fd1d406cfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.152+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 shutdown_connections 2024-09-15T22:51:11.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.152+0000 7fd1d9800640 1 -- 172.21.15.31:0/2013316831 wait complete. 2024-09-15T22:51:11.171 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-15T22:51:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 Processor -- start 2024-09-15T22:51:11.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 -- start start 2024-09-15T22:51:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d6406f270 0x7f2d6406f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2d64072870 0x7f2d6415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d6406fb90 con 0x7f2d640b47a0 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2d6415ba60 con 0x7f2d6406f270 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d6b000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2d640affa0 con 0x7f2d64072870 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d6406f270 0x7f2d6406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2d6406f270 0x7f2d6406f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39010/0 (socket says 172.21.15.31:39010) 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 -- 172.21.15.31:0/124574283 learned_addr learned my addr 172.21.15.31:0/124574283 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d69000640 1 --2- 172.21.15.31:0/124574283 >> v2:172.21.15.102:3300/0 conn(0x7f2d64072870 0x7f2d6415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 -- 172.21.15.31:0/124574283 >> v2:172.21.15.102:3300/0 conn(0x7f2d64072870 msgr2=0x7f2d6415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 --2- 172.21.15.31:0/124574283 >> v2:172.21.15.102:3300/0 conn(0x7f2d64072870 0x7f2d6415c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 -- 172.21.15.31:0/124574283 >> v1:172.21.15.102:6789/0 conn(0x7f2d640b47a0 legacy=0x7f2d64072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.312+0000 7f2d63e00640 1 -- 172.21.15.31:0/124574283 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d64072d40 con 0x7f2d6406f270 2024-09-15T22:51:11.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d63e00640 1 --2- 172.21.15.31:0/124574283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d6406f270 0x7f2d6406f650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d640b5ba0 tx=0x7f2d5401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ba4ae7282f8a50 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d62a00640 1 -- 172.21.15.31:0/124574283 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d540ab610 con 0x7f2d6406f270 2024-09-15T22:51:11.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d62a00640 1 -- 172.21.15.31:0/124574283 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d540b0070 con 0x7f2d6406f270 2024-09-15T22:51:11.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d62a00640 1 -- 172.21.15.31:0/124574283 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d540ab9d0 con 0x7f2d6406f270 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 -- 172.21.15.31:0/124574283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d6406f270 msgr2=0x7f2d6406f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 --2- 172.21.15.31:0/124574283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d6406f270 0x7f2d6406f650 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2d640b5ba0 tx=0x7f2d5401c520 comp rx=0 tx=0).stop 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 -- 172.21.15.31:0/124574283 shutdown_connections 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 --2- 172.21.15.31:0/124574283 >> v2:172.21.15.102:3300/0 conn(0x7f2d64072870 0x7f2d6415c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 --2- 172.21.15.31:0/124574283 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d6406f270 0x7f2d6406f650 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 -- 172.21.15.31:0/124574283 >> 172.21.15.31:0/124574283 conn(0x7f2d64067e00 msgr2=0x7f2d6406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 -- 172.21.15.31:0/124574283 shutdown_connections 2024-09-15T22:51:11.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.316+0000 7f2d6b000640 1 -- 172.21.15.31:0/124574283 wait complete. 2024-09-15T22:51:11.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 Processor -- start 2024-09-15T22:51:11.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- start start 2024-09-15T22:51:11.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d6406f270 0x7f2d64139620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 0x7f2d6413c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64155b90 con 0x7f2d640b47a0 2024-09-15T22:51:11.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2d64155a10 con 0x7f2d6406f270 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2d640b4bb0 con 0x7f2d64072870 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39024/0 (socket says 172.21.15.31:39024) 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 -- 172.21.15.31:0/1047596066 learned_addr learned my addr 172.21.15.31:0/1047596066 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d63e00640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d6406f270 0x7f2d64139620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d63400640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 0x7f2d6413c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 -- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 msgr2=0x7f2d6413c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 0x7f2d6413c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 -- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d6406f270 msgr2=0x7f2d64139620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d6406f270 0x7f2d64139620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 -- 172.21.15.31:0/1047596066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6413cd80 con 0x7f2d640b47a0 2024-09-15T22:51:11.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d63400640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 0x7f2d6413c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:11.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d69000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c007e60 tx=0x7f2d5c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c014420 con 0x7f2d640b47a0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d5c019070 con 0x7f2d640b47a0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c014800 con 0x7f2d640b47a0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6413a160 con 0x7f2d640b47a0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6413a720 con 0x7f2d640b47a0 2024-09-15T22:51:11.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.320+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6415d190 con 0x7f2d640b47a0 2024-09-15T22:51:11.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.324+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2d5c0149a0 con 0x7f2d640b47a0 2024-09-15T22:51:11.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.324+0000 7f2d5be00640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 0x7f2d44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.324+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f2d5c086330 con 0x7f2d640b47a0 2024-09-15T22:51:11.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.324+0000 7f2d63e00640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 0x7f2d44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.324+0000 7f2d63e00640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 0x7f2d44069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2d540af000 tx=0x7f2d540a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.328+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2d5c056f90 con 0x7f2d640b47a0 2024-09-15T22:51:11.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.548+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f2d6406f650 con 0x7f2d640b47a0 2024-09-15T22:51:11.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.552+0000 7f2d5be00640 1 -- 172.21.15.31:0/1047596066 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f2d5c056890 con 0x7f2d640b47a0 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 msgr2=0x7f2d44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 0x7f2d44069d80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2d540af000 tx=0x7f2d540a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 msgr2=0x7f2d640b06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c007e60 tx=0x7f2d5c00e4b0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 shutdown_connections 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2d440678c0 0x7f2d44069d80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2d640b47a0 0x7f2d640b06a0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2d64072870 0x7f2d6413c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 --2- 172.21.15.31:0/1047596066 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2d6406f270 0x7f2d64139620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 >> 172.21.15.31:0/1047596066 conn(0x7f2d64067e00 msgr2=0x7f2d64074780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:11.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 shutdown_connections 2024-09-15T22:51:11.558 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.556+0000 7f2d6b000640 1 -- 172.21.15.31:0/1047596066 wait complete. 2024-09-15T22:51:11.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-15T22:51:11.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 Processor -- start 2024-09-15T22:51:11.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 -- start start 2024-09-15T22:51:11.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62e815c080 0x7f62e8070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e806e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e80af440 con 0x7f62e80b04e0 2024-09-15T22:51:11.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f62e80b0050 con 0x7f62e815c080 2024-09-15T22:51:11.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.716+0000 7f62f0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f62e80af720 con 0x7f62e80ae470 2024-09-15T22:51:11.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f62e815c080 0x7f62e8070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ecc00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f62e80b04e0 0x7f62e80add60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42308/0 (socket says 172.21.15.31:42308) 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ecc00640 1 -- 172.21.15.31:0/698095979 learned_addr learned my addr 172.21.15.31:0/698095979 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ee000640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e806e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 -- 172.21.15.31:0/698095979 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 msgr2=0x7f62e806e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e806e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 -- 172.21.15.31:0/698095979 >> v1:172.21.15.31:6789/0 conn(0x7f62e80b04e0 legacy=0x7f62e80add60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 -- 172.21.15.31:0/698095979 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80afa00 con 0x7f62e815c080 2024-09-15T22:51:11.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62e7e00640 1 -- 172.21.15.31:0/698095979 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 124543627 0 0) 0x7f62e80af440 con 0x7f62e80b04e0 2024-09-15T22:51:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62ed600640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e815c080 0x7f62e8070a90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5872b752488521 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62e7e00640 1 -- 172.21.15.31:0/698095979 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0b0070 con 0x7f62e815c080 2024-09-15T22:51:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62e7e00640 1 -- 172.21.15.31:0/698095979 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62dc0ab600 con 0x7f62e815c080 2024-09-15T22:51:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.720+0000 7f62e7e00640 1 -- 172.21.15.31:0/698095979 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62dc0ab9d0 con 0x7f62e815c080 2024-09-15T22:51:11.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- 172.21.15.31:0/698095979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e815c080 msgr2=0x7f62e8070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e815c080 0x7f62e8070a90 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0097c0 tx=0x7f62dc01c470 comp rx=0 tx=0).stop 2024-09-15T22:51:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- 172.21.15.31:0/698095979 shutdown_connections 2024-09-15T22:51:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e806e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- 172.21.15.31:0/698095979 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e815c080 0x7f62e8070a90 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- 172.21.15.31:0/698095979 >> 172.21.15.31:0/698095979 conn(0x7f62e806bcc0 msgr2=0x7f62e806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- 172.21.15.31:0/698095979 shutdown_connections 2024-09-15T22:51:11.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- 172.21.15.31:0/698095979 wait complete. 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 Processor -- start 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- start start 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e815efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e815c080 0x7f62e815cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f62e816b4b0 con 0x7f62e80b04e0 2024-09-15T22:51:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f62e816b330 con 0x7f62e815c080 2024-09-15T22:51:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62f0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f62e816b630 con 0x7f62e80ae470 2024-09-15T22:51:11.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39050/0 (socket says 172.21.15.31:39050) 2024-09-15T22:51:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 -- 172.21.15.31:0/3439667982 learned_addr learned my addr 172.21.15.31:0/3439667982 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ed600640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e815efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ee000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e815c080 0x7f62e815cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 -- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 msgr2=0x7f62e815efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e815efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 -- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e815c080 msgr2=0x7f62e815cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e815c080 0x7f62e815cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.724+0000 7f62ecc00640 1 -- 172.21.15.31:0/3439667982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e8154620 con 0x7f62e80b04e0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62ecc00640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62d40011f0 tx=0x7f62d400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4018070 con 0x7f62e80b04e0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62d40074e0 con 0x7f62e80b04e0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62e8153860 con 0x7f62e80b04e0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62d4004a10 con 0x7f62e80b04e0 2024-09-15T22:51:11.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62e8153e20 con 0x7f62e80b04e0 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62e8155dc0 con 0x7f62e80b04e0 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f62d401b070 con 0x7f62e80b04e0 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 0x7f62c8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f62d4084de0 con 0x7f62e80b04e0 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.728+0000 7f62ed600640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 0x7f62c8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:11.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.732+0000 7f62ed600640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 0x7f62c8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:11.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.732+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f62d40553f0 con 0x7f62e80b04e0 2024-09-15T22:51:11.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.956+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7f62e8149ae0 con 0x7f62e80b04e0 2024-09-15T22:51:11.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62e5600640 1 -- 172.21.15.31:0/3439667982 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f62d40596f0 con 0x7f62e80b04e0 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 msgr2=0x7f62c8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 0x7f62c8069d80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f62dc0ad000 tx=0x7f62dc0a6000 comp rx=0 tx=0).stop 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 msgr2=0x7f62e81495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f62d40011f0 tx=0x7f62d400c9b0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 shutdown_connections 2024-09-15T22:51:11.964 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f62c80678c0 0x7f62c8069d80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f62e815c080 0x7f62e815cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f62e80b04e0 0x7f62e81495a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 --2- 172.21.15.31:0/3439667982 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f62e80ae470 0x7f62e815efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 >> 172.21.15.31:0/3439667982 conn(0x7f62e806bcc0 msgr2=0x7f62e815fd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 shutdown_connections 2024-09-15T22:51:11.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:11.960+0000 7f62f0000640 1 -- 172.21.15.31:0/3439667982 wait complete. 2024-09-15T22:51:11.983 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-15T22:51:12.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 Processor -- start 2024-09-15T22:51:12.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 -- start start 2024-09-15T22:51:12.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbd280b47a0 0x7fbd28072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd280726a0 0x7fbd2815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd28072ad0 con 0x7fbd2806f270 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2815ba60 con 0x7fbd280b47a0 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2fa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280affa0 con 0x7fbd280726a0 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2d000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fbd2806f270 0x7fbd2806f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42320/0 (socket says 172.21.15.31:42320) 2024-09-15T22:51:12.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2d000640 1 -- 172.21.15.31:0/2283355450 learned_addr learned my addr 172.21.15.31:0/2283355450 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd2da00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd280726a0 0x7fbd2815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2283355450 >> v2:172.21.15.102:3300/0 conn(0x7fbd280b47a0 0x7fbd28072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475947794 0 0) 0x7fbd28072ad0 con 0x7fbd2806f270 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd0c003530 con 0x7fbd2806f270 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.124+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2843016609 0 0) 0x7fbd0c003530 con 0x7fbd2806f270 2024-09-15T22:51:12.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd280726a0 msgr2=0x7fbd2815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd280726a0 0x7fbd2815c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 >> v2:172.21.15.102:3300/0 conn(0x7fbd280b47a0 msgr2=0x7fbd28072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 --2- 172.21.15.31:0/2283355450 >> v2:172.21.15.102:3300/0 conn(0x7fbd280b47a0 0x7fbd28072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd28072d40 con 0x7fbd2806f270 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7fbd180016a0 con 0x7fbd2806f270 2024-09-15T22:51:12.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 >> v1:172.21.15.31:6789/0 conn(0x7fbd2806f270 legacy=0x7fbd2806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd0c0039c0 0x7fbd0c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd0c004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd0c004f00 0x7fbd0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2815ba60 con 0x7fbd0c0043b0 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280affa0 con 0x7fbd0c004f00 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd0c00bf10 con 0x7fbd0c0039c0 2024-09-15T22:51:12.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd2da00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd280726a0 0x7fbd2815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd0c004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd2d000640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd0c0039c0 0x7fbd0c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd2da00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd0c004f00 0x7fbd0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 -- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd0c0039c0 msgr2=0x7fbd0c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd0c0039c0 0x7fbd0c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 -- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd0c004f00 msgr2=0x7fbd0c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd0c004f00 0x7fbd0c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 -- 172.21.15.31:0/2283355450 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd0c003530 con 0x7fbd0c0043b0 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd0c004890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009ae0 tx=0x7fbd1001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a24755bf698bf88 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.128+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100b2070 con 0x7fbd0c0043b0 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd100a5620 con 0x7fbd0c0043b0 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd27e00640 1 -- 172.21.15.31:0/2283355450 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd100096b0 con 0x7fbd0c0043b0 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- 172.21.15.31:0/2283355450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 msgr2=0x7fbd0c004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/2283355450 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd0c004890 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fbd10009ae0 tx=0x7fbd1001cab0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2da00640 1 -- 172.21.15.31:0/2283355450 reap_dead start 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- 172.21.15.31:0/2283355450 shutdown_connections 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- 172.21.15.31:0/2283355450 >> 172.21.15.31:0/2283355450 conn(0x7fbd28067e00 msgr2=0x7fbd2806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- 172.21.15.31:0/2283355450 shutdown_connections 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- 172.21.15.31:0/2283355450 wait complete. 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 Processor -- start 2024-09-15T22:51:12.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- start start 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd2814eda0 0x7fbd281f7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd281f7ad0 0x7fbd2815d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b3cc0 con 0x7fbd0c0043b0 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbd280b4310 con 0x7fbd2814eda0 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2fa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbd280b3fa0 con 0x7fbd281f7ad0 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39066/0 (socket says 172.21.15.31:39066) 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2d000640 1 -- 172.21.15.31:0/3581528490 learned_addr learned my addr 172.21.15.31:0/3581528490 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd2814eda0 0x7fbd281f7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.132+0000 7fbd2da00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd281f7ad0 0x7fbd2815d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 -- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd281f7ad0 msgr2=0x7fbd2815d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd281f7ad0 0x7fbd2815d260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 -- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd2814eda0 msgr2=0x7fbd281f7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd2814eda0 0x7fbd281f7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 -- 172.21.15.31:0/3581528490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2814e300 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2d000640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd180058b0 tx=0x7fbd180126f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd1801c070 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd18014550 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd281f8050 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd18014920 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2814e5a0 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd280b4c30 con 0x7fbd0c0043b0 2024-09-15T22:51:12.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbd1801f070 con 0x7fbd0c0043b0 2024-09-15T22:51:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 0x7fbd04069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7fbd18088290 con 0x7fbd0c0043b0 2024-09-15T22:51:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.136+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 0x7fbd04069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.140+0000 7fbd1fe00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 0x7fbd04069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd100af000 tx=0x7fbd100046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.144 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.140+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbd18058930 con 0x7fbd0c0043b0 2024-09-15T22:51:12.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.368+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7fbd280b01c0 con 0x7fbd0c0043b0 2024-09-15T22:51:12.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.372+0000 7fbd25600640 1 -- 172.21.15.31:0/3581528490 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) ==== 97+0+0 (secure 0 0 0) 0x7fbd1805cc30 con 0x7fbd0c0043b0 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 msgr2=0x7fbd04069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 0x7fbd04069db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fbd100af000 tx=0x7fbd100046d0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 msgr2=0x7fbd2814b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fbd180058b0 tx=0x7fbd180126f0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 shutdown_connections 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbd040678f0 0x7fbd04069db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbd281f7ad0 0x7fbd2815d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbd2814eda0 0x7fbd281f7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 --2- 172.21.15.31:0/3581528490 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbd0c0043b0 0x7fbd2814b750 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 >> 172.21.15.31:0/3581528490 conn(0x7fbd28067e00 msgr2=0x7fbd2815e000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:12.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 shutdown_connections 2024-09-15T22:51:12.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.376+0000 7fbd2fa00640 1 -- 172.21.15.31:0/3581528490 wait complete. 2024-09-15T22:51:12.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-15T22:51:12.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 Processor -- start 2024-09-15T22:51:12.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 -- start start 2024-09-15T22:51:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff2806d990 0x7eff2815f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff280b1c70 con 0x7eff280b1890 2024-09-15T22:51:12.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2809b1e0 con 0x7eff2815ffb0 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff2d000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7eff2809b4c0 con 0x7eff2806d990 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff2806d990 0x7eff2815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7eff2806d990 0x7eff2815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39072/0 (socket says 172.21.15.31:39072) 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 -- 172.21.15.31:0/196949594 learned_addr learned my addr 172.21.15.31:0/196949594 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 -- 172.21.15.31:0/196949594 >> v1:172.21.15.102:6789/0 conn(0x7eff2815ffb0 legacy=0x7eff2815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 -- 172.21.15.31:0/196949594 >> v1:172.21.15.31:6789/0 conn(0x7eff280b1890 legacy=0x7eff2806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.536+0000 7eff1d400640 1 -- 172.21.15.31:0/196949594 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2809b7a0 con 0x7eff2806d990 2024-09-15T22:51:12.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff1d400640 1 --2- 172.21.15.31:0/196949594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815f810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff10009870 tx=0x7eff1001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d3e38fb4b3e292 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff25400640 1 -- 172.21.15.31:0/196949594 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff100b2070 con 0x7eff2806d990 2024-09-15T22:51:12.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff25400640 1 -- 172.21.15.31:0/196949594 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff100a9070 con 0x7eff2806d990 2024-09-15T22:51:12.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff25400640 1 -- 172.21.15.31:0/196949594 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff100ad880 con 0x7eff2806d990 2024-09-15T22:51:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 -- 172.21.15.31:0/196949594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 msgr2=0x7eff2815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 --2- 172.21.15.31:0/196949594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815f810 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7eff10009870 tx=0x7eff1001c560 comp rx=0 tx=0).stop 2024-09-15T22:51:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 -- 172.21.15.31:0/196949594 shutdown_connections 2024-09-15T22:51:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 --2- 172.21.15.31:0/196949594 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815f810 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 -- 172.21.15.31:0/196949594 >> 172.21.15.31:0/196949594 conn(0x7eff280d23b0 msgr2=0x7eff280d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 -- 172.21.15.31:0/196949594 shutdown_connections 2024-09-15T22:51:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.540+0000 7eff2d000640 1 -- 172.21.15.31:0/196949594 wait complete. 2024-09-15T22:51:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 Processor -- start 2024-09-15T22:51:12.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- start start 2024-09-15T22:51:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff280b1890 0x7eff28158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff2815ffb0 0x7eff281592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7eff280d1520 con 0x7eff2806d990 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7eff280d13a0 con 0x7eff280b1890 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7eff280d16a0 con 0x7eff2815ffb0 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39074/0 (socket says 172.21.15.31:39074) 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 -- 172.21.15.31:0/3548769080 learned_addr learned my addr 172.21.15.31:0/3548769080 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff1d400640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff280b1890 0x7eff28158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff26800640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff2815ffb0 0x7eff281592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 -- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff2815ffb0 msgr2=0x7eff281592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff2815ffb0 0x7eff281592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 -- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff280b1890 msgr2=0x7eff28158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff280b1890 0x7eff28158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 -- 172.21.15.31:0/3548769080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2815caa0 con 0x7eff2806d990 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff25e00640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c500 tx=0x7eff1800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18016020 con 0x7eff2806d990 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff18005220 con 0x7eff2806d990 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2815cd80 con 0x7eff2806d990 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff18007030 con 0x7eff2806d990 2024-09-15T22:51:12.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.544+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2815d340 con 0x7eff2806d990 2024-09-15T22:51:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff280d2120 con 0x7eff2806d990 2024-09-15T22:51:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7eff180071d0 con 0x7eff2806d990 2024-09-15T22:51:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff1ea00640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 0x7eff04069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7eff18085430 con 0x7eff2806d990 2024-09-15T22:51:12.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff1d400640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 0x7eff04069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.548+0000 7eff1d400640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 0x7eff04069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff100af000 tx=0x7eff100a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.555 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.552+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7eff18020020 con 0x7eff2806d990 2024-09-15T22:51:12.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.780+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7eff280b8330 con 0x7eff2806d990 2024-09-15T22:51:12.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.784+0000 7eff1ea00640 1 -- 172.21.15.31:0/3548769080 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7eff280b1c70 con 0x7eff2806d990 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 msgr2=0x7eff04069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 0x7eff04069d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7eff100af000 tx=0x7eff100a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 msgr2=0x7eff2815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7eff1800c500 tx=0x7eff1800c9c0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 shutdown_connections 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7eff040678c0 0x7eff04069d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7eff2815ffb0 0x7eff281592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7eff280b1890 0x7eff28158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 --2- 172.21.15.31:0/3548769080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7eff2806d990 0x7eff2815db40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 >> 172.21.15.31:0/3548769080 conn(0x7eff280d23b0 msgr2=0x7eff2806d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:12.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 shutdown_connections 2024-09-15T22:51:12.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.788+0000 7eff2d000640 1 -- 172.21.15.31:0/3548769080 wait complete. 2024-09-15T22:51:12.807 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:51:12.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.944+0000 7ffa50c00640 1 Processor -- start 2024-09-15T22:51:12.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.944+0000 7ffa50c00640 1 -- start start 2024-09-15T22:51:12.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa50c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa4c161a40 0x7ffa4c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c0b47c0 0x7ffa4c09af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa50c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffa4c070d80 con 0x7ffa4c1620e0 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa50c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ffa4c0d0190 con 0x7ffa4c161a40 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa50c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c0d0430 con 0x7ffa4c0b47c0 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa4c161a40 0x7ffa4c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffa4c161a40 0x7ffa4c09aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39088/0 (socket says 172.21.15.31:39088) 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 -- 172.21.15.31:0/1181119557 learned_addr learned my addr 172.21.15.31:0/1181119557 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:12.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa43e00640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c0b47c0 0x7ffa4c09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 -- 172.21.15.31:0/1181119557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c0b47c0 msgr2=0x7ffa4c09af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c0b47c0 0x7ffa4c09af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 -- 172.21.15.31:0/1181119557 >> v1:172.21.15.102:6789/0 conn(0x7ffa4c1620e0 legacy=0x7ffa4c162570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.948+0000 7ffa4b400640 1 -- 172.21.15.31:0/1181119557 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c0d0710 con 0x7ffa4c161a40 2024-09-15T22:51:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa4b400640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c161a40 0x7ffa4c09aa40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009870 tx=0x7ffa3c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d533c0571c7801 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa4aa00640 1 -- 172.21.15.31:0/1181119557 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0a9640 con 0x7ffa4c161a40 2024-09-15T22:51:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa4aa00640 1 -- 172.21.15.31:0/1181119557 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa3c0a97e0 con 0x7ffa4c161a40 2024-09-15T22:51:12.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa4aa00640 1 -- 172.21.15.31:0/1181119557 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0a9bb0 con 0x7ffa4c161a40 2024-09-15T22:51:12.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- 172.21.15.31:0/1181119557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c161a40 msgr2=0x7ffa4c09aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c161a40 0x7ffa4c09aa40 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009870 tx=0x7ffa3c01c520 comp rx=0 tx=0).stop 2024-09-15T22:51:12.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- 172.21.15.31:0/1181119557 shutdown_connections 2024-09-15T22:51:12.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c0b47c0 0x7ffa4c09af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1181119557 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c161a40 0x7ffa4c09aa40 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- 172.21.15.31:0/1181119557 >> 172.21.15.31:0/1181119557 conn(0x7ffa4c0b3ca0 msgr2=0x7ffa4c0b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- 172.21.15.31:0/1181119557 shutdown_connections 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- 172.21.15.31:0/1181119557 wait complete. 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 Processor -- start 2024-09-15T22:51:12.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.952+0000 7ffa50c00640 1 -- start start 2024-09-15T22:51:12.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa4c0b47c0 0x7ffa4c155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c161a40 0x7ffa4c156340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c0b1390 con 0x7ffa4c1620e0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c0b1210 con 0x7ffa4c0b47c0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffa4c16bc30 con 0x7ffa4c161a40 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39090/0 (socket says 172.21.15.31:39090) 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 -- 172.21.15.31:0/1946971539 learned_addr learned my addr 172.21.15.31:0/1946971539 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa43e00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c161a40 0x7ffa4c156340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4b400640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa4c0b47c0 0x7ffa4c155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 -- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c161a40 msgr2=0x7ffa4c156340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c161a40 0x7ffa4c156340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 -- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa4c0b47c0 msgr2=0x7ffa4c155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa4c0b47c0 0x7ffa4c155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 -- 172.21.15.31:0/1946971539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c15e010 con 0x7ffa4c1620e0 2024-09-15T22:51:12.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa4be00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c770 tx=0x7ffa4400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44003b80 con 0x7ffa4c1620e0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffa44003d20 con 0x7ffa4c1620e0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4400aa90 con 0x7ffa4c1620e0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c15f670 con 0x7ffa4c1620e0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c15e2b0 con 0x7ffa4c1620e0 2024-09-15T22:51:12.960 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa4c15f840 con 0x7ffa4c1620e0 2024-09-15T22:51:12.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.956+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffa4400ac30 con 0x7ffa4c1620e0 2024-09-15T22:51:12.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.960+0000 7ffa43400640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 0x7ffa28069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:12.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.960+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7ffa44085af0 con 0x7ffa4c1620e0 2024-09-15T22:51:12.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.960+0000 7ffa4b400640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 0x7ffa28069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:12.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.960+0000 7ffa4b400640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 0x7ffa28069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ae000 tx=0x7ffa3c0b3040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:12.965 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:12.964+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffa44056750 con 0x7ffa4c1620e0 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.132+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7ffa4c1624f0 con 0x7ffa4c1620e0 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.132+0000 7ffa43400640 1 -- 172.21.15.31:0/1946971539 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) ==== 84+0+65 (secure 0 0 0) 0x7ffa44056050 con 0x7ffa4c1620e0 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-15T22:51:13.135 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:51:13.136 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-15T22:51:13.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 msgr2=0x7ffa28069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 0x7ffa28069d80 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ae000 tx=0x7ffa3c0b3040 comp rx=0 tx=0).stop 2024-09-15T22:51:13.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 msgr2=0x7ffa4c159a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffa4400c770 tx=0x7ffa4400cc30 comp rx=0 tx=0).stop 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 shutdown_connections 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffa280678c0 0x7ffa28069d80 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffa4c1620e0 0x7ffa4c159a90 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffa4c161a40 0x7ffa4c156340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 --2- 172.21.15.31:0/1946971539 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffa4c0b47c0 0x7ffa4c155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 >> 172.21.15.31:0/1946971539 conn(0x7ffa4c0b3ca0 msgr2=0x7ffa4c0b4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 shutdown_connections 2024-09-15T22:51:13.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.136+0000 7ffa50c00640 1 -- 172.21.15.31:0/1946971539 wait complete. 2024-09-15T22:51:13.157 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:51:13.158 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:51:13.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 Processor -- start 2024-09-15T22:51:13.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 -- start start 2024-09-15T22:51:13.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c541522d0 0x7f9c5415ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f9c540d0780 0x7f9c5415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c540ce310 con 0x7f9c540b4ba0 2024-09-15T22:51:13.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9c541526b0 con 0x7f9c541522d0 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c59e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f9c540ce5f0 con 0x7f9c540d0780 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c541522d0 0x7f9c5415ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9c541522d0 0x7f9c5415ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39104/0 (socket says 172.21.15.31:39104) 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 -- 172.21.15.31:0/1614341009 learned_addr learned my addr 172.21.15.31:0/1614341009 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 -- 172.21.15.31:0/1614341009 >> v2:172.21.15.102:3300/0 conn(0x7f9c540d0780 msgr2=0x7f9c5415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 --2- 172.21.15.31:0/1614341009 >> v2:172.21.15.102:3300/0 conn(0x7f9c540d0780 0x7f9c5415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 -- 172.21.15.31:0/1614341009 >> v1:172.21.15.102:6789/0 conn(0x7f9c540b4ba0 legacy=0x7f9c540d0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:13.305 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.300+0000 7f9c52a00640 1 -- 172.21.15.31:0/1614341009 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c540ce8d0 con 0x7f9c541522d0 2024-09-15T22:51:13.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c52a00640 1 --2- 172.21.15.31:0/1614341009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c541522d0 0x7f9c5415ed40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af650 tx=0x7f9c4401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e853cd268a37c113 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:13.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c52000640 1 -- 172.21.15.31:0/1614341009 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c440b1070 con 0x7f9c541522d0 2024-09-15T22:51:13.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c52000640 1 -- 172.21.15.31:0/1614341009 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c440ac410 con 0x7f9c541522d0 2024-09-15T22:51:13.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c52000640 1 -- 172.21.15.31:0/1614341009 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c440ac7e0 con 0x7f9c541522d0 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 -- 172.21.15.31:0/1614341009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c541522d0 msgr2=0x7f9c5415ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 --2- 172.21.15.31:0/1614341009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c541522d0 0x7f9c5415ed40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9c540af650 tx=0x7f9c4401c4b0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 -- 172.21.15.31:0/1614341009 shutdown_connections 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 --2- 172.21.15.31:0/1614341009 >> v2:172.21.15.102:3300/0 conn(0x7f9c540d0780 0x7f9c5415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 --2- 172.21.15.31:0/1614341009 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c541522d0 0x7f9c5415ed40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 -- 172.21.15.31:0/1614341009 >> 172.21.15.31:0/1614341009 conn(0x7f9c5406be90 msgr2=0x7f9c5406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 -- 172.21.15.31:0/1614341009 shutdown_connections 2024-09-15T22:51:13.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.304+0000 7f9c59e00640 1 -- 172.21.15.31:0/1614341009 wait complete. 2024-09-15T22:51:13.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 Processor -- start 2024-09-15T22:51:13.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- start start 2024-09-15T22:51:13.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c540b4ba0 0x7f9c54146590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 0x7f9c5414e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9c540b3230 con 0x7f9c540d0780 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9c540b5030 con 0x7f9c541522d0 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9c540b33b0 con 0x7f9c540b4ba0 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39108/0 (socket says 172.21.15.31:39108) 2024-09-15T22:51:13.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 -- 172.21.15.31:0/4137001613 learned_addr learned my addr 172.21.15.31:0/4137001613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 -- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c540b4ba0 msgr2=0x7f9c54146590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c540b4ba0 0x7f9c54146590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 -- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 msgr2=0x7f9c5414e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c53400640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 0x7f9c5414e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 0x7f9c5414e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.312 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 -- 172.21.15.31:0/4137001613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c54146390 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c53400640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 0x7f9c5414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4a000640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c450 tx=0x7f9c3c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c012830 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c3c017070 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c3c012c30 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5414ed10 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.308+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c54158240 con 0x7f9c540d0780 2024-09-15T22:51:13.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c540ae200 con 0x7f9c540d0780 2024-09-15T22:51:13.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9c3c01c460 con 0x7f9c540d0780 2024-09-15T22:51:13.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c4be00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:13.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5249+0+0 (secure 0 0 0) 0x7f9c3c0858f0 con 0x7f9c540d0780 2024-09-15T22:51:13.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c52a00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:13.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.312+0000 7f9c52a00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 0x7f9c30069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ae000 tx=0x7f9c44004740 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:13.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.316+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9c54146390 con 0x7f9c540d0780 2024-09-15T22:51:13.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.480+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9c540b41e0 con 0x7f9c540d0780 2024-09-15T22:51:13.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.940+0000 7f9c4be00640 1 -- 172.21.15.31:0/4137001613 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) ==== 138+0+0 (secure 0 0 0) 0x7f9c3c056550 con 0x7f9c540d0780 2024-09-15T22:51:13.943 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 msgr2=0x7f9c30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 0x7f9c30069d80 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9c440ae000 tx=0x7f9c44004740 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 msgr2=0x7f9c54145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9c3c00c450 tx=0x7f9c3c00c910 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 shutdown_connections 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9c300678c0 0x7f9c30069d80 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9c541522d0 0x7f9c5414e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9c540d0780 0x7f9c54145e50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 --2- 172.21.15.31:0/4137001613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9c540b4ba0 0x7f9c54146590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 >> 172.21.15.31:0/4137001613 conn(0x7f9c5406be90 msgr2=0x7f9c5415a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:13.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 shutdown_connections 2024-09-15T22:51:13.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:13.944+0000 7f9c59e00640 1 -- 172.21.15.31:0/4137001613 wait complete. 2024-09-15T22:51:13.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:51:14.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:51:14.084 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:51:14.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 Processor -- start 2024-09-15T22:51:14.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 -- start start 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd8f015e130 0x7fd8f0067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 0x7fd8f00b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8f006e770 con 0x7fd8f015e510 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd8f006f060 con 0x7fd8f015e130 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f7c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f00680c0 con 0x7fd8f00aff00 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8e7e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd8f015e510 0x7fd8f00af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:42340/0 (socket says 172.21.15.31:42340) 2024-09-15T22:51:14.128 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8e7e00640 1 -- 172.21.15.31:0/1192743106 learned_addr learned my addr 172.21.15.31:0/1192743106 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1192743106 >> v2:172.21.15.102:3300/0 conn(0x7fd8f015e130 0x7fd8f0067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.124+0000 7fd8f5c00640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 0x7fd8f00b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8efe00640 1 -- 172.21.15.31:0/1192743106 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914807684 0 0) 0x7fd8f006e770 con 0x7fd8f015e510 2024-09-15T22:51:14.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8efe00640 1 -- 172.21.15.31:0/1192743106 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8d4003530 con 0x7fd8f015e510 2024-09-15T22:51:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5200640 1 -- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 msgr2=0x7fd8f00b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 0x7fd8f00b50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5200640 1 -- 172.21.15.31:0/1192743106 >> v1:172.21.15.31:6789/0 conn(0x7fd8f015e510 legacy=0x7fd8f00af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5200640 1 -- 172.21.15.31:0/1192743106 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f006ea10 con 0x7fd8f015e130 2024-09-15T22:51:14.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5c00640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 0x7fd8f00b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:14.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f015e130 0x7fd8f0067a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00097c0 tx=0x7fd8e001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85d09c54ee4f0460 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:14.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8efe00640 1 -- 172.21.15.31:0/1192743106 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00b1070 con 0x7fd8f015e130 2024-09-15T22:51:14.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8efe00640 1 -- 172.21.15.31:0/1192743106 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8e00ac410 con 0x7fd8f015e130 2024-09-15T22:51:14.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.128+0000 7fd8efe00640 1 -- 172.21.15.31:0/1192743106 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8e00ac7c0 con 0x7fd8f015e130 2024-09-15T22:51:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f015e130 msgr2=0x7fd8f0067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f015e130 0x7fd8f0067a00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00097c0 tx=0x7fd8e001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1192743106 shutdown_connections 2024-09-15T22:51:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f00aff00 0x7fd8f00b50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.133 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1192743106 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f015e130 0x7fd8f0067a00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1192743106 >> 172.21.15.31:0/1192743106 conn(0x7fd8f0073640 msgr2=0x7fd8f006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1192743106 shutdown_connections 2024-09-15T22:51:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1192743106 wait complete. 2024-09-15T22:51:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 Processor -- start 2024-09-15T22:51:14.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- start start 2024-09-15T22:51:14.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 0x7fd8f0150e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 0x7fd8f015f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f0070090 con 0x7fd8f015e130 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8f006ff10 con 0x7fd8f00aff00 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f7c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8f0070210 con 0x7fd8f015e510 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8e7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:39114/0 (socket says 172.21.15.31:39114) 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8e7e00640 1 -- 172.21.15.31:0/1288610527 learned_addr learned my addr 172.21.15.31:0/1288610527 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f5c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 0x7fd8f015f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.132+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 0x7fd8f0150e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 -- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 msgr2=0x7fd8f015f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 0x7fd8f015f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 -- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 msgr2=0x7fd8f0150e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 0x7fd8f0150e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 -- 172.21.15.31:0/1288610527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8f00ce8c0 con 0x7fd8f015e130 2024-09-15T22:51:14.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f5c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 0x7fd8f015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:14.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 0x7fd8f0150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:14.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8e7e00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800c460 tx=0x7fd8d800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d8017070 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8d8005d10 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8f00ceba0 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8d80072b0 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8f00cf440 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f00b50c0 con 0x7fd8f015e130 2024-09-15T22:51:14.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8d801a070 con 0x7fd8f015e130 2024-09-15T22:51:14.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 0x7fd8cc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:14.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5619+0+0 (secure 0 0 0) 0x7fd8d8084e40 con 0x7fd8f015e130 2024-09-15T22:51:14.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.136+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 0x7fd8cc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:14.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.140+0000 7fd8f5200640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 0x7fd8cc069db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00ae000 tx=0x7fd8e0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:14.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.144+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd8d80553f0 con 0x7fd8f015e130 2024-09-15T22:51:14.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.308+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fd8f006d360 con 0x7fd8f015e130 2024-09-15T22:51:14.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.948+0000 7fd8ed600640 1 -- 172.21.15.31:0/1288610527 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) ==== 170+0+0 (secure 0 0 0) 0x7fd8d80596f0 con 0x7fd8f015e130 2024-09-15T22:51:14.953 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 msgr2=0x7fd8cc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 0x7fd8cc069db0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00ae000 tx=0x7fd8e0008040 comp rx=0 tx=0).stop 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 msgr2=0x7fd8f0158600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800c460 tx=0x7fd8d800c920 comp rx=0 tx=0).stop 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 shutdown_connections 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd8cc0678f0 0x7fd8cc069db0 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd8e00ae000 tx=0x7fd8e0008040 comp rx=0 tx=0).stop 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8f015e510 0x7fd8f015f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8f015e130 0x7fd8f0158600 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fd8d800c460 tx=0x7fd8d800c920 comp rx=0 tx=0).stop 2024-09-15T22:51:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 --2- 172.21.15.31:0/1288610527 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8f00aff00 0x7fd8f0150e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.952+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 >> 172.21.15.31:0/1288610527 conn(0x7fd8f0073640 msgr2=0x7fd8f0157440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.956+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 shutdown_connections 2024-09-15T22:51:14.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:14.956+0000 7fd8f7c00640 1 -- 172.21.15.31:0/1288610527 wait complete. 2024-09-15T22:51:14.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:51:15.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.188+0000 7efe0fe00640 1 Processor -- start 2024-09-15T22:51:15.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.188+0000 7efe0fe00640 1 -- start start 2024-09-15T22:51:15.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe1006def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:15.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0fe00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe100b52c0 con 0x7efe1006e430 2024-09-15T22:51:15.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0fe00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe100d2740 con 0x7efe100d20e0 2024-09-15T22:51:15.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0fe00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe100d2520 con 0x7efe10147d80 2024-09-15T22:51:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0e000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efe1006e430 0x7efe100d19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33106/0 (socket says 172.21.15.31:33106) 2024-09-15T22:51:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0e000640 1 -- 172.21.15.31:0/2324517460 learned_addr learned my addr 172.21.15.31:0/2324517460 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0ea00640 1 --2- 172.21.15.31:0/2324517460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe1006def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:15.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536299594 0 0) 0x7efe100b52c0 con 0x7efe1006e430 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf4003530 con 0x7efe1006e430 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151712535 0 0) 0x7efe100d2740 con 0x7efe100d20e0 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe100b52c0 con 0x7efe100d20e0 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0ea00640 1 -- 172.21.15.31:0/2324517460 >> v1:172.21.15.102:6789/0 conn(0x7efe100d20e0 legacy=0x7efe100b57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0ea00640 1 -- 172.21.15.31:0/2324517460 >> v1:172.21.15.31:6789/0 conn(0x7efe1006e430 legacy=0x7efe100d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.192+0000 7efe0ea00640 1 -- 172.21.15.31:0/2324517460 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe100d2a20 con 0x7efe10147d80 2024-09-15T22:51:15.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0ea00640 1 --2- 172.21.15.31:0/2324517460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe1006def0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe000097f0 tx=0x7efe0001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77ea8d13afffc708 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000ab5f0 con 0x7efe10147d80 2024-09-15T22:51:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe000b0070 con 0x7efe10147d80 2024-09-15T22:51:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0d600640 1 -- 172.21.15.31:0/2324517460 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000ab9b0 con 0x7efe10147d80 2024-09-15T22:51:15.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- 172.21.15.31:0/2324517460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 msgr2=0x7efe1006def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2324517460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe1006def0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7efe000097f0 tx=0x7efe0001c4e0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- 172.21.15.31:0/2324517460 shutdown_connections 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2324517460 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe1006def0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- 172.21.15.31:0/2324517460 >> 172.21.15.31:0/2324517460 conn(0x7efe10070000 msgr2=0x7efe10070410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- 172.21.15.31:0/2324517460 shutdown_connections 2024-09-15T22:51:15.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- 172.21.15.31:0/2324517460 wait complete. 2024-09-15T22:51:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 Processor -- start 2024-09-15T22:51:15.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.196+0000 7efe0fe00640 1 -- start start 2024-09-15T22:51:15.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe100d20e0 0x7efe101fa4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe101faa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efe100b6af0 con 0x7efe1006e430 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efe100b6970 con 0x7efe100d20e0 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efe1016be00 con 0x7efe10147d80 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54712/0 (socket says 172.21.15.31:54712) 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 -- 172.21.15.31:0/2146671306 learned_addr learned my addr 172.21.15.31:0/2146671306 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0f400640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe101faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0e000640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe100d20e0 0x7efe101fa4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 -- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 msgr2=0x7efe101faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe101faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 -- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe100d20e0 msgr2=0x7efe101fa4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.202 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe100d20e0 0x7efe101fa4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 -- 172.21.15.31:0/2146671306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe10146210 con 0x7efe1006e430 2024-09-15T22:51:15.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0ea00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe000190f0 tx=0x7efe00019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000b4ac0 con 0x7efe1006e430 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe000b4c80 con 0x7efe1006e430 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe000bf690 con 0x7efe1006e430 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe101464f0 con 0x7efe1006e430 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe10146ab0 con 0x7efe1006e430 2024-09-15T22:51:15.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.200+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe1013d940 con 0x7efe1006e430 2024-09-15T22:51:15.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.204+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efe000c83f0 con 0x7efe1006e430 2024-09-15T22:51:15.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.204+0000 7efe06a00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 0x7efdf0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:15.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.204+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6001+0+0 (secure 0 0 0) 0x7efe00120290 con 0x7efe1006e430 2024-09-15T22:51:15.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.204+0000 7efe0e000640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 0x7efdf0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:15.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.204+0000 7efe0e000640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 0x7efdf0069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe10169dc0 tx=0x7efdfc007d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:15.210 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.208+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7efe000160d0 con 0x7efe1006e430 2024-09-15T22:51:15.411 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.408+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7efe100b2110 con 0x7efe1006e430 2024-09-15T22:51:15.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.972+0000 7efe06a00640 1 -- 172.21.15.31:0/2146671306 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) ==== 172+0+0 (secure 0 0 0) 0x7efe000f07e0 con 0x7efe1006e430 2024-09-15T22:51:15.974 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 5 and data pool 6 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 msgr2=0x7efdf0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 0x7efdf0069d80 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe10169dc0 tx=0x7efdfc007d80 comp rx=0 tx=0).stop 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 msgr2=0x7efe1015d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efe000190f0 tx=0x7efe00019280 comp rx=0 tx=0).stop 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 shutdown_connections 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efdf00678c0 0x7efdf0069d80 secure :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7efe10169dc0 tx=0x7efdfc007d80 comp rx=0 tx=0).stop 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efe10147d80 0x7efe101faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efe100d20e0 0x7efe101fa4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 --2- 172.21.15.31:0/2146671306 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efe1006e430 0x7efe1015d870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:15.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.976+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 >> 172.21.15.31:0/2146671306 conn(0x7efe10070000 msgr2=0x7efe100b35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:15.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.980+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 shutdown_connections 2024-09-15T22:51:15.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:15.980+0000 7efe0fe00640 1 -- 172.21.15.31:0/2146671306 wait complete. 2024-09-15T22:51:16.021 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:51:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.160+0000 7ff4adc00640 1 Processor -- start 2024-09-15T22:51:16.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.160+0000 7ff4adc00640 1 -- start start 2024-09-15T22:51:16.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4adc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 0x7ff4a813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4adc00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff4a806e160 0x7ff4a806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4adc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4a81407b0 con 0x7ff4a8072160 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4adc00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff4a813f640 con 0x7ff4a806e160 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4adc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a81413c0 con 0x7ff4a813fa40 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4a6a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff4a8072160 0x7ff4a8072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33110/0 (socket says 172.21.15.31:33110) 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4a6a00640 1 -- 172.21.15.31:0/4040186943 learned_addr learned my addr 172.21.15.31:0/4040186943 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff49e000640 1 --2- 172.21.15.31:0/4040186943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 0x7ff4a813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4a7400640 1 --2- 172.21.15.31:0/4040186943 >> v2:172.21.15.102:3300/0 conn(0x7ff4a806e160 0x7ff4a806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4a6000640 1 -- 172.21.15.31:0/4040186943 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 225624041 0 0) 0x7ff4a81407b0 con 0x7ff4a8072160 2024-09-15T22:51:16.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff4a6000640 1 -- 172.21.15.31:0/4040186943 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff48c003530 con 0x7ff4a8072160 2024-09-15T22:51:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff49e000640 1 -- 172.21.15.31:0/4040186943 >> v2:172.21.15.102:3300/0 conn(0x7ff4a806e160 msgr2=0x7ff4a806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff49e000640 1 --2- 172.21.15.31:0/4040186943 >> v2:172.21.15.102:3300/0 conn(0x7ff4a806e160 0x7ff4a806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff49e000640 1 -- 172.21.15.31:0/4040186943 >> v1:172.21.15.31:6789/0 conn(0x7ff4a8072160 legacy=0x7ff4a8072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.164+0000 7ff49e000640 1 -- 172.21.15.31:0/4040186943 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a8140a90 con 0x7ff4a813fa40 2024-09-15T22:51:16.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff49e000640 1 --2- 172.21.15.31:0/4040186943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 0x7ff4a813fea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4900097c0 tx=0x7ff49001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36bb0621863677d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4a6000640 1 -- 172.21.15.31:0/4040186943 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900b0070 con 0x7ff4a813fa40 2024-09-15T22:51:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4a6000640 1 -- 172.21.15.31:0/4040186943 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4900ab600 con 0x7ff4a813fa40 2024-09-15T22:51:16.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4a6000640 1 -- 172.21.15.31:0/4040186943 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900ab9b0 con 0x7ff4a813fa40 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- 172.21.15.31:0/4040186943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 msgr2=0x7ff4a813fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- 172.21.15.31:0/4040186943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 0x7ff4a813fea0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff4900097c0 tx=0x7ff49001c410 comp rx=0 tx=0).stop 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- 172.21.15.31:0/4040186943 shutdown_connections 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- 172.21.15.31:0/4040186943 >> v2:172.21.15.102:3300/0 conn(0x7ff4a806e160 0x7ff4a806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- 172.21.15.31:0/4040186943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a813fa40 0x7ff4a813fea0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- 172.21.15.31:0/4040186943 >> 172.21.15.31:0/4040186943 conn(0x7ff4a8067e00 msgr2=0x7ff4a806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- 172.21.15.31:0/4040186943 shutdown_connections 2024-09-15T22:51:16.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- 172.21.15.31:0/4040186943 wait complete. 2024-09-15T22:51:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 Processor -- start 2024-09-15T22:51:16.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- start start 2024-09-15T22:51:16.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 0x7ff4a813eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 0x7ff4a8136690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a813fa40 0x7ff4a815c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8168ee0 con 0x7ff4a806e160 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a8168d60 con 0x7ff4a813fa40 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4adc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff4a8169060 con 0x7ff4a8072160 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.168+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 0x7ff4a813eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4a6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 0x7ff4a813eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54724/0 (socket says 172.21.15.31:54724) 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4a6a00640 1 -- 172.21.15.31:0/1801525378 learned_addr learned my addr 172.21.15.31:0/1801525378 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 0x7ff4a8136690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4a7400640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a813fa40 0x7ff4a815c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 -- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a813fa40 msgr2=0x7ff4a815c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a813fa40 0x7ff4a815c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 -- 172.21.15.31:0/1801525378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 msgr2=0x7ff4a813eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 0x7ff4a813eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 -- 172.21.15.31:0/1801525378 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a813db00 con 0x7ff4a8072160 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49e000640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 0x7ff4a8136690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4900ab000 tx=0x7ff4900191b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900ba070 con 0x7ff4a8072160 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4900ab9b0 con 0x7ff4a8072160 2024-09-15T22:51:16.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4900b0040 con 0x7ff4a8072160 2024-09-15T22:51:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a813dde0 con 0x7ff4a8072160 2024-09-15T22:51:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a8157a40 con 0x7ff4a8072160 2024-09-15T22:51:16.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a806e610 con 0x7ff4a8072160 2024-09-15T22:51:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.172+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff4900d7760 con 0x7ff4a8072160 2024-09-15T22:51:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.176+0000 7ff49f400640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 0x7ff484069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.176+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7ff49011ee40 con 0x7ff4a8072160 2024-09-15T22:51:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.176+0000 7ff4a6a00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 0x7ff484069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.176+0000 7ff4a6a00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 0x7ff484069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff498007fd0 tx=0x7ff498009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.176+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff490016090 con 0x7ff4a8072160 2024-09-15T22:51:16.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.344+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff4a813cbd0 con 0x7ff4a8072160 2024-09-15T22:51:16.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff49f400640 1 -- 172.21.15.31:0/1801525378 <== mon.2 v2:172.21.15.102:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16979 (secure 0 0 0) 0x7ff4900ef180 con 0x7ff4a8072160 2024-09-15T22:51:16.350 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:16.350 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:51:15.411658+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:51:13.528767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T22:51:14.356901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:51:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 msgr2=0x7ff484069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 0x7ff484069d80 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff498007fd0 tx=0x7ff498009040 comp rx=0 tx=0).stop 2024-09-15T22:51:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 msgr2=0x7ff4a8136690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 0x7ff4a8136690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff4900ab000 tx=0x7ff4900191b0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 shutdown_connections 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff4840678c0 0x7ff484069d80 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff4a813fa40 0x7ff4a815c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff4a8072160 0x7ff4a8136690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 --2- 172.21.15.31:0/1801525378 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff4a806e160 0x7ff4a813eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 >> 172.21.15.31:0/1801525378 conn(0x7ff4a8067e00 msgr2=0x7ff4a815d9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 shutdown_connections 2024-09-15T22:51:16.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.348+0000 7ff4adc00640 1 -- 172.21.15.31:0/1801525378 wait complete. 2024-09-15T22:51:16.372 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:51:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 Processor -- start 2024-09-15T22:51:16.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 -- start start 2024-09-15T22:51:16.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0d0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4f5c06cdd0 0x7f4f5c0b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f5c06e920 con 0x7f4f5c09b830 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4f5c0b4d90 con 0x7f4f5c06cdd0 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f63c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c0d1d20 con 0x7f4f5c15e790 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f5be00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4f5c09b830 0x7f4f5c0d07a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33112/0 (socket says 172.21.15.31:33112) 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f5be00640 1 -- 172.21.15.31:0/475002714 learned_addr learned my addr 172.21.15.31:0/475002714 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61200640 1 --2- 172.21.15.31:0/475002714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0d0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61c00640 1 --2- 172.21.15.31:0/475002714 >> v2:172.21.15.102:3300/0 conn(0x7f4f5c06cdd0 0x7f4f5c0b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f5b400640 1 -- 172.21.15.31:0/475002714 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839480666 0 0) 0x7f4f5c06e920 con 0x7f4f5c09b830 2024-09-15T22:51:16.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f5b400640 1 -- 172.21.15.31:0/475002714 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f40003530 con 0x7f4f5c09b830 2024-09-15T22:51:16.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61200640 1 -- 172.21.15.31:0/475002714 >> v2:172.21.15.102:3300/0 conn(0x7f4f5c06cdd0 msgr2=0x7f4f5c0b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:16.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61200640 1 --2- 172.21.15.31:0/475002714 >> v2:172.21.15.102:3300/0 conn(0x7f4f5c06cdd0 0x7f4f5c0b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.517 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61200640 1 -- 172.21.15.31:0/475002714 >> v1:172.21.15.31:6789/0 conn(0x7f4f5c09b830 legacy=0x7f4f5c0d07a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.518 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.512+0000 7f4f61200640 1 -- 172.21.15.31:0/475002714 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c06eb90 con 0x7f4f5c15e790 2024-09-15T22:51:16.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f61200640 1 --2- 172.21.15.31:0/475002714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0d0260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0097c0 tx=0x7f4f4c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1bbf2946d799476 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f5b400640 1 -- 172.21.15.31:0/475002714 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0b0070 con 0x7f4f5c15e790 2024-09-15T22:51:16.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f5b400640 1 -- 172.21.15.31:0/475002714 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f5c0d10c0 con 0x7f4f5c15e790 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f5b400640 1 -- 172.21.15.31:0/475002714 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0ab820 con 0x7f4f5c15e790 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 -- 172.21.15.31:0/475002714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 msgr2=0x7f4f5c0d0260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 --2- 172.21.15.31:0/475002714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0d0260 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0097c0 tx=0x7f4f4c01c410 comp rx=0 tx=0).stop 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 -- 172.21.15.31:0/475002714 shutdown_connections 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 --2- 172.21.15.31:0/475002714 >> v2:172.21.15.102:3300/0 conn(0x7f4f5c06cdd0 0x7f4f5c0b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 --2- 172.21.15.31:0/475002714 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0d0260 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 -- 172.21.15.31:0/475002714 >> 172.21.15.31:0/475002714 conn(0x7f4f5c0b3ed0 msgr2=0x7f4f5c0b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 -- 172.21.15.31:0/475002714 shutdown_connections 2024-09-15T22:51:16.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.516+0000 7f4f63c00640 1 -- 172.21.15.31:0/475002714 wait complete. 2024-09-15T22:51:16.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 Processor -- start 2024-09-15T22:51:16.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- start start 2024-09-15T22:51:16.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c06cdd0 0x7f4f5c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0b1de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c16b6c0 con 0x7f4f5c09b830 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c16b540 con 0x7f4f5c06cdd0 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4f5c16b840 con 0x7f4f5c15e790 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54736/0 (socket says 172.21.15.31:54736) 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 -- 172.21.15.31:0/2086692812 learned_addr learned my addr 172.21.15.31:0/2086692812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f61200640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c06cdd0 0x7f4f5c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f61c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0b1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 -- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 msgr2=0x7f4f5c0b1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0b1de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 -- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c06cdd0 msgr2=0x7f4f5c148dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c06cdd0 0x7f4f5c148dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 -- 172.21.15.31:0/2086692812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c0d1930 con 0x7f4f5c09b830 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f5be00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c430 tx=0x7f4f4800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f48017070 con 0x7f4f5c09b830 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f48005cf0 con 0x7f4f5c09b830 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f480072f0 con 0x7f4f5c09b830 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c09e7e0 con 0x7f4f5c09b830 2024-09-15T22:51:16.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.520+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c0af740 con 0x7f4f5c09b830 2024-09-15T22:51:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f5c09ed00 con 0x7f4f5c09b830 2024-09-15T22:51:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4f4801a070 con 0x7f4f5c09b830 2024-09-15T22:51:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f58c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 0x7f4f3c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f4f48085200 con 0x7f4f5c09b830 2024-09-15T22:51:16.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f61200640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 0x7f4f3c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.524+0000 7f4f61200640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 0x7f4f3c069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ad000 tx=0x7f4f4c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.528+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4f5c09ed00 con 0x7f4f5c09b830 2024-09-15T22:51:16.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.696+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f5c0b51d0 con 0x7f4f5c09b830 2024-09-15T22:51:16.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f58c00640 1 -- 172.21.15.31:0/2086692812 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+16979 (secure 0 0 0) 0x7f4f48055ba0 con 0x7f4f5c09b830 2024-09-15T22:51:16.701 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:16.701 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":38,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:51:15.411658+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:51:13.528767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T22:51:14.356901+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:51:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 msgr2=0x7f4f3c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 0x7f4f3c069d80 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0ad000 tx=0x7f4f4c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:51:16.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 msgr2=0x7f4f5c09dd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c430 tx=0x7f4f4800c8f0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 shutdown_connections 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4f3c0678c0 0x7f4f3c069d80 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4f5c15e790 0x7f4f5c0b1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4f5c09b830 0x7f4f5c09dd90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 --2- 172.21.15.31:0/2086692812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4f5c06cdd0 0x7f4f5c148dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 >> 172.21.15.31:0/2086692812 conn(0x7f4f5c0b3ed0 msgr2=0x7f4f5c0d2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 shutdown_connections 2024-09-15T22:51:16.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.700+0000 7f4f63c00640 1 -- 172.21.15.31:0/2086692812 wait complete. 2024-09-15T22:51:16.722 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:51:16.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 Processor -- start 2024-09-15T22:51:16.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 -- start start 2024-09-15T22:51:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f203c15fb30 0x7f203c0b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f203c0ce830 0x7f203c1600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f203c0d32f0 con 0x7f203c1605f0 2024-09-15T22:51:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f203c160d80 con 0x7f203c0ce830 2024-09-15T22:51:16.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f2042800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f203c0d0b30 con 0x7f203c15fb30 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f203c0ce830 0x7f203c1600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f203c0ce830 0x7f203c1600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54750/0 (socket says 172.21.15.31:54750) 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 -- 172.21.15.31:0/4046289231 learned_addr learned my addr 172.21.15.31:0/4046289231 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203b400640 1 --2- 172.21.15.31:0/4046289231 >> v2:172.21.15.102:3300/0 conn(0x7f203c15fb30 0x7f203c0b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 -- 172.21.15.31:0/4046289231 >> v2:172.21.15.102:3300/0 conn(0x7f203c15fb30 msgr2=0x7f203c0b2f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:16.868 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 --2- 172.21.15.31:0/4046289231 >> v2:172.21.15.102:3300/0 conn(0x7f203c15fb30 0x7f203c0b2f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 -- 172.21.15.31:0/4046289231 >> v1:172.21.15.102:6789/0 conn(0x7f203c1605f0 legacy=0x7f203c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:16.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.864+0000 7f203aa00640 1 -- 172.21.15.31:0/4046289231 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c0d0e10 con 0x7f203c0ce830 2024-09-15T22:51:16.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f203aa00640 1 --2- 172.21.15.31:0/4046289231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c1600b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f203c073380 tx=0x7f202801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e46cf319c7eeb93 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f203a000640 1 -- 172.21.15.31:0/4046289231 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280b1070 con 0x7f203c0ce830 2024-09-15T22:51:16.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f203a000640 1 -- 172.21.15.31:0/4046289231 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20280ac600 con 0x7f203c0ce830 2024-09-15T22:51:16.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f203a000640 1 -- 172.21.15.31:0/4046289231 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20280ac9d0 con 0x7f203c0ce830 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 -- 172.21.15.31:0/4046289231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 msgr2=0x7f203c1600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 --2- 172.21.15.31:0/4046289231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c1600b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f203c073380 tx=0x7f202801c490 comp rx=0 tx=0).stop 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 -- 172.21.15.31:0/4046289231 shutdown_connections 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 --2- 172.21.15.31:0/4046289231 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c1600b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 --2- 172.21.15.31:0/4046289231 >> v2:172.21.15.102:3300/0 conn(0x7f203c15fb30 0x7f203c0b2f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 -- 172.21.15.31:0/4046289231 >> 172.21.15.31:0/4046289231 conn(0x7f203c0d23b0 msgr2=0x7f203c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 -- 172.21.15.31:0/4046289231 shutdown_connections 2024-09-15T22:51:16.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.868+0000 7f2042800640 1 -- 172.21.15.31:0/4046289231 wait complete. 2024-09-15T22:51:16.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 Processor -- start 2024-09-15T22:51:16.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- start start 2024-09-15T22:51:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f203c15fb30 0x7f203c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 0x7f203c06e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f203c169780 con 0x7f203c0ce830 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f203c169600 con 0x7f203c1605f0 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f203c169900 con 0x7f203c15fb30 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54758/0 (socket says 172.21.15.31:54758) 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 -- 172.21.15.31:0/3806177872 learned_addr learned my addr 172.21.15.31:0/3806177872 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203aa00640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f203c15fb30 0x7f203c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203be00640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 0x7f203c06e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 -- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f203c15fb30 msgr2=0x7f203c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f203c15fb30 0x7f203c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 -- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 msgr2=0x7f203c06e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:16.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 0x7f203c06e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 -- 172.21.15.31:0/3806177872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f203c1583f0 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203be00640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 0x7f203c06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f203b400640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f202c00d5f0 tx=0x7f202c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0125f0 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f202c019070 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202c0129d0 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f203c0b7220 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.872+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f203c15c550 con 0x7f203c0ce830 2024-09-15T22:51:16.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f203c1600b0 con 0x7f203c0ce830 2024-09-15T22:51:16.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f202c012b70 con 0x7f203c0ce830 2024-09-15T22:51:16.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f2033400640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 0x7f201c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:16.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 6101+0+0 (secure 0 0 0) 0x7f202c0862d0 con 0x7f203c0ce830 2024-09-15T22:51:16.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f203aa00640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 0x7f201c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:16.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.876+0000 7f203aa00640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 0x7f201c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20280ae000 tx=0x7f20280a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:16.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:16.880+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f202c056be0 con 0x7f203c0ce830 2024-09-15T22:51:17.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.084+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f203c0d2ed0 con 0x7f203c0ce830 2024-09-15T22:51:17.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.980+0000 7f2033400640 1 -- 172.21.15.31:0/3806177872 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7f202c0564e0 con 0x7f203c0ce830 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 msgr2=0x7f201c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 0x7f201c069d80 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f20280ae000 tx=0x7f20280a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 msgr2=0x7f203c158690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f202c00d5f0 tx=0x7f202c00dab0 comp rx=0 tx=0).stop 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 shutdown_connections 2024-09-15T22:51:17.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f201c0678c0 0x7f201c069d80 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f203c1605f0 0x7f203c06e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f203c15fb30 0x7f203c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 --2- 172.21.15.31:0/3806177872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f203c0ce830 0x7f203c158690 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 >> 172.21.15.31:0/3806177872 conn(0x7f203c0d23b0 msgr2=0x7f203c0cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 shutdown_connections 2024-09-15T22:51:17.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:17.984+0000 7f2042800640 1 -- 172.21.15.31:0/3806177872 wait complete. 2024-09-15T22:51:18.010 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:51:18.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:51:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.156+0000 7f4d06400640 1 Processor -- start 2024-09-15T22:51:18.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.156+0000 7f4d06400640 1 -- start start 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.156+0000 7f4d06400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d0015e130 0x7f4d00067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4d06400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0006e770 con 0x7f4d0015e510 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4d06400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d000680c0 con 0x7f4d000aff00 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4d06400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0006f060 con 0x7f4d0015e130 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d0015e130 0x7f4d00067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cf6a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4d0015e510 0x7f4d000af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33120/0 (socket says 172.21.15.31:33120) 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cf6a00640 1 -- 172.21.15.31:0/3951702499 learned_addr learned my addr 172.21.15.31:0/3951702499 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d0015e130 0x7f4d00067a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54768/0 (socket says 172.21.15.31:54768) 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 -- 172.21.15.31:0/3951702499 >> v1:172.21.15.102:6789/0 conn(0x7f4d000aff00 legacy=0x7f4d0006f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 -- 172.21.15.31:0/3951702499 >> v1:172.21.15.31:6789/0 conn(0x7f4d0015e510 legacy=0x7f4d000af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 -- 172.21.15.31:0/3951702499 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0006ea10 con 0x7f4d0015e130 2024-09-15T22:51:18.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cff400640 1 --2- 172.21.15.31:0/3951702499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d00067a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00097c0 tx=0x7f4cf001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ea9570d047f31dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cfea00640 1 -- 172.21.15.31:0/3951702499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00ab430 con 0x7f4d0015e130 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cfea00640 1 -- 172.21.15.31:0/3951702499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cf00b0070 con 0x7f4d0015e130 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.160+0000 7f4cfea00640 1 -- 172.21.15.31:0/3951702499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cf00ab7f0 con 0x7f4d0015e130 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- 172.21.15.31:0/3951702499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 msgr2=0x7f4d00067a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 --2- 172.21.15.31:0/3951702499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d00067a00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00097c0 tx=0x7f4cf001c470 comp rx=0 tx=0).stop 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- 172.21.15.31:0/3951702499 shutdown_connections 2024-09-15T22:51:18.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 --2- 172.21.15.31:0/3951702499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d00067a00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- 172.21.15.31:0/3951702499 >> 172.21.15.31:0/3951702499 conn(0x7f4d00073640 msgr2=0x7f4d0006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- 172.21.15.31:0/3951702499 shutdown_connections 2024-09-15T22:51:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- 172.21.15.31:0/3951702499 wait complete. 2024-09-15T22:51:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 Processor -- start 2024-09-15T22:51:18.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- start start 2024-09-15T22:51:18.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000aff00 0x7f4d0014d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:18.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 0x7f4d000cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0016c260 con 0x7f4d0015e130 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0016c0e0 con 0x7f4d0015e510 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4d06400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0016c3e0 con 0x7f4d000aff00 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54784/0 (socket says 172.21.15.31:54784) 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 -- 172.21.15.31:0/4050428640 learned_addr learned my addr 172.21.15.31:0/4050428640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cff400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000aff00 0x7f4d0014d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cffe00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 0x7f4d000cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 -- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000aff00 msgr2=0x7f4d0014d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000aff00 0x7f4d0014d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 -- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 msgr2=0x7f4d000cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 0x7f4d000cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cf6a00640 1 -- 172.21.15.31:0/4050428640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d00160df0 con 0x7f4d0015e130 2024-09-15T22:51:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.164+0000 7f4cffe00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 0x7f4d000cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf6a00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c4d0 tx=0x7f4ce800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:18.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8017070 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005cf0 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d00161070 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce80072b0 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d00161310 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d00067a00 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4ce801a070 con 0x7f4d0015e130 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 0x7f4cdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:18.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f4ce80850f0 con 0x7f4d0015e130 2024-09-15T22:51:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.168+0000 7f4cff400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 0x7f4cdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:18.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.172+0000 7f4cff400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 0x7f4cdc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00af000 tx=0x7f4cf00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:18.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.172+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d00160df0 con 0x7f4d0015e130 2024-09-15T22:51:18.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.376+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4d00169e90 con 0x7f4d0015e130 2024-09-15T22:51:18.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.984+0000 7f4cf7e00640 1 -- 172.21.15.31:0/4050428640 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) ==== 122+0+0 (secure 0 0 0) 0x7f4ce8055440 con 0x7f4d0015e130 2024-09-15T22:51:18.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 msgr2=0x7f4cdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 0x7f4cdc069d80 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4cf00af000 tx=0x7f4cf00a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 msgr2=0x7f4d0015f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4ce800c4d0 tx=0x7f4ce800c990 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 shutdown_connections 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4cdc0678c0 0x7f4cdc069d80 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d0015e510 0x7f4d000cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d0015e130 0x7f4d0015f280 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 --2- 172.21.15.31:0/4050428640 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d000aff00 0x7f4d0014d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 >> 172.21.15.31:0/4050428640 conn(0x7f4d00073640 msgr2=0x7f4d000b5740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 shutdown_connections 2024-09-15T22:51:18.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:18.988+0000 7f4d06400640 1 -- 172.21.15.31:0/4050428640 wait complete. 2024-09-15T22:51:19.014 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:51:19.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:19.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.156+0000 7fd8c4600640 1 Processor -- start 2024-09-15T22:51:19.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.156+0000 7fd8c4600640 1 -- start start 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c4600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8bc06f270 0x7fd8bc06f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c4600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd8bc0b47a0 0x7fd8bc072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c4600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8bc072aa0 con 0x7fd8bc0726a0 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c4600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd8bc15ba60 con 0x7fd8bc06f270 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c4600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd8bc0affa0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8bc06f270 0x7fd8bc06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd8bc06f270 0x7fd8bc06f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54794/0 (socket says 172.21.15.31:54794) 2024-09-15T22:51:19.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 -- 172.21.15.31:0/3091457846 learned_addr learned my addr 172.21.15.31:0/3091457846 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c2600640 1 --1- 172.21.15.31:0/3091457846 >> v1:172.21.15.31:6789/0 conn(0x7fd8bc0726a0 0x7fd8bc15c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33132/0 (socket says 172.21.15.31:33132) 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1200640 1 --2- 172.21.15.31:0/3091457846 >> v2:172.21.15.102:3300/0 conn(0x7fd8bc0b47a0 0x7fd8bc072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 -- 172.21.15.31:0/3091457846 >> v2:172.21.15.102:3300/0 conn(0x7fd8bc0b47a0 msgr2=0x7fd8bc072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/3091457846 >> v2:172.21.15.102:3300/0 conn(0x7fd8bc0b47a0 0x7fd8bc072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 -- 172.21.15.31:0/3091457846 >> v1:172.21.15.31:6789/0 conn(0x7fd8bc0726a0 legacy=0x7fd8bc15c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 -- 172.21.15.31:0/3091457846 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc06fb90 con 0x7fd8bc06f270 2024-09-15T22:51:19.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8bbe00640 1 -- 172.21.15.31:0/3091457846 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637774459 0 0) 0x7fd8bc072aa0 con 0x7fd8bc0726a0 2024-09-15T22:51:19.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.160+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/3091457846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc06f270 0x7fd8bc06f650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc073580 tx=0x7fd8b001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebfae9c61c2ba96d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8bbe00640 1 -- 172.21.15.31:0/3091457846 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00b4070 con 0x7fd8bc06f270 2024-09-15T22:51:19.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8bbe00640 1 -- 172.21.15.31:0/3091457846 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b00a7ad0 con 0x7fd8bc06f270 2024-09-15T22:51:19.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8bbe00640 1 -- 172.21.15.31:0/3091457846 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00af440 con 0x7fd8bc06f270 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- 172.21.15.31:0/3091457846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc06f270 msgr2=0x7fd8bc06f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- 172.21.15.31:0/3091457846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc06f270 0x7fd8bc06f650 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc073580 tx=0x7fd8b001ebf0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- 172.21.15.31:0/3091457846 shutdown_connections 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- 172.21.15.31:0/3091457846 >> v2:172.21.15.102:3300/0 conn(0x7fd8bc0b47a0 0x7fd8bc072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- 172.21.15.31:0/3091457846 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc06f270 0x7fd8bc06f650 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- 172.21.15.31:0/3091457846 >> 172.21.15.31:0/3091457846 conn(0x7fd8bc067e00 msgr2=0x7fd8bc06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- 172.21.15.31:0/3091457846 shutdown_connections 2024-09-15T22:51:19.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- 172.21.15.31:0/3091457846 wait complete. 2024-09-15T22:51:19.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 Processor -- start 2024-09-15T22:51:19.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- start start 2024-09-15T22:51:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 0x7fd8bc147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8bc0726a0 0x7fd8bc1f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc0b3fa0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd8bc0b3cc0 con 0x7fd8bc0726a0 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c4600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd8bc155a10 con 0x7fd8bc06f270 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54810/0 (socket says 172.21.15.31:54810) 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.164+0000 7fd8c2600640 1 -- 172.21.15.31:0/988324836 learned_addr learned my addr 172.21.15.31:0/988324836 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 0x7fd8bc147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c1200640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8bc0726a0 0x7fd8bc1f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 -- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 msgr2=0x7fd8bc147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 0x7fd8bc147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 -- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8bc0726a0 msgr2=0x7fd8bc1f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8bc0726a0 0x7fd8bc1f8370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 -- 172.21.15.31:0/988324836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8bc1f7ce0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 0x7fd8bc147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c2600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c7a0 tx=0x7fd8b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b4018070 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8b400a640 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8b400aab0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8bc1f7fc0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8bc149e90 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8bc0b4bb0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd8b400ac50 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 0x7fd89c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.168+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fd8b4085400 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.172+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 0x7fd89c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.172+0000 7fd8c1c00640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 0x7fd89c069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00b1000 tx=0x7fd8b00a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.172+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd8b4055da0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.372+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd8bc14a060 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8b9600640 1 -- 172.21.15.31:0/988324836 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7fd8b40556a0 con 0x7fd8bc0b47a0 2024-09-15T22:51:19.377 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:19.377 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"2024-09-15T22:51:18:986929+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3621432872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3621432872},{"type":"v1","addr":"172.21.15.31:6834","nonce":3621432872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2733624123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2733624123},{"type":"v1","addr":"172.21.15.102:6837","nonce":2733624123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3976047272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3976047272},{"type":"v1","addr":"172.21.15.102:6836","nonce":3976047272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:18.378937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4872":{"gid":4872,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3813108153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3813108153},{"type":"v1","addr":"172.21.15.31:6835","nonce":3813108153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4872,"qdb_cluster":[4872]},"id":2}]} 2024-09-15T22:51:19.377 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 msgr2=0x7fd89c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 0x7fd89c069db0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00b1000 tx=0x7fd8b00a9070 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 msgr2=0x7fd8bc1f71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd8b400c7a0 tx=0x7fd8b400cc60 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 shutdown_connections 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd89c0678f0 0x7fd89c069db0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd8bc0b47a0 0x7fd8bc1f71b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd8bc0726a0 0x7fd8bc1f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 --2- 172.21.15.31:0/988324836 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd8bc06f270 0x7fd8bc147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 >> 172.21.15.31:0/988324836 conn(0x7fd8bc067e00 msgr2=0x7fd8bc154e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:19.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 shutdown_connections 2024-09-15T22:51:19.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.376+0000 7fd8c4600640 1 -- 172.21.15.31:0/988324836 wait complete. 2024-09-15T22:51:19.398 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:51:19.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.536+0000 7f7047800640 1 Processor -- start 2024-09-15T22:51:19.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.536+0000 7f7047800640 1 -- start start 2024-09-15T22:51:19.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7047800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f704006f270 0x7f704006f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7047800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7040072870 0x7f704015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7047800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704006fb90 con 0x7f70400b47a0 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7047800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f704015ba60 con 0x7f7040072870 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7047800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70400affa0 con 0x7f704006f270 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7040072870 0x7f704015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7040072870 0x7f704015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54812/0 (socket says 172.21.15.31:54812) 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 -- 172.21.15.31:0/1315456107 learned_addr learned my addr 172.21.15.31:0/1315456107 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7037e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f70400b47a0 0x7f7040072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33136/0 (socket says 172.21.15.31:33136) 2024-09-15T22:51:19.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7044e00640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f704006f270 0x7f704006f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 -- 172.21.15.31:0/1315456107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f704006f270 msgr2=0x7f704006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:19.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f704006f270 0x7f704006f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 -- 172.21.15.31:0/1315456107 >> v1:172.21.15.31:6789/0 conn(0x7f70400b47a0 legacy=0x7f7040072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f7045800640 1 -- 172.21.15.31:0/1315456107 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7040072d40 con 0x7f7040072870 2024-09-15T22:51:19.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.540+0000 7f703fe00640 1 -- 172.21.15.31:0/1315456107 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461692741 0 0) 0x7f704006fb90 con 0x7f70400b47a0 2024-09-15T22:51:19.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7045800640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7040072870 0x7f704015c840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7038009e50 tx=0x7f703801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1829a7af4cd9a1ab server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f703fe00640 1 -- 172.21.15.31:0/1315456107 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380a57f0 con 0x7f7040072870 2024-09-15T22:51:19.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f703fe00640 1 -- 172.21.15.31:0/1315456107 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70380a5990 con 0x7f7040072870 2024-09-15T22:51:19.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f703fe00640 1 -- 172.21.15.31:0/1315456107 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70380a5d60 con 0x7f7040072870 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- 172.21.15.31:0/1315456107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7040072870 msgr2=0x7f704015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7040072870 0x7f704015c840 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7038009e50 tx=0x7f703801ca30 comp rx=0 tx=0).stop 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- 172.21.15.31:0/1315456107 shutdown_connections 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7040072870 0x7f704015c840 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- 172.21.15.31:0/1315456107 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f704006f270 0x7f704006f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- 172.21.15.31:0/1315456107 >> 172.21.15.31:0/1315456107 conn(0x7f7040067e00 msgr2=0x7f704006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- 172.21.15.31:0/1315456107 shutdown_connections 2024-09-15T22:51:19.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- 172.21.15.31:0/1315456107 wait complete. 2024-09-15T22:51:19.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 Processor -- start 2024-09-15T22:51:19.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- start start 2024-09-15T22:51:19.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7040072870 0x7f70400b0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 0x7f704015a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7040155b90 con 0x7f704006f270 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7040155a10 con 0x7f7040072870 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.544+0000 7f7047800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f70400b4bc0 con 0x7f70400b47a0 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54818/0 (socket says 172.21.15.31:54818) 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 -- 172.21.15.31:0/435761523 learned_addr learned my addr 172.21.15.31:0/435761523 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7045800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 0x7f704015a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7037e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7040072870 0x7f70400b0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 -- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 msgr2=0x7f704015a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.550 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 0x7f704015a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 -- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7040072870 msgr2=0x7f70400b0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7040072870 0x7f70400b0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 -- 172.21.15.31:0/435761523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70400b14f0 con 0x7f704006f270 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7045800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 0x7f704015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7044e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f703000e960 tx=0x7f703000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7030017070 con 0x7f704006f270 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f703000ca00 con 0x7f704006f270 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70400b17d0 con 0x7f704006f270 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f703000cdb0 con 0x7f704006f270 2024-09-15T22:51:19.551 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70400b1d90 con 0x7f704006f270 2024-09-15T22:51:19.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f704015e310 con 0x7f704006f270 2024-09-15T22:51:19.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.548+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f703001a070 con 0x7f704006f270 2024-09-15T22:51:19.552 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.552+0000 7f703d600640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 0x7f701c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.552+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f7030086280 con 0x7f704006f270 2024-09-15T22:51:19.553 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.552+0000 7f7037e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 0x7f701c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.554 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.552+0000 7f7037e00640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 0x7f701c069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f704014cff0 tx=0x7f7028007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.557 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.556+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7030056b90 con 0x7f704006f270 2024-09-15T22:51:19.723 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.720+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70400724d0 con 0x7f704006f270 2024-09-15T22:51:19.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.720+0000 7f703d600640 1 -- 172.21.15.31:0/435761523 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) ==== 74+0+16966 (secure 0 0 0) 0x7f7030056490 con 0x7f704006f270 2024-09-15T22:51:19.724 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:19.725 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:51:16.954527+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:51:13.528767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T22:51:14.356901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 msgr2=0x7f701c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 0x7f701c069db0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f704014cff0 tx=0x7f7028007c10 comp rx=0 tx=0).stop 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 msgr2=0x7f7040146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f703000e960 tx=0x7f703000ee20 comp rx=0 tx=0).stop 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 shutdown_connections 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f701c0678f0 0x7f701c069db0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f70400b47a0 0x7f704015a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7040072870 0x7f70400b0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 --2- 172.21.15.31:0/435761523 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f704006f270 0x7f7040146fe0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 >> 172.21.15.31:0/435761523 conn(0x7f7040067e00 msgr2=0x7f7040150f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 shutdown_connections 2024-09-15T22:51:19.728 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.724+0000 7f7047800640 1 -- 172.21.15.31:0/435761523 wait complete. 2024-09-15T22:51:19.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:51:19.746 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:51:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 Processor -- start 2024-09-15T22:51:19.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 -- start start 2024-09-15T22:51:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f87280b47a0 0x7f8728072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f872815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8728072ad0 con 0x7f872806f270 2024-09-15T22:51:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f872815ba60 con 0x7f87280b47a0 2024-09-15T22:51:19.888 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f872d000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f87280affa0 con 0x7f87280726a0 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f871d400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f87280b47a0 0x7f8728072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f8725e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f872806f270 0x7f872806f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:45574/0 (socket says 172.21.15.31:45574) 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f871d400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f87280b47a0 0x7f8728072160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:44258/0 (socket says 172.21.15.31:44258) 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f8725e00640 1 -- 172.21.15.31:0/761615638 learned_addr learned my addr 172.21.15.31:0/761615638 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.884+0000 7f8726800640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f872815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f871d400640 1 -- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 msgr2=0x7f872815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f871d400640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f872815c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f871d400640 1 -- 172.21.15.31:0/761615638 >> v1:172.21.15.102:6789/0 conn(0x7f872806f270 legacy=0x7f872806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f871d400640 1 -- 172.21.15.31:0/761615638 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728072d40 con 0x7f87280b47a0 2024-09-15T22:51:19.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f8725400640 1 -- 172.21.15.31:0/761615638 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61660344 0 0) 0x7f8728072ad0 con 0x7f872806f270 2024-09-15T22:51:19.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f871d400640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728072160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f871001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab8b609be8c19f4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f8725400640 1 -- 172.21.15.31:0/761615638 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87100b2070 con 0x7f87280b47a0 2024-09-15T22:51:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f8725400640 1 -- 172.21.15.31:0/761615638 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87100ad640 con 0x7f87280b47a0 2024-09-15T22:51:19.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f8725400640 1 -- 172.21.15.31:0/761615638 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87100ada10 con 0x7f87280b47a0 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f872d000640 1 -- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 msgr2=0x7f8728072160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.888+0000 7f872d000640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728072160 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f87100097c0 tx=0x7f871001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- 172.21.15.31:0/761615638 shutdown_connections 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f872815c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 --2- 172.21.15.31:0/761615638 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728072160 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- 172.21.15.31:0/761615638 >> 172.21.15.31:0/761615638 conn(0x7f8728067e00 msgr2=0x7f872806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- 172.21.15.31:0/761615638 shutdown_connections 2024-09-15T22:51:19.893 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- 172.21.15.31:0/761615638 wait complete. 2024-09-15T22:51:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 Processor -- start 2024-09-15T22:51:19.894 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- start start 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f87281528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f87280b4c30 con 0x7f872806f270 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8728155a10 con 0x7f87280b47a0 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8728146ed0 con 0x7f87280726a0 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54820/0 (socket says 172.21.15.31:54820) 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 -- 172.21.15.31:0/1635822445 learned_addr learned my addr 172.21.15.31:0/1635822445 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8726800640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f871d400640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f87281528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 -- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 msgr2=0x7f87281528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f87281528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 -- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 msgr2=0x7f8728154f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728154f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:19.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 -- 172.21.15.31:0/1635822445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8728152e00 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f8725e00640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f871800c580 tx=0x7f871800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718017070 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8718005d10 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8728153ba0 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.892+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8718007330 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8728154160 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f872815d190 con 0x7f872806f270 2024-09-15T22:51:19.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f871801a070 con 0x7f872806f270 2024-09-15T22:51:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f871ea00640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 0x7f8704069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f8718085270 con 0x7f872806f270 2024-09-15T22:51:19.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f871d400640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 0x7f8704069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:19.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.896+0000 7f871d400640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 0x7f8704069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87100af000 tx=0x7f8710008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:19.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:19.900+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8718055540 con 0x7f872806f270 2024-09-15T22:51:19.928 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-15T22:51:19.924+0000 7f0c40000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:51:20.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.064+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f872815e960 con 0x7f87040678f0 2024-09-15T22:51:20.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.072+0000 7f871ea00640 1 -- 172.21.15.31:0/1635822445 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f872815e960 con 0x7f87040678f0 2024-09-15T22:51:20.078 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:20.080 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 msgr2=0x7f8704069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 0x7f8704069db0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f87100af000 tx=0x7f8710008040 comp rx=0 tx=0).stop 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 msgr2=0x7f8728146990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f871800c580 tx=0x7f871800ca40 comp rx=0 tx=0).stop 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 shutdown_connections 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f87040678f0 0x7f8704069db0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f87280b47a0 0x7f8728154f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f87280726a0 0x7f87281528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 --2- 172.21.15.31:0/1635822445 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f872806f270 0x7f8728146990 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 >> 172.21.15.31:0/1635822445 conn(0x7f8728067e00 msgr2=0x7f87280b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 shutdown_connections 2024-09-15T22:51:20.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.076+0000 7f872d000640 1 -- 172.21.15.31:0/1635822445 wait complete. 2024-09-15T22:51:20.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-15T22:51:19.569266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4538368,"data_stored":2605898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.624999"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960093+0000","last_change":"2024-09-15T22:51:14.960093+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960093+0000","last_undegraded":"2024-09-15T22:51:14.960093+0000","last_fullsized":"2024-09-15T22:51:14.960093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962022+0000","last_change":"2024-09-15T22:51:14.962022+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962022+0000","last_undegraded":"2024-09-15T22:51:14.962022+0000","last_fullsized":"2024-09-15T22:51:14.962022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965376+0000","last_change":"2024-09-15T22:51:14.965376+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965376+0000","last_undegraded":"2024-09-15T22:51:14.965376+0000","last_fullsized":"2024-09-15T22:51:14.965376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959294+0000","last_change":"2024-09-15T22:51:14.959294+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959294+0000","last_undegraded":"2024-09-15T22:51:14.959294+0000","last_fullsized":"2024-09-15T22:51:14.959294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958919+0000","last_change":"2024-09-15T22:51:14.958919+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958919+0000","last_undegraded":"2024-09-15T22:51:14.958919+0000","last_fullsized":"2024-09-15T22:51:14.958919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960367+0000","last_change":"2024-09-15T22:51:14.960367+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960367+0000","last_undegraded":"2024-09-15T22:51:14.960367+0000","last_fullsized":"2024-09-15T22:51:14.960367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963179+0000","last_change":"2024-09-15T22:51:14.963179+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963179+0000","last_undegraded":"2024-09-15T22:51:14.963179+0000","last_fullsized":"2024-09-15T22:51:14.963179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959534+0000","last_change":"2024-09-15T22:51:14.959534+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959534+0000","last_undegraded":"2024-09-15T22:51:14.959534+0000","last_fullsized":"2024-09-15T22:51:14.959534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965805+0000","last_change":"2024-09-15T22:51:14.965805+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965805+0000","last_undegraded":"2024-09-15T22:51:14.965805+0000","last_fullsized":"2024-09-15T22:51:14.965805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.971772+0000","last_change":"2024-09-15T22:51:14.971772+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.971772+0000","last_undegraded":"2024-09-15T22:51:14.971772+0000","last_fullsized":"2024-09-15T22:51:14.971772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967862+0000","last_change":"2024-09-15T22:51:14.967862+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967862+0000","last_undegraded":"2024-09-15T22:51:14.967862+0000","last_fullsized":"2024-09-15T22:51:14.967862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964856+0000","last_change":"2024-09-15T22:51:14.964856+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964856+0000","last_undegraded":"2024-09-15T22:51:14.964856+0000","last_fullsized":"2024-09-15T22:51:14.964856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968343+0000","last_change":"2024-09-15T22:51:14.968343+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968343+0000","last_undegraded":"2024-09-15T22:51:14.968343+0000","last_fullsized":"2024-09-15T22:51:14.968343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969345+0000","last_change":"2024-09-15T22:51:14.969345+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969345+0000","last_undegraded":"2024-09-15T22:51:14.969345+0000","last_fullsized":"2024-09-15T22:51:14.969345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962670+0000","last_change":"2024-09-15T22:51:14.962670+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962670+0000","last_undegraded":"2024-09-15T22:51:14.962670+0000","last_fullsized":"2024-09-15T22:51:14.962670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.973428+0000","last_change":"2024-09-15T22:51:14.973428+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.973428+0000","last_undegraded":"2024-09-15T22:51:14.973428+0000","last_fullsized":"2024-09-15T22:51:14.973428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975197+0000","last_change":"2024-09-15T22:51:14.975197+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975197+0000","last_undegraded":"2024-09-15T22:51:14.975197+0000","last_fullsized":"2024-09-15T22:51:14.975197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958809+0000","last_change":"2024-09-15T22:51:14.958809+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958809+0000","last_undegraded":"2024-09-15T22:51:14.958809+0000","last_fullsized":"2024-09-15T22:51:14.958809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964145+0000","last_change":"2024-09-15T22:51:14.964145+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964145+0000","last_undegraded":"2024-09-15T22:51:14.964145+0000","last_fullsized":"2024-09-15T22:51:14.964145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967813+0000","last_change":"2024-09-15T22:51:14.967813+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967813+0000","last_undegraded":"2024-09-15T22:51:14.967813+0000","last_fullsized":"2024-09-15T22:51:14.967813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965191+0000","last_change":"2024-09-15T22:51:14.965191+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965191+0000","last_undegraded":"2024-09-15T22:51:14.965191+0000","last_fullsized":"2024-09-15T22:51:14.965191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977196+0000","last_change":"2024-09-15T22:51:14.977196+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977196+0000","last_undegraded":"2024-09-15T22:51:14.977196+0000","last_fullsized":"2024-09-15T22:51:14.977196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959297+0000","last_change":"2024-09-15T22:51:14.959297+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959297+0000","last_undegraded":"2024-09-15T22:51:14.959297+0000","last_fullsized":"2024-09-15T22:51:14.959297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964786+0000","last_change":"2024-09-15T22:51:14.964786+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964786+0000","last_undegraded":"2024-09-15T22:51:14.964786+0000","last_fullsized":"2024-09-15T22:51:14.964786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962735+0000","last_change":"2024-09-15T22:51:14.962735+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962735+0000","last_undegraded":"2024-09-15T22:51:14.962735+0000","last_fullsized":"2024-09-15T22:51:14.962735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.966193+0000","last_change":"2024-09-15T22:51:14.966193+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.966193+0000","last_undegraded":"2024-09-15T22:51:14.966193+0000","last_fullsized":"2024-09-15T22:51:14.966193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968563+0000","last_change":"2024-09-15T22:51:14.968563+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968563+0000","last_undegraded":"2024-09-15T22:51:14.968563+0000","last_fullsized":"2024-09-15T22:51:14.968563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965400+0000","last_change":"2024-09-15T22:51:14.965400+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965400+0000","last_undegraded":"2024-09-15T22:51:14.965400+0000","last_fullsized":"2024-09-15T22:51:14.965400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974352+0000","last_change":"2024-09-15T22:51:14.974352+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974352+0000","last_undegraded":"2024-09-15T22:51:14.974352+0000","last_fullsized":"2024-09-15T22:51:14.974352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961903+0000","last_change":"2024-09-15T22:51:14.961903+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961903+0000","last_undegraded":"2024-09-15T22:51:14.961903+0000","last_fullsized":"2024-09-15T22:51:14.961903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977273+0000","last_change":"2024-09-15T22:51:14.977273+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977273+0000","last_undegraded":"2024-09-15T22:51:14.977273+0000","last_fullsized":"2024-09-15T22:51:14.977273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979097+0000","last_change":"2024-09-15T22:51:14.976712+0000","last_active":"2024-09-15T22:51:14.979097+0000","last_peered":"2024-09-15T22:51:14.979097+0000","last_clean":"2024-09-15T22:51:14.979097+0000","last_became_active":"2024-09-15T22:51:14.976384+0000","last_became_peered":"2024-09-15T22:51:14.976384+0000","last_unstale":"2024-09-15T22:51:14.979097+0000","last_undegraded":"2024-09-15T22:51:14.979097+0000","last_fullsized":"2024-09-15T22:51:14.979097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964155+0000","last_change":"2024-09-15T22:51:14.964155+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964155+0000","last_undegraded":"2024-09-15T22:51:14.964155+0000","last_fullsized":"2024-09-15T22:51:14.964155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982284+0000","last_change":"2024-09-15T22:51:14.981079+0000","last_active":"2024-09-15T22:51:14.982284+0000","last_peered":"2024-09-15T22:51:14.982284+0000","last_clean":"2024-09-15T22:51:14.982284+0000","last_became_active":"2024-09-15T22:51:14.980582+0000","last_became_peered":"2024-09-15T22:51:14.980582+0000","last_unstale":"2024-09-15T22:51:14.982284+0000","last_undegraded":"2024-09-15T22:51:14.982284+0000","last_fullsized":"2024-09-15T22:51:14.982284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962897+0000","last_change":"2024-09-15T22:51:14.962897+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962897+0000","last_undegraded":"2024-09-15T22:51:14.962897+0000","last_fullsized":"2024-09-15T22:51:14.962897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982029+0000","last_change":"2024-09-15T22:51:14.978636+0000","last_active":"2024-09-15T22:51:14.982029+0000","last_peered":"2024-09-15T22:51:14.982029+0000","last_clean":"2024-09-15T22:51:14.982029+0000","last_became_active":"2024-09-15T22:51:14.978265+0000","last_became_peered":"2024-09-15T22:51:14.978265+0000","last_unstale":"2024-09-15T22:51:14.982029+0000","last_undegraded":"2024-09-15T22:51:14.982029+0000","last_fullsized":"2024-09-15T22:51:14.982029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960964+0000","last_change":"2024-09-15T22:51:14.960964+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960964+0000","last_undegraded":"2024-09-15T22:51:14.960964+0000","last_fullsized":"2024-09-15T22:51:14.960964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976881+0000","last_change":"2024-09-15T22:51:14.974047+0000","last_active":"2024-09-15T22:51:14.976881+0000","last_peered":"2024-09-15T22:51:14.976881+0000","last_clean":"2024-09-15T22:51:14.976881+0000","last_became_active":"2024-09-15T22:51:14.973769+0000","last_became_peered":"2024-09-15T22:51:14.973769+0000","last_unstale":"2024-09-15T22:51:14.976881+0000","last_undegraded":"2024-09-15T22:51:14.976881+0000","last_fullsized":"2024-09-15T22:51:14.976881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963339+0000","last_change":"2024-09-15T22:51:14.963339+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963339+0000","last_undegraded":"2024-09-15T22:51:14.963339+0000","last_fullsized":"2024-09-15T22:51:14.963339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981420+0000","last_change":"2024-09-15T22:51:14.974086+0000","last_active":"2024-09-15T22:51:14.981420+0000","last_peered":"2024-09-15T22:51:14.981420+0000","last_clean":"2024-09-15T22:51:14.981420+0000","last_became_active":"2024-09-15T22:51:14.973787+0000","last_became_peered":"2024-09-15T22:51:14.973787+0000","last_unstale":"2024-09-15T22:51:14.981420+0000","last_undegraded":"2024-09-15T22:51:14.981420+0000","last_fullsized":"2024-09-15T22:51:14.981420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:02.055900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962162+0000","last_change":"2024-09-15T22:51:14.962162+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962162+0000","last_undegraded":"2024-09-15T22:51:14.962162+0000","last_fullsized":"2024-09-15T22:51:14.962162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989228+0000","last_change":"2024-09-15T22:51:14.986951+0000","last_active":"2024-09-15T22:51:14.989228+0000","last_peered":"2024-09-15T22:51:14.989228+0000","last_clean":"2024-09-15T22:51:14.989228+0000","last_became_active":"2024-09-15T22:51:14.986518+0000","last_became_peered":"2024-09-15T22:51:14.986518+0000","last_unstale":"2024-09-15T22:51:14.989228+0000","last_undegraded":"2024-09-15T22:51:14.989228+0000","last_fullsized":"2024-09-15T22:51:14.989228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964195+0000","last_change":"2024-09-15T22:51:14.964195+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964195+0000","last_undegraded":"2024-09-15T22:51:14.964195+0000","last_fullsized":"2024-09-15T22:51:14.964195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976684+0000","last_change":"2024-09-15T22:51:14.973894+0000","last_active":"2024-09-15T22:51:14.976684+0000","last_peered":"2024-09-15T22:51:14.976684+0000","last_clean":"2024-09-15T22:51:14.976684+0000","last_became_active":"2024-09-15T22:51:14.973577+0000","last_became_peered":"2024-09-15T22:51:14.973577+0000","last_unstale":"2024-09-15T22:51:14.976684+0000","last_undegraded":"2024-09-15T22:51:14.976684+0000","last_fullsized":"2024-09-15T22:51:14.976684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961086+0000","last_change":"2024-09-15T22:51:14.961086+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961086+0000","last_undegraded":"2024-09-15T22:51:14.961086+0000","last_fullsized":"2024-09-15T22:51:14.961086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976811+0000","last_change":"2024-09-15T22:51:14.972066+0000","last_active":"2024-09-15T22:51:14.976811+0000","last_peered":"2024-09-15T22:51:14.976811+0000","last_clean":"2024-09-15T22:51:14.976811+0000","last_became_active":"2024-09-15T22:51:14.971640+0000","last_became_peered":"2024-09-15T22:51:14.971640+0000","last_unstale":"2024-09-15T22:51:14.976811+0000","last_undegraded":"2024-09-15T22:51:14.976811+0000","last_fullsized":"2024-09-15T22:51:14.976811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958245+0000","last_change":"2024-09-15T22:51:14.958245+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958245+0000","last_undegraded":"2024-09-15T22:51:14.958245+0000","last_fullsized":"2024-09-15T22:51:14.958245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977235+0000","last_change":"2024-09-15T22:51:14.972265+0000","last_active":"2024-09-15T22:51:14.977235+0000","last_peered":"2024-09-15T22:51:14.977235+0000","last_clean":"2024-09-15T22:51:14.977235+0000","last_became_active":"2024-09-15T22:51:14.971919+0000","last_became_peered":"2024-09-15T22:51:14.971919+0000","last_unstale":"2024-09-15T22:51:14.977235+0000","last_undegraded":"2024-09-15T22:51:14.977235+0000","last_fullsized":"2024-09-15T22:51:14.977235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.491357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.978317+0000","last_change":"2024-09-15T22:51:14.978317+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.978317+0000","last_undegraded":"2024-09-15T22:51:14.978317+0000","last_fullsized":"2024-09-15T22:51:14.978317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985757+0000","last_change":"2024-09-15T22:51:14.979937+0000","last_active":"2024-09-15T22:51:14.985757+0000","last_peered":"2024-09-15T22:51:14.985757+0000","last_clean":"2024-09-15T22:51:14.985757+0000","last_became_active":"2024-09-15T22:51:14.979599+0000","last_became_peered":"2024-09-15T22:51:14.979599+0000","last_unstale":"2024-09-15T22:51:14.985757+0000","last_undegraded":"2024-09-15T22:51:14.985757+0000","last_fullsized":"2024-09-15T22:51:14.985757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:28.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961676+0000","last_change":"2024-09-15T22:51:14.961676+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961676+0000","last_undegraded":"2024-09-15T22:51:14.961676+0000","last_fullsized":"2024-09-15T22:51:14.961676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985795+0000","last_change":"2024-09-15T22:51:14.980163+0000","last_active":"2024-09-15T22:51:14.985795+0000","last_peered":"2024-09-15T22:51:14.985795+0000","last_clean":"2024-09-15T22:51:14.985795+0000","last_became_active":"2024-09-15T22:51:14.979726+0000","last_became_peered":"2024-09-15T22:51:14.979726+0000","last_unstale":"2024-09-15T22:51:14.985795+0000","last_undegraded":"2024-09-15T22:51:14.985795+0000","last_fullsized":"2024-09-15T22:51:14.985795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:03.182113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961440+0000","last_change":"2024-09-15T22:51:14.961440+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961440+0000","last_undegraded":"2024-09-15T22:51:14.961440+0000","last_fullsized":"2024-09-15T22:51:14.961440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981142+0000","last_change":"2024-09-15T22:51:14.980076+0000","last_active":"2024-09-15T22:51:14.981142+0000","last_peered":"2024-09-15T22:51:14.981142+0000","last_clean":"2024-09-15T22:51:14.981142+0000","last_became_active":"2024-09-15T22:51:14.979781+0000","last_became_peered":"2024-09-15T22:51:14.979781+0000","last_unstale":"2024-09-15T22:51:14.981142+0000","last_undegraded":"2024-09-15T22:51:14.981142+0000","last_fullsized":"2024-09-15T22:51:14.981142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:06.565997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960407+0000","last_change":"2024-09-15T22:51:14.960407+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960407+0000","last_undegraded":"2024-09-15T22:51:14.960407+0000","last_fullsized":"2024-09-15T22:51:14.960407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975741+0000","last_change":"2024-09-15T22:51:14.971500+0000","last_active":"2024-09-15T22:51:14.975741+0000","last_peered":"2024-09-15T22:51:14.975741+0000","last_clean":"2024-09-15T22:51:14.975741+0000","last_became_active":"2024-09-15T22:51:14.971212+0000","last_became_peered":"2024-09-15T22:51:14.971212+0000","last_unstale":"2024-09-15T22:51:14.975741+0000","last_undegraded":"2024-09-15T22:51:14.975741+0000","last_fullsized":"2024-09-15T22:51:14.975741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959157+0000","last_change":"2024-09-15T22:51:14.959157+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959157+0000","last_undegraded":"2024-09-15T22:51:14.959157+0000","last_fullsized":"2024-09-15T22:51:14.959157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976720+0000","last_change":"2024-09-15T22:51:14.974430+0000","last_active":"2024-09-15T22:51:14.976720+0000","last_peered":"2024-09-15T22:51:14.976720+0000","last_clean":"2024-09-15T22:51:14.976720+0000","last_became_active":"2024-09-15T22:51:14.974129+0000","last_became_peered":"2024-09-15T22:51:14.974129+0000","last_unstale":"2024-09-15T22:51:14.976720+0000","last_undegraded":"2024-09-15T22:51:14.976720+0000","last_fullsized":"2024-09-15T22:51:14.976720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975580+0000","last_change":"2024-09-15T22:51:14.975580+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975580+0000","last_undegraded":"2024-09-15T22:51:14.975580+0000","last_fullsized":"2024-09-15T22:51:14.975580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978766+0000","last_change":"2024-09-15T22:51:14.973590+0000","last_active":"2024-09-15T22:51:14.978766+0000","last_peered":"2024-09-15T22:51:14.978766+0000","last_clean":"2024-09-15T22:51:14.978766+0000","last_became_active":"2024-09-15T22:51:14.973243+0000","last_became_peered":"2024-09-15T22:51:14.973243+0000","last_unstale":"2024-09-15T22:51:14.978766+0000","last_undegraded":"2024-09-15T22:51:14.978766+0000","last_fullsized":"2024-09-15T22:51:14.978766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960536+0000","last_change":"2024-09-15T22:51:14.960536+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960536+0000","last_undegraded":"2024-09-15T22:51:14.960536+0000","last_fullsized":"2024-09-15T22:51:14.960536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.987568+0000","last_change":"2024-09-15T22:51:14.985081+0000","last_active":"2024-09-15T22:51:14.987568+0000","last_peered":"2024-09-15T22:51:14.987568+0000","last_clean":"2024-09-15T22:51:14.987568+0000","last_became_active":"2024-09-15T22:51:14.984750+0000","last_became_peered":"2024-09-15T22:51:14.984750+0000","last_unstale":"2024-09-15T22:51:14.987568+0000","last_undegraded":"2024-09-15T22:51:14.987568+0000","last_fullsized":"2024-09-15T22:51:14.987568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961252+0000","last_change":"2024-09-15T22:51:14.961252+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961252+0000","last_undegraded":"2024-09-15T22:51:14.961252+0000","last_fullsized":"2024-09-15T22:51:14.961252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985949+0000","last_change":"2024-09-15T22:51:14.981702+0000","last_active":"2024-09-15T22:51:14.985949+0000","last_peered":"2024-09-15T22:51:14.985949+0000","last_clean":"2024-09-15T22:51:14.985949+0000","last_became_active":"2024-09-15T22:51:14.981473+0000","last_became_peered":"2024-09-15T22:51:14.981473+0000","last_unstale":"2024-09-15T22:51:14.985949+0000","last_undegraded":"2024-09-15T22:51:14.985949+0000","last_fullsized":"2024-09-15T22:51:14.985949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:48.535081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967496+0000","last_change":"2024-09-15T22:51:14.967496+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967496+0000","last_undegraded":"2024-09-15T22:51:14.967496+0000","last_fullsized":"2024-09-15T22:51:14.967496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978420+0000","last_change":"2024-09-15T22:51:14.975951+0000","last_active":"2024-09-15T22:51:14.978420+0000","last_peered":"2024-09-15T22:51:14.978420+0000","last_clean":"2024-09-15T22:51:14.978420+0000","last_became_active":"2024-09-15T22:51:14.975646+0000","last_became_peered":"2024-09-15T22:51:14.975646+0000","last_unstale":"2024-09-15T22:51:14.978420+0000","last_undegraded":"2024-09-15T22:51:14.978420+0000","last_fullsized":"2024-09-15T22:51:14.978420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962455+0000","last_change":"2024-09-15T22:51:14.962455+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962455+0000","last_undegraded":"2024-09-15T22:51:14.962455+0000","last_fullsized":"2024-09-15T22:51:14.962455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985444+0000","last_change":"2024-09-15T22:51:14.984134+0000","last_active":"2024-09-15T22:51:14.985444+0000","last_peered":"2024-09-15T22:51:14.985444+0000","last_clean":"2024-09-15T22:51:14.985444+0000","last_became_active":"2024-09-15T22:51:14.983836+0000","last_became_peered":"2024-09-15T22:51:14.983836+0000","last_unstale":"2024-09-15T22:51:14.985444+0000","last_undegraded":"2024-09-15T22:51:14.985444+0000","last_fullsized":"2024-09-15T22:51:14.985444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:42.823356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958046+0000","last_change":"2024-09-15T22:51:14.958046+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958046+0000","last_undegraded":"2024-09-15T22:51:14.958046+0000","last_fullsized":"2024-09-15T22:51:14.958046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979913+0000","last_change":"2024-09-15T22:51:14.976515+0000","last_active":"2024-09-15T22:51:14.979913+0000","last_peered":"2024-09-15T22:51:14.979913+0000","last_clean":"2024-09-15T22:51:14.979913+0000","last_became_active":"2024-09-15T22:51:14.976095+0000","last_became_peered":"2024-09-15T22:51:14.976095+0000","last_unstale":"2024-09-15T22:51:14.979913+0000","last_undegraded":"2024-09-15T22:51:14.979913+0000","last_fullsized":"2024-09-15T22:51:14.979913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.972865+0000","last_change":"2024-09-15T22:51:14.972865+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.972865+0000","last_undegraded":"2024-09-15T22:51:14.972865+0000","last_fullsized":"2024-09-15T22:51:14.972865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977129+0000","last_change":"2024-09-15T22:51:14.970136+0000","last_active":"2024-09-15T22:51:14.977129+0000","last_peered":"2024-09-15T22:51:14.977129+0000","last_clean":"2024-09-15T22:51:14.977129+0000","last_became_active":"2024-09-15T22:51:14.969847+0000","last_became_peered":"2024-09-15T22:51:14.969847+0000","last_unstale":"2024-09-15T22:51:14.977129+0000","last_undegraded":"2024-09-15T22:51:14.977129+0000","last_fullsized":"2024-09-15T22:51:14.977129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:06.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963147+0000","last_change":"2024-09-15T22:51:14.963147+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963147+0000","last_undegraded":"2024-09-15T22:51:14.963147+0000","last_fullsized":"2024-09-15T22:51:14.963147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975374+0000","last_change":"2024-09-15T22:51:14.972795+0000","last_active":"2024-09-15T22:51:14.975374+0000","last_peered":"2024-09-15T22:51:14.975374+0000","last_clean":"2024-09-15T22:51:14.975374+0000","last_became_active":"2024-09-15T22:51:14.972530+0000","last_became_peered":"2024-09-15T22:51:14.972530+0000","last_unstale":"2024-09-15T22:51:14.975374+0000","last_undegraded":"2024-09-15T22:51:14.975374+0000","last_fullsized":"2024-09-15T22:51:14.975374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:20.601266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967000+0000","last_change":"2024-09-15T22:51:14.967000+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967000+0000","last_undegraded":"2024-09-15T22:51:14.967000+0000","last_fullsized":"2024-09-15T22:51:14.967000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989213+0000","last_change":"2024-09-15T22:51:14.986927+0000","last_active":"2024-09-15T22:51:14.989213+0000","last_peered":"2024-09-15T22:51:14.989213+0000","last_clean":"2024-09-15T22:51:14.989213+0000","last_became_active":"2024-09-15T22:51:14.986593+0000","last_became_peered":"2024-09-15T22:51:14.986593+0000","last_unstale":"2024-09-15T22:51:14.989213+0000","last_undegraded":"2024-09-15T22:51:14.989213+0000","last_fullsized":"2024-09-15T22:51:14.989213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959682+0000","last_change":"2024-09-15T22:51:14.959682+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959682+0000","last_undegraded":"2024-09-15T22:51:14.959682+0000","last_fullsized":"2024-09-15T22:51:14.959682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975337+0000","last_change":"2024-09-15T22:51:14.969964+0000","last_active":"2024-09-15T22:51:14.975337+0000","last_peered":"2024-09-15T22:51:14.975337+0000","last_clean":"2024-09-15T22:51:14.975337+0000","last_became_active":"2024-09-15T22:51:14.969593+0000","last_became_peered":"2024-09-15T22:51:14.969593+0000","last_unstale":"2024-09-15T22:51:14.975337+0000","last_undegraded":"2024-09-15T22:51:14.975337+0000","last_fullsized":"2024-09-15T22:51:14.975337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:24.050921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961121+0000","last_change":"2024-09-15T22:51:14.961121+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961121+0000","last_undegraded":"2024-09-15T22:51:14.961121+0000","last_fullsized":"2024-09-15T22:51:14.961121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985927+0000","last_change":"2024-09-15T22:51:14.981097+0000","last_active":"2024-09-15T22:51:14.985927+0000","last_peered":"2024-09-15T22:51:14.985927+0000","last_clean":"2024-09-15T22:51:14.985927+0000","last_became_active":"2024-09-15T22:51:14.980807+0000","last_became_peered":"2024-09-15T22:51:14.980807+0000","last_unstale":"2024-09-15T22:51:14.985927+0000","last_undegraded":"2024-09-15T22:51:14.985927+0000","last_fullsized":"2024-09-15T22:51:14.985927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:36.425528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977848+0000","last_change":"2024-09-15T22:51:14.977848+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977848+0000","last_undegraded":"2024-09-15T22:51:14.977848+0000","last_fullsized":"2024-09-15T22:51:14.977848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975326+0000","last_change":"2024-09-15T22:51:14.973168+0000","last_active":"2024-09-15T22:51:14.975326+0000","last_peered":"2024-09-15T22:51:14.975326+0000","last_clean":"2024-09-15T22:51:14.975326+0000","last_became_active":"2024-09-15T22:51:14.972888+0000","last_became_peered":"2024-09-15T22:51:14.972888+0000","last_unstale":"2024-09-15T22:51:14.975326+0000","last_undegraded":"2024-09-15T22:51:14.975326+0000","last_fullsized":"2024-09-15T22:51:14.975326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.363473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960896+0000","last_change":"2024-09-15T22:51:14.960896+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960896+0000","last_undegraded":"2024-09-15T22:51:14.960896+0000","last_fullsized":"2024-09-15T22:51:14.960896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980309+0000","last_change":"2024-09-15T22:51:14.977285+0000","last_active":"2024-09-15T22:51:14.980309+0000","last_peered":"2024-09-15T22:51:14.980309+0000","last_clean":"2024-09-15T22:51:14.980309+0000","last_became_active":"2024-09-15T22:51:14.976967+0000","last_became_peered":"2024-09-15T22:51:14.976967+0000","last_unstale":"2024-09-15T22:51:14.980309+0000","last_undegraded":"2024-09-15T22:51:14.980309+0000","last_fullsized":"2024-09-15T22:51:14.980309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959909+0000","last_change":"2024-09-15T22:51:14.959909+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959909+0000","last_undegraded":"2024-09-15T22:51:14.959909+0000","last_fullsized":"2024-09-15T22:51:14.959909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977463+0000","last_change":"2024-09-15T22:51:14.974881+0000","last_active":"2024-09-15T22:51:14.977463+0000","last_peered":"2024-09-15T22:51:14.977463+0000","last_clean":"2024-09-15T22:51:14.977463+0000","last_became_active":"2024-09-15T22:51:14.974621+0000","last_became_peered":"2024-09-15T22:51:14.974621+0000","last_unstale":"2024-09-15T22:51:14.977463+0000","last_undegraded":"2024-09-15T22:51:14.977463+0000","last_fullsized":"2024-09-15T22:51:14.977463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963279+0000","last_change":"2024-09-15T22:51:14.963279+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963279+0000","last_undegraded":"2024-09-15T22:51:14.963279+0000","last_fullsized":"2024-09-15T22:51:14.963279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979066+0000","last_change":"2024-09-15T22:51:14.975174+0000","last_active":"2024-09-15T22:51:14.979066+0000","last_peered":"2024-09-15T22:51:14.979066+0000","last_clean":"2024-09-15T22:51:14.979066+0000","last_became_active":"2024-09-15T22:51:14.974907+0000","last_became_peered":"2024-09-15T22:51:14.974907+0000","last_unstale":"2024-09-15T22:51:14.979066+0000","last_undegraded":"2024-09-15T22:51:14.979066+0000","last_fullsized":"2024-09-15T22:51:14.979066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964683+0000","last_change":"2024-09-15T22:51:14.964683+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964683+0000","last_undegraded":"2024-09-15T22:51:14.964683+0000","last_fullsized":"2024-09-15T22:51:14.964683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977114+0000","last_change":"2024-09-15T22:51:14.973229+0000","last_active":"2024-09-15T22:51:14.977114+0000","last_peered":"2024-09-15T22:51:14.977114+0000","last_clean":"2024-09-15T22:51:14.977114+0000","last_became_active":"2024-09-15T22:51:14.972952+0000","last_became_peered":"2024-09-15T22:51:14.972952+0000","last_unstale":"2024-09-15T22:51:14.977114+0000","last_undegraded":"2024-09-15T22:51:14.977114+0000","last_fullsized":"2024-09-15T22:51:14.977114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974438+0000","last_change":"2024-09-15T22:51:14.974438+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974438+0000","last_undegraded":"2024-09-15T22:51:14.974438+0000","last_fullsized":"2024-09-15T22:51:14.974438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977168+0000","last_change":"2024-09-15T22:51:14.971981+0000","last_active":"2024-09-15T22:51:14.977168+0000","last_peered":"2024-09-15T22:51:14.977168+0000","last_clean":"2024-09-15T22:51:14.977168+0000","last_became_active":"2024-09-15T22:51:14.971568+0000","last_became_peered":"2024-09-15T22:51:14.971568+0000","last_unstale":"2024-09-15T22:51:14.977168+0000","last_undegraded":"2024-09-15T22:51:14.977168+0000","last_fullsized":"2024-09-15T22:51:14.977168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969071+0000","last_change":"2024-09-15T22:51:14.969071+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969071+0000","last_undegraded":"2024-09-15T22:51:14.969071+0000","last_fullsized":"2024-09-15T22:51:14.969071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989242+0000","last_change":"2024-09-15T22:51:14.987009+0000","last_active":"2024-09-15T22:51:14.989242+0000","last_peered":"2024-09-15T22:51:14.989242+0000","last_clean":"2024-09-15T22:51:14.989242+0000","last_became_active":"2024-09-15T22:51:14.986692+0000","last_became_peered":"2024-09-15T22:51:14.986692+0000","last_unstale":"2024-09-15T22:51:14.989242+0000","last_undegraded":"2024-09-15T22:51:14.989242+0000","last_fullsized":"2024-09-15T22:51:14.989242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980361+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:51:14.980361+0000","last_peered":"2024-09-15T22:51:14.980361+0000","last_clean":"2024-09-15T22:51:14.980361+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:51:14.980361+0000","last_undegraded":"2024-09-15T22:51:14.980361+0000","last_fullsized":"2024-09-15T22:51:14.980361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:51:20.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:51:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.276+0000 7fdc07200640 1 Processor -- start 2024-09-15T22:51:20.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.276+0000 7fdc07200640 1 -- start start 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc07200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc000cfda0 0x7fdc000b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc07200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc0015b920 0x7fdc000b4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc07200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc000b4480 con 0x7fdc000729f0 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc07200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdc0006e320 con 0x7fdc000cfda0 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc07200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc000d0180 con 0x7fdc0015b920 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdc000cfda0 0x7fdc000b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc05200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdc000729f0 0x7fdc0006e7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33152/0 (socket says 172.21.15.31:33152) 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdc05200640 1 -- 172.21.15.31:0/3314753724 learned_addr learned my addr 172.21.15.31:0/3314753724 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbf7400640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc0015b920 0x7fdc000b4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 -- 172.21.15.31:0/3314753724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc0015b920 msgr2=0x7fdc000b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc0015b920 0x7fdc000b4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 -- 172.21.15.31:0/3314753724 >> v1:172.21.15.31:6789/0 conn(0x7fdc000729f0 legacy=0x7fdc0006e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 -- 172.21.15.31:0/3314753724 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc000b3be0 con 0x7fdc000cfda0 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.280+0000 7fdbffe00640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc000cfda0 0x7fdc000b34e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000a960 tx=0x7fdbf001d7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507b2276463bf2e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdbff400640 1 -- 172.21.15.31:0/3314753724 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf00b3070 con 0x7fdc000cfda0 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdbff400640 1 -- 172.21.15.31:0/3314753724 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf00a67c0 con 0x7fdc000cfda0 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdbff400640 1 -- 172.21.15.31:0/3314753724 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf000b040 con 0x7fdc000cfda0 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- 172.21.15.31:0/3314753724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc000cfda0 msgr2=0x7fdc000b34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.285 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc000cfda0 0x7fdc000b34e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdbf000a960 tx=0x7fdbf001d7e0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- 172.21.15.31:0/3314753724 shutdown_connections 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc0015b920 0x7fdc000b4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- 172.21.15.31:0/3314753724 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc000cfda0 0x7fdc000b34e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- 172.21.15.31:0/3314753724 >> 172.21.15.31:0/3314753724 conn(0x7fdc00067e00 msgr2=0x7fdc0006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- 172.21.15.31:0/3314753724 shutdown_connections 2024-09-15T22:51:20.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- 172.21.15.31:0/3314753724 wait complete. 2024-09-15T22:51:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 Processor -- start 2024-09-15T22:51:20.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- start start 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc000729f0 0x7fdc0014f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc000cfda0 0x7fdc0014c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0015be80 con 0x7fdc0015b920 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0015bd00 con 0x7fdc000729f0 2024-09-15T22:51:20.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc07200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdc000b4dd0 con 0x7fdc000cfda0 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc05200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc05200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54826/0 (socket says 172.21.15.31:54826) 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdc05200640 1 -- 172.21.15.31:0/614451795 learned_addr learned my addr 172.21.15.31:0/614451795 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdbffe00640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc000729f0 0x7fdc0014f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.284+0000 7fdbf7400640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc000cfda0 0x7fdc0014c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 -- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc000cfda0 msgr2=0x7fdc0014c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc000cfda0 0x7fdc0014c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 -- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc000729f0 msgr2=0x7fdc0014f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc000729f0 0x7fdc0014f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 -- 172.21.15.31:0/614451795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc0014f780 con 0x7fdc0015b920 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc05200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8002240 tx=0x7fdbf800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8017070 con 0x7fdc0015b920 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbf800abd0 con 0x7fdc0015b920 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbf8012400 con 0x7fdc0015b920 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc00150aa0 con 0x7fdc0015b920 2024-09-15T22:51:20.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0014fce0 con 0x7fdc0015b920 2024-09-15T22:51:20.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc000b34e0 con 0x7fdc0015b920 2024-09-15T22:51:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdbf801a070 con 0x7fdc0015b920 2024-09-15T22:51:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 0x7fdbdc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.288+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7fdbf8085a30 con 0x7fdc0015b920 2024-09-15T22:51:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.292+0000 7fdbffe00640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 0x7fdbdc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.292+0000 7fdbffe00640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 0x7fdbdc069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00b0000 tx=0x7fdbf0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.292+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdc0014f780 con 0x7fdc0015b920 2024-09-15T22:51:20.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.456+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc0006d140 con 0x7fdbdc0678c0 2024-09-15T22:51:20.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.460+0000 7fdbfcc00640 1 -- 172.21.15.31:0/614451795 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7fdc0006d140 con 0x7fdbdc0678c0 2024-09-15T22:51:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:20.469 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:51:20.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 msgr2=0x7fdbdc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 0x7fdbdc069d80 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdbf00b0000 tx=0x7fdbf0008040 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 msgr2=0x7fdc000a9d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdbf8002240 tx=0x7fdbf800cf00 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 shutdown_connections 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdbdc0678c0 0x7fdbdc069d80 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdc0015b920 0x7fdc000a9d90 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdc000cfda0 0x7fdc0014c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 --2- 172.21.15.31:0/614451795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdc000729f0 0x7fdc0014f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 >> 172.21.15.31:0/614451795 conn(0x7fdc00067e00 msgr2=0x7fdc0015b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 shutdown_connections 2024-09-15T22:51:20.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.464+0000 7fdc07200640 1 -- 172.21.15.31:0/614451795 wait complete. 2024-09-15T22:51:20.487 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-15T22:51:19.569266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4538368,"data_stored":2605898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.624999"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960093+0000","last_change":"2024-09-15T22:51:14.960093+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960093+0000","last_undegraded":"2024-09-15T22:51:14.960093+0000","last_fullsized":"2024-09-15T22:51:14.960093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962022+0000","last_change":"2024-09-15T22:51:14.962022+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962022+0000","last_undegraded":"2024-09-15T22:51:14.962022+0000","last_fullsized":"2024-09-15T22:51:14.962022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965376+0000","last_change":"2024-09-15T22:51:14.965376+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965376+0000","last_undegraded":"2024-09-15T22:51:14.965376+0000","last_fullsized":"2024-09-15T22:51:14.965376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959294+0000","last_change":"2024-09-15T22:51:14.959294+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959294+0000","last_undegraded":"2024-09-15T22:51:14.959294+0000","last_fullsized":"2024-09-15T22:51:14.959294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958919+0000","last_change":"2024-09-15T22:51:14.958919+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958919+0000","last_undegraded":"2024-09-15T22:51:14.958919+0000","last_fullsized":"2024-09-15T22:51:14.958919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960367+0000","last_change":"2024-09-15T22:51:14.960367+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960367+0000","last_undegraded":"2024-09-15T22:51:14.960367+0000","last_fullsized":"2024-09-15T22:51:14.960367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963179+0000","last_change":"2024-09-15T22:51:14.963179+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963179+0000","last_undegraded":"2024-09-15T22:51:14.963179+0000","last_fullsized":"2024-09-15T22:51:14.963179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959534+0000","last_change":"2024-09-15T22:51:14.959534+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959534+0000","last_undegraded":"2024-09-15T22:51:14.959534+0000","last_fullsized":"2024-09-15T22:51:14.959534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965805+0000","last_change":"2024-09-15T22:51:14.965805+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965805+0000","last_undegraded":"2024-09-15T22:51:14.965805+0000","last_fullsized":"2024-09-15T22:51:14.965805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.971772+0000","last_change":"2024-09-15T22:51:14.971772+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.971772+0000","last_undegraded":"2024-09-15T22:51:14.971772+0000","last_fullsized":"2024-09-15T22:51:14.971772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967862+0000","last_change":"2024-09-15T22:51:14.967862+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967862+0000","last_undegraded":"2024-09-15T22:51:14.967862+0000","last_fullsized":"2024-09-15T22:51:14.967862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964856+0000","last_change":"2024-09-15T22:51:14.964856+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964856+0000","last_undegraded":"2024-09-15T22:51:14.964856+0000","last_fullsized":"2024-09-15T22:51:14.964856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968343+0000","last_change":"2024-09-15T22:51:14.968343+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968343+0000","last_undegraded":"2024-09-15T22:51:14.968343+0000","last_fullsized":"2024-09-15T22:51:14.968343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969345+0000","last_change":"2024-09-15T22:51:14.969345+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969345+0000","last_undegraded":"2024-09-15T22:51:14.969345+0000","last_fullsized":"2024-09-15T22:51:14.969345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962670+0000","last_change":"2024-09-15T22:51:14.962670+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962670+0000","last_undegraded":"2024-09-15T22:51:14.962670+0000","last_fullsized":"2024-09-15T22:51:14.962670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.973428+0000","last_change":"2024-09-15T22:51:14.973428+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.973428+0000","last_undegraded":"2024-09-15T22:51:14.973428+0000","last_fullsized":"2024-09-15T22:51:14.973428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975197+0000","last_change":"2024-09-15T22:51:14.975197+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975197+0000","last_undegraded":"2024-09-15T22:51:14.975197+0000","last_fullsized":"2024-09-15T22:51:14.975197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958809+0000","last_change":"2024-09-15T22:51:14.958809+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958809+0000","last_undegraded":"2024-09-15T22:51:14.958809+0000","last_fullsized":"2024-09-15T22:51:14.958809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964145+0000","last_change":"2024-09-15T22:51:14.964145+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964145+0000","last_undegraded":"2024-09-15T22:51:14.964145+0000","last_fullsized":"2024-09-15T22:51:14.964145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967813+0000","last_change":"2024-09-15T22:51:14.967813+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967813+0000","last_undegraded":"2024-09-15T22:51:14.967813+0000","last_fullsized":"2024-09-15T22:51:14.967813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965191+0000","last_change":"2024-09-15T22:51:14.965191+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965191+0000","last_undegraded":"2024-09-15T22:51:14.965191+0000","last_fullsized":"2024-09-15T22:51:14.965191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977196+0000","last_change":"2024-09-15T22:51:14.977196+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977196+0000","last_undegraded":"2024-09-15T22:51:14.977196+0000","last_fullsized":"2024-09-15T22:51:14.977196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959297+0000","last_change":"2024-09-15T22:51:14.959297+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959297+0000","last_undegraded":"2024-09-15T22:51:14.959297+0000","last_fullsized":"2024-09-15T22:51:14.959297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964786+0000","last_change":"2024-09-15T22:51:14.964786+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964786+0000","last_undegraded":"2024-09-15T22:51:14.964786+0000","last_fullsized":"2024-09-15T22:51:14.964786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962735+0000","last_change":"2024-09-15T22:51:14.962735+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962735+0000","last_undegraded":"2024-09-15T22:51:14.962735+0000","last_fullsized":"2024-09-15T22:51:14.962735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.966193+0000","last_change":"2024-09-15T22:51:14.966193+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.966193+0000","last_undegraded":"2024-09-15T22:51:14.966193+0000","last_fullsized":"2024-09-15T22:51:14.966193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968563+0000","last_change":"2024-09-15T22:51:14.968563+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968563+0000","last_undegraded":"2024-09-15T22:51:14.968563+0000","last_fullsized":"2024-09-15T22:51:14.968563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965400+0000","last_change":"2024-09-15T22:51:14.965400+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965400+0000","last_undegraded":"2024-09-15T22:51:14.965400+0000","last_fullsized":"2024-09-15T22:51:14.965400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974352+0000","last_change":"2024-09-15T22:51:14.974352+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974352+0000","last_undegraded":"2024-09-15T22:51:14.974352+0000","last_fullsized":"2024-09-15T22:51:14.974352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961903+0000","last_change":"2024-09-15T22:51:14.961903+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961903+0000","last_undegraded":"2024-09-15T22:51:14.961903+0000","last_fullsized":"2024-09-15T22:51:14.961903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977273+0000","last_change":"2024-09-15T22:51:14.977273+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977273+0000","last_undegraded":"2024-09-15T22:51:14.977273+0000","last_fullsized":"2024-09-15T22:51:14.977273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979097+0000","last_change":"2024-09-15T22:51:14.976712+0000","last_active":"2024-09-15T22:51:14.979097+0000","last_peered":"2024-09-15T22:51:14.979097+0000","last_clean":"2024-09-15T22:51:14.979097+0000","last_became_active":"2024-09-15T22:51:14.976384+0000","last_became_peered":"2024-09-15T22:51:14.976384+0000","last_unstale":"2024-09-15T22:51:14.979097+0000","last_undegraded":"2024-09-15T22:51:14.979097+0000","last_fullsized":"2024-09-15T22:51:14.979097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964155+0000","last_change":"2024-09-15T22:51:14.964155+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964155+0000","last_undegraded":"2024-09-15T22:51:14.964155+0000","last_fullsized":"2024-09-15T22:51:14.964155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982284+0000","last_change":"2024-09-15T22:51:14.981079+0000","last_active":"2024-09-15T22:51:14.982284+0000","last_peered":"2024-09-15T22:51:14.982284+0000","last_clean":"2024-09-15T22:51:14.982284+0000","last_became_active":"2024-09-15T22:51:14.980582+0000","last_became_peered":"2024-09-15T22:51:14.980582+0000","last_unstale":"2024-09-15T22:51:14.982284+0000","last_undegraded":"2024-09-15T22:51:14.982284+0000","last_fullsized":"2024-09-15T22:51:14.982284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962897+0000","last_change":"2024-09-15T22:51:14.962897+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962897+0000","last_undegraded":"2024-09-15T22:51:14.962897+0000","last_fullsized":"2024-09-15T22:51:14.962897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982029+0000","last_change":"2024-09-15T22:51:14.978636+0000","last_active":"2024-09-15T22:51:14.982029+0000","last_peered":"2024-09-15T22:51:14.982029+0000","last_clean":"2024-09-15T22:51:14.982029+0000","last_became_active":"2024-09-15T22:51:14.978265+0000","last_became_peered":"2024-09-15T22:51:14.978265+0000","last_unstale":"2024-09-15T22:51:14.982029+0000","last_undegraded":"2024-09-15T22:51:14.982029+0000","last_fullsized":"2024-09-15T22:51:14.982029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960964+0000","last_change":"2024-09-15T22:51:14.960964+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960964+0000","last_undegraded":"2024-09-15T22:51:14.960964+0000","last_fullsized":"2024-09-15T22:51:14.960964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976881+0000","last_change":"2024-09-15T22:51:14.974047+0000","last_active":"2024-09-15T22:51:14.976881+0000","last_peered":"2024-09-15T22:51:14.976881+0000","last_clean":"2024-09-15T22:51:14.976881+0000","last_became_active":"2024-09-15T22:51:14.973769+0000","last_became_peered":"2024-09-15T22:51:14.973769+0000","last_unstale":"2024-09-15T22:51:14.976881+0000","last_undegraded":"2024-09-15T22:51:14.976881+0000","last_fullsized":"2024-09-15T22:51:14.976881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963339+0000","last_change":"2024-09-15T22:51:14.963339+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963339+0000","last_undegraded":"2024-09-15T22:51:14.963339+0000","last_fullsized":"2024-09-15T22:51:14.963339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981420+0000","last_change":"2024-09-15T22:51:14.974086+0000","last_active":"2024-09-15T22:51:14.981420+0000","last_peered":"2024-09-15T22:51:14.981420+0000","last_clean":"2024-09-15T22:51:14.981420+0000","last_became_active":"2024-09-15T22:51:14.973787+0000","last_became_peered":"2024-09-15T22:51:14.973787+0000","last_unstale":"2024-09-15T22:51:14.981420+0000","last_undegraded":"2024-09-15T22:51:14.981420+0000","last_fullsized":"2024-09-15T22:51:14.981420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:02.055900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962162+0000","last_change":"2024-09-15T22:51:14.962162+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962162+0000","last_undegraded":"2024-09-15T22:51:14.962162+0000","last_fullsized":"2024-09-15T22:51:14.962162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989228+0000","last_change":"2024-09-15T22:51:14.986951+0000","last_active":"2024-09-15T22:51:14.989228+0000","last_peered":"2024-09-15T22:51:14.989228+0000","last_clean":"2024-09-15T22:51:14.989228+0000","last_became_active":"2024-09-15T22:51:14.986518+0000","last_became_peered":"2024-09-15T22:51:14.986518+0000","last_unstale":"2024-09-15T22:51:14.989228+0000","last_undegraded":"2024-09-15T22:51:14.989228+0000","last_fullsized":"2024-09-15T22:51:14.989228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964195+0000","last_change":"2024-09-15T22:51:14.964195+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964195+0000","last_undegraded":"2024-09-15T22:51:14.964195+0000","last_fullsized":"2024-09-15T22:51:14.964195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976684+0000","last_change":"2024-09-15T22:51:14.973894+0000","last_active":"2024-09-15T22:51:14.976684+0000","last_peered":"2024-09-15T22:51:14.976684+0000","last_clean":"2024-09-15T22:51:14.976684+0000","last_became_active":"2024-09-15T22:51:14.973577+0000","last_became_peered":"2024-09-15T22:51:14.973577+0000","last_unstale":"2024-09-15T22:51:14.976684+0000","last_undegraded":"2024-09-15T22:51:14.976684+0000","last_fullsized":"2024-09-15T22:51:14.976684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961086+0000","last_change":"2024-09-15T22:51:14.961086+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961086+0000","last_undegraded":"2024-09-15T22:51:14.961086+0000","last_fullsized":"2024-09-15T22:51:14.961086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976811+0000","last_change":"2024-09-15T22:51:14.972066+0000","last_active":"2024-09-15T22:51:14.976811+0000","last_peered":"2024-09-15T22:51:14.976811+0000","last_clean":"2024-09-15T22:51:14.976811+0000","last_became_active":"2024-09-15T22:51:14.971640+0000","last_became_peered":"2024-09-15T22:51:14.971640+0000","last_unstale":"2024-09-15T22:51:14.976811+0000","last_undegraded":"2024-09-15T22:51:14.976811+0000","last_fullsized":"2024-09-15T22:51:14.976811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958245+0000","last_change":"2024-09-15T22:51:14.958245+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958245+0000","last_undegraded":"2024-09-15T22:51:14.958245+0000","last_fullsized":"2024-09-15T22:51:14.958245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977235+0000","last_change":"2024-09-15T22:51:14.972265+0000","last_active":"2024-09-15T22:51:14.977235+0000","last_peered":"2024-09-15T22:51:14.977235+0000","last_clean":"2024-09-15T22:51:14.977235+0000","last_became_active":"2024-09-15T22:51:14.971919+0000","last_became_peered":"2024-09-15T22:51:14.971919+0000","last_unstale":"2024-09-15T22:51:14.977235+0000","last_undegraded":"2024-09-15T22:51:14.977235+0000","last_fullsized":"2024-09-15T22:51:14.977235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.491357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.978317+0000","last_change":"2024-09-15T22:51:14.978317+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.978317+0000","last_undegraded":"2024-09-15T22:51:14.978317+0000","last_fullsized":"2024-09-15T22:51:14.978317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985757+0000","last_change":"2024-09-15T22:51:14.979937+0000","last_active":"2024-09-15T22:51:14.985757+0000","last_peered":"2024-09-15T22:51:14.985757+0000","last_clean":"2024-09-15T22:51:14.985757+0000","last_became_active":"2024-09-15T22:51:14.979599+0000","last_became_peered":"2024-09-15T22:51:14.979599+0000","last_unstale":"2024-09-15T22:51:14.985757+0000","last_undegraded":"2024-09-15T22:51:14.985757+0000","last_fullsized":"2024-09-15T22:51:14.985757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:28.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961676+0000","last_change":"2024-09-15T22:51:14.961676+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961676+0000","last_undegraded":"2024-09-15T22:51:14.961676+0000","last_fullsized":"2024-09-15T22:51:14.961676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985795+0000","last_change":"2024-09-15T22:51:14.980163+0000","last_active":"2024-09-15T22:51:14.985795+0000","last_peered":"2024-09-15T22:51:14.985795+0000","last_clean":"2024-09-15T22:51:14.985795+0000","last_became_active":"2024-09-15T22:51:14.979726+0000","last_became_peered":"2024-09-15T22:51:14.979726+0000","last_unstale":"2024-09-15T22:51:14.985795+0000","last_undegraded":"2024-09-15T22:51:14.985795+0000","last_fullsized":"2024-09-15T22:51:14.985795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:03.182113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961440+0000","last_change":"2024-09-15T22:51:14.961440+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961440+0000","last_undegraded":"2024-09-15T22:51:14.961440+0000","last_fullsized":"2024-09-15T22:51:14.961440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981142+0000","last_change":"2024-09-15T22:51:14.980076+0000","last_active":"2024-09-15T22:51:14.981142+0000","last_peered":"2024-09-15T22:51:14.981142+0000","last_clean":"2024-09-15T22:51:14.981142+0000","last_became_active":"2024-09-15T22:51:14.979781+0000","last_became_peered":"2024-09-15T22:51:14.979781+0000","last_unstale":"2024-09-15T22:51:14.981142+0000","last_undegraded":"2024-09-15T22:51:14.981142+0000","last_fullsized":"2024-09-15T22:51:14.981142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:06.565997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960407+0000","last_change":"2024-09-15T22:51:14.960407+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960407+0000","last_undegraded":"2024-09-15T22:51:14.960407+0000","last_fullsized":"2024-09-15T22:51:14.960407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975741+0000","last_change":"2024-09-15T22:51:14.971500+0000","last_active":"2024-09-15T22:51:14.975741+0000","last_peered":"2024-09-15T22:51:14.975741+0000","last_clean":"2024-09-15T22:51:14.975741+0000","last_became_active":"2024-09-15T22:51:14.971212+0000","last_became_peered":"2024-09-15T22:51:14.971212+0000","last_unstale":"2024-09-15T22:51:14.975741+0000","last_undegraded":"2024-09-15T22:51:14.975741+0000","last_fullsized":"2024-09-15T22:51:14.975741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959157+0000","last_change":"2024-09-15T22:51:14.959157+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959157+0000","last_undegraded":"2024-09-15T22:51:14.959157+0000","last_fullsized":"2024-09-15T22:51:14.959157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976720+0000","last_change":"2024-09-15T22:51:14.974430+0000","last_active":"2024-09-15T22:51:14.976720+0000","last_peered":"2024-09-15T22:51:14.976720+0000","last_clean":"2024-09-15T22:51:14.976720+0000","last_became_active":"2024-09-15T22:51:14.974129+0000","last_became_peered":"2024-09-15T22:51:14.974129+0000","last_unstale":"2024-09-15T22:51:14.976720+0000","last_undegraded":"2024-09-15T22:51:14.976720+0000","last_fullsized":"2024-09-15T22:51:14.976720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975580+0000","last_change":"2024-09-15T22:51:14.975580+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975580+0000","last_undegraded":"2024-09-15T22:51:14.975580+0000","last_fullsized":"2024-09-15T22:51:14.975580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978766+0000","last_change":"2024-09-15T22:51:14.973590+0000","last_active":"2024-09-15T22:51:14.978766+0000","last_peered":"2024-09-15T22:51:14.978766+0000","last_clean":"2024-09-15T22:51:14.978766+0000","last_became_active":"2024-09-15T22:51:14.973243+0000","last_became_peered":"2024-09-15T22:51:14.973243+0000","last_unstale":"2024-09-15T22:51:14.978766+0000","last_undegraded":"2024-09-15T22:51:14.978766+0000","last_fullsized":"2024-09-15T22:51:14.978766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960536+0000","last_change":"2024-09-15T22:51:14.960536+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960536+0000","last_undegraded":"2024-09-15T22:51:14.960536+0000","last_fullsized":"2024-09-15T22:51:14.960536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.987568+0000","last_change":"2024-09-15T22:51:14.985081+0000","last_active":"2024-09-15T22:51:14.987568+0000","last_peered":"2024-09-15T22:51:14.987568+0000","last_clean":"2024-09-15T22:51:14.987568+0000","last_became_active":"2024-09-15T22:51:14.984750+0000","last_became_peered":"2024-09-15T22:51:14.984750+0000","last_unstale":"2024-09-15T22:51:14.987568+0000","last_undegraded":"2024-09-15T22:51:14.987568+0000","last_fullsized":"2024-09-15T22:51:14.987568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961252+0000","last_change":"2024-09-15T22:51:14.961252+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961252+0000","last_undegraded":"2024-09-15T22:51:14.961252+0000","last_fullsized":"2024-09-15T22:51:14.961252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985949+0000","last_change":"2024-09-15T22:51:14.981702+0000","last_active":"2024-09-15T22:51:14.985949+0000","last_peered":"2024-09-15T22:51:14.985949+0000","last_clean":"2024-09-15T22:51:14.985949+0000","last_became_active":"2024-09-15T22:51:14.981473+0000","last_became_peered":"2024-09-15T22:51:14.981473+0000","last_unstale":"2024-09-15T22:51:14.985949+0000","last_undegraded":"2024-09-15T22:51:14.985949+0000","last_fullsized":"2024-09-15T22:51:14.985949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:48.535081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967496+0000","last_change":"2024-09-15T22:51:14.967496+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967496+0000","last_undegraded":"2024-09-15T22:51:14.967496+0000","last_fullsized":"2024-09-15T22:51:14.967496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978420+0000","last_change":"2024-09-15T22:51:14.975951+0000","last_active":"2024-09-15T22:51:14.978420+0000","last_peered":"2024-09-15T22:51:14.978420+0000","last_clean":"2024-09-15T22:51:14.978420+0000","last_became_active":"2024-09-15T22:51:14.975646+0000","last_became_peered":"2024-09-15T22:51:14.975646+0000","last_unstale":"2024-09-15T22:51:14.978420+0000","last_undegraded":"2024-09-15T22:51:14.978420+0000","last_fullsized":"2024-09-15T22:51:14.978420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962455+0000","last_change":"2024-09-15T22:51:14.962455+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962455+0000","last_undegraded":"2024-09-15T22:51:14.962455+0000","last_fullsized":"2024-09-15T22:51:14.962455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985444+0000","last_change":"2024-09-15T22:51:14.984134+0000","last_active":"2024-09-15T22:51:14.985444+0000","last_peered":"2024-09-15T22:51:14.985444+0000","last_clean":"2024-09-15T22:51:14.985444+0000","last_became_active":"2024-09-15T22:51:14.983836+0000","last_became_peered":"2024-09-15T22:51:14.983836+0000","last_unstale":"2024-09-15T22:51:14.985444+0000","last_undegraded":"2024-09-15T22:51:14.985444+0000","last_fullsized":"2024-09-15T22:51:14.985444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:42.823356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958046+0000","last_change":"2024-09-15T22:51:14.958046+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958046+0000","last_undegraded":"2024-09-15T22:51:14.958046+0000","last_fullsized":"2024-09-15T22:51:14.958046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979913+0000","last_change":"2024-09-15T22:51:14.976515+0000","last_active":"2024-09-15T22:51:14.979913+0000","last_peered":"2024-09-15T22:51:14.979913+0000","last_clean":"2024-09-15T22:51:14.979913+0000","last_became_active":"2024-09-15T22:51:14.976095+0000","last_became_peered":"2024-09-15T22:51:14.976095+0000","last_unstale":"2024-09-15T22:51:14.979913+0000","last_undegraded":"2024-09-15T22:51:14.979913+0000","last_fullsized":"2024-09-15T22:51:14.979913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.972865+0000","last_change":"2024-09-15T22:51:14.972865+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.972865+0000","last_undegraded":"2024-09-15T22:51:14.972865+0000","last_fullsized":"2024-09-15T22:51:14.972865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977129+0000","last_change":"2024-09-15T22:51:14.970136+0000","last_active":"2024-09-15T22:51:14.977129+0000","last_peered":"2024-09-15T22:51:14.977129+0000","last_clean":"2024-09-15T22:51:14.977129+0000","last_became_active":"2024-09-15T22:51:14.969847+0000","last_became_peered":"2024-09-15T22:51:14.969847+0000","last_unstale":"2024-09-15T22:51:14.977129+0000","last_undegraded":"2024-09-15T22:51:14.977129+0000","last_fullsized":"2024-09-15T22:51:14.977129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:06.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963147+0000","last_change":"2024-09-15T22:51:14.963147+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963147+0000","last_undegraded":"2024-09-15T22:51:14.963147+0000","last_fullsized":"2024-09-15T22:51:14.963147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975374+0000","last_change":"2024-09-15T22:51:14.972795+0000","last_active":"2024-09-15T22:51:14.975374+0000","last_peered":"2024-09-15T22:51:14.975374+0000","last_clean":"2024-09-15T22:51:14.975374+0000","last_became_active":"2024-09-15T22:51:14.972530+0000","last_became_peered":"2024-09-15T22:51:14.972530+0000","last_unstale":"2024-09-15T22:51:14.975374+0000","last_undegraded":"2024-09-15T22:51:14.975374+0000","last_fullsized":"2024-09-15T22:51:14.975374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:20.601266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967000+0000","last_change":"2024-09-15T22:51:14.967000+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967000+0000","last_undegraded":"2024-09-15T22:51:14.967000+0000","last_fullsized":"2024-09-15T22:51:14.967000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989213+0000","last_change":"2024-09-15T22:51:14.986927+0000","last_active":"2024-09-15T22:51:14.989213+0000","last_peered":"2024-09-15T22:51:14.989213+0000","last_clean":"2024-09-15T22:51:14.989213+0000","last_became_active":"2024-09-15T22:51:14.986593+0000","last_became_peered":"2024-09-15T22:51:14.986593+0000","last_unstale":"2024-09-15T22:51:14.989213+0000","last_undegraded":"2024-09-15T22:51:14.989213+0000","last_fullsized":"2024-09-15T22:51:14.989213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959682+0000","last_change":"2024-09-15T22:51:14.959682+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959682+0000","last_undegraded":"2024-09-15T22:51:14.959682+0000","last_fullsized":"2024-09-15T22:51:14.959682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975337+0000","last_change":"2024-09-15T22:51:14.969964+0000","last_active":"2024-09-15T22:51:14.975337+0000","last_peered":"2024-09-15T22:51:14.975337+0000","last_clean":"2024-09-15T22:51:14.975337+0000","last_became_active":"2024-09-15T22:51:14.969593+0000","last_became_peered":"2024-09-15T22:51:14.969593+0000","last_unstale":"2024-09-15T22:51:14.975337+0000","last_undegraded":"2024-09-15T22:51:14.975337+0000","last_fullsized":"2024-09-15T22:51:14.975337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:24.050921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961121+0000","last_change":"2024-09-15T22:51:14.961121+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961121+0000","last_undegraded":"2024-09-15T22:51:14.961121+0000","last_fullsized":"2024-09-15T22:51:14.961121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985927+0000","last_change":"2024-09-15T22:51:14.981097+0000","last_active":"2024-09-15T22:51:14.985927+0000","last_peered":"2024-09-15T22:51:14.985927+0000","last_clean":"2024-09-15T22:51:14.985927+0000","last_became_active":"2024-09-15T22:51:14.980807+0000","last_became_peered":"2024-09-15T22:51:14.980807+0000","last_unstale":"2024-09-15T22:51:14.985927+0000","last_undegraded":"2024-09-15T22:51:14.985927+0000","last_fullsized":"2024-09-15T22:51:14.985927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:36.425528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977848+0000","last_change":"2024-09-15T22:51:14.977848+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977848+0000","last_undegraded":"2024-09-15T22:51:14.977848+0000","last_fullsized":"2024-09-15T22:51:14.977848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975326+0000","last_change":"2024-09-15T22:51:14.973168+0000","last_active":"2024-09-15T22:51:14.975326+0000","last_peered":"2024-09-15T22:51:14.975326+0000","last_clean":"2024-09-15T22:51:14.975326+0000","last_became_active":"2024-09-15T22:51:14.972888+0000","last_became_peered":"2024-09-15T22:51:14.972888+0000","last_unstale":"2024-09-15T22:51:14.975326+0000","last_undegraded":"2024-09-15T22:51:14.975326+0000","last_fullsized":"2024-09-15T22:51:14.975326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.363473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960896+0000","last_change":"2024-09-15T22:51:14.960896+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960896+0000","last_undegraded":"2024-09-15T22:51:14.960896+0000","last_fullsized":"2024-09-15T22:51:14.960896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980309+0000","last_change":"2024-09-15T22:51:14.977285+0000","last_active":"2024-09-15T22:51:14.980309+0000","last_peered":"2024-09-15T22:51:14.980309+0000","last_clean":"2024-09-15T22:51:14.980309+0000","last_became_active":"2024-09-15T22:51:14.976967+0000","last_became_peered":"2024-09-15T22:51:14.976967+0000","last_unstale":"2024-09-15T22:51:14.980309+0000","last_undegraded":"2024-09-15T22:51:14.980309+0000","last_fullsized":"2024-09-15T22:51:14.980309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959909+0000","last_change":"2024-09-15T22:51:14.959909+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959909+0000","last_undegraded":"2024-09-15T22:51:14.959909+0000","last_fullsized":"2024-09-15T22:51:14.959909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977463+0000","last_change":"2024-09-15T22:51:14.974881+0000","last_active":"2024-09-15T22:51:14.977463+0000","last_peered":"2024-09-15T22:51:14.977463+0000","last_clean":"2024-09-15T22:51:14.977463+0000","last_became_active":"2024-09-15T22:51:14.974621+0000","last_became_peered":"2024-09-15T22:51:14.974621+0000","last_unstale":"2024-09-15T22:51:14.977463+0000","last_undegraded":"2024-09-15T22:51:14.977463+0000","last_fullsized":"2024-09-15T22:51:14.977463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963279+0000","last_change":"2024-09-15T22:51:14.963279+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963279+0000","last_undegraded":"2024-09-15T22:51:14.963279+0000","last_fullsized":"2024-09-15T22:51:14.963279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979066+0000","last_change":"2024-09-15T22:51:14.975174+0000","last_active":"2024-09-15T22:51:14.979066+0000","last_peered":"2024-09-15T22:51:14.979066+0000","last_clean":"2024-09-15T22:51:14.979066+0000","last_became_active":"2024-09-15T22:51:14.974907+0000","last_became_peered":"2024-09-15T22:51:14.974907+0000","last_unstale":"2024-09-15T22:51:14.979066+0000","last_undegraded":"2024-09-15T22:51:14.979066+0000","last_fullsized":"2024-09-15T22:51:14.979066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964683+0000","last_change":"2024-09-15T22:51:14.964683+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964683+0000","last_undegraded":"2024-09-15T22:51:14.964683+0000","last_fullsized":"2024-09-15T22:51:14.964683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977114+0000","last_change":"2024-09-15T22:51:14.973229+0000","last_active":"2024-09-15T22:51:14.977114+0000","last_peered":"2024-09-15T22:51:14.977114+0000","last_clean":"2024-09-15T22:51:14.977114+0000","last_became_active":"2024-09-15T22:51:14.972952+0000","last_became_peered":"2024-09-15T22:51:14.972952+0000","last_unstale":"2024-09-15T22:51:14.977114+0000","last_undegraded":"2024-09-15T22:51:14.977114+0000","last_fullsized":"2024-09-15T22:51:14.977114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974438+0000","last_change":"2024-09-15T22:51:14.974438+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974438+0000","last_undegraded":"2024-09-15T22:51:14.974438+0000","last_fullsized":"2024-09-15T22:51:14.974438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977168+0000","last_change":"2024-09-15T22:51:14.971981+0000","last_active":"2024-09-15T22:51:14.977168+0000","last_peered":"2024-09-15T22:51:14.977168+0000","last_clean":"2024-09-15T22:51:14.977168+0000","last_became_active":"2024-09-15T22:51:14.971568+0000","last_became_peered":"2024-09-15T22:51:14.971568+0000","last_unstale":"2024-09-15T22:51:14.977168+0000","last_undegraded":"2024-09-15T22:51:14.977168+0000","last_fullsized":"2024-09-15T22:51:14.977168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969071+0000","last_change":"2024-09-15T22:51:14.969071+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969071+0000","last_undegraded":"2024-09-15T22:51:14.969071+0000","last_fullsized":"2024-09-15T22:51:14.969071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989242+0000","last_change":"2024-09-15T22:51:14.987009+0000","last_active":"2024-09-15T22:51:14.989242+0000","last_peered":"2024-09-15T22:51:14.989242+0000","last_clean":"2024-09-15T22:51:14.989242+0000","last_became_active":"2024-09-15T22:51:14.986692+0000","last_became_peered":"2024-09-15T22:51:14.986692+0000","last_unstale":"2024-09-15T22:51:14.989242+0000","last_undegraded":"2024-09-15T22:51:14.989242+0000","last_fullsized":"2024-09-15T22:51:14.989242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980361+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:51:14.980361+0000","last_peered":"2024-09-15T22:51:14.980361+0000","last_clean":"2024-09-15T22:51:14.980361+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:51:14.980361+0000","last_undegraded":"2024-09-15T22:51:14.980361+0000","last_fullsized":"2024-09-15T22:51:14.980361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:51:20.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:51:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 Processor -- start 2024-09-15T22:51:20.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 -- start start 2024-09-15T22:51:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 0x7f59ac15e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.670 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ac09aa40 0x7f59ac0b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ac15d380 con 0x7f59ac0b46a0 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f59ac15d620 con 0x7f59ac09aa40 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b4600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac15d900 con 0x7f59ac15b320 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59ac09aa40 0x7f59ac0b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b2600640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f59ac0b46a0 0x7f59ac0cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33158/0 (socket says 172.21.15.31:33158) 2024-09-15T22:51:20.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b2600640 1 -- 172.21.15.31:0/3101235767 learned_addr learned my addr 172.21.15.31:0/3101235767 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 0x7f59ac15e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1200640 1 -- 172.21.15.31:0/3101235767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 msgr2=0x7f59ac15e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1200640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 0x7f59ac15e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1200640 1 -- 172.21.15.31:0/3101235767 >> v1:172.21.15.31:6789/0 conn(0x7f59ac0b46a0 legacy=0x7f59ac0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1200640 1 -- 172.21.15.31:0/3101235767 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac15dbe0 con 0x7f59ac09aa40 2024-09-15T22:51:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59abe00640 1 -- 172.21.15.31:0/3101235767 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864515522 0 0) 0x7f59ac15d380 con 0x7f59ac0b46a0 2024-09-15T22:51:20.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.668+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 0x7f59ac15e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b1200640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac09aa40 0x7f59ac0b4d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f599800ba60 tx=0x7f599801eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=198410f474da6000 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59abe00640 1 -- 172.21.15.31:0/3101235767 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980b4070 con 0x7f59ac09aa40 2024-09-15T22:51:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59abe00640 1 -- 172.21.15.31:0/3101235767 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59980a7a20 con 0x7f59ac09aa40 2024-09-15T22:51:20.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59abe00640 1 -- 172.21.15.31:0/3101235767 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59980a7df0 con 0x7f59ac09aa40 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- 172.21.15.31:0/3101235767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac09aa40 msgr2=0x7f59ac0b4d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac09aa40 0x7f59ac0b4d60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f599800ba60 tx=0x7f599801eb40 comp rx=0 tx=0).stop 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- 172.21.15.31:0/3101235767 shutdown_connections 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac09aa40 0x7f59ac0b4d60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 --2- 172.21.15.31:0/3101235767 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac15b320 0x7f59ac15e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- 172.21.15.31:0/3101235767 >> 172.21.15.31:0/3101235767 conn(0x7f59ac073540 msgr2=0x7f59ac0b2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- 172.21.15.31:0/3101235767 shutdown_connections 2024-09-15T22:51:20.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- 172.21.15.31:0/3101235767 wait complete. 2024-09-15T22:51:20.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 Processor -- start 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.672+0000 7f59b4600640 1 -- start start 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 0x7f59ac0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 0x7f59ac150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac06c4d0 con 0x7f59ac15b320 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59ac0b56b0 con 0x7f59ac09aa40 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59ac06c650 con 0x7f59ac0b46a0 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54848/0 (socket says 172.21.15.31:54848) 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 -- 172.21.15.31:0/3564779967 learned_addr learned my addr 172.21.15.31:0/3564779967 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b1200640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 0x7f59ac150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 -- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 msgr2=0x7f59ac150e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 0x7f59ac150e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 -- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 msgr2=0x7f59ac0cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 0x7f59ac0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 0x7f59ac0cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 -- 172.21.15.31:0/3564779967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ac0b2cb0 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b1200640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 0x7f59ac150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 0x7f59ac0cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b2600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c7a0 tx=0x7f59a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a4018070 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a400a640 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a400aab0 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ac0b29d0 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ac1570c0 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.676+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ac06ca10 con 0x7f59ac15b320 2024-09-15T22:51:20.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.680+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59a401b070 con 0x7f59ac15b320 2024-09-15T22:51:20.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.680+0000 7f59a9600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 0x7f598c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:20.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.680+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f59a4085490 con 0x7f59ac15b320 2024-09-15T22:51:20.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.680+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 0x7f598c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:20.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.680+0000 7f59b1c00640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 0x7f598c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59a0008890 tx=0x7f59a0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:20.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.684+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59a4055da0 con 0x7f59ac15b320 2024-09-15T22:51:20.848 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.844+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f59ac0b4270 con 0x7f598c0678c0 2024-09-15T22:51:20.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.852+0000 7f59a9600640 1 -- 172.21.15.31:0/3564779967 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+246636 (secure 0 0 0) 0x7f59ac0b4270 con 0x7f598c0678c0 2024-09-15T22:51:20.857 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:20.859 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 msgr2=0x7f598c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 0x7f598c069d80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59a0008890 tx=0x7f59a0008040 comp rx=0 tx=0).stop 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 msgr2=0x7f59ac1578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f59a400c7a0 tx=0x7f59a400cc60 comp rx=0 tx=0).stop 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 shutdown_connections 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f598c0678c0 0x7f598c069d80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59ac15b320 0x7f59ac1578c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59ac0b46a0 0x7f59ac150e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 --2- 172.21.15.31:0/3564779967 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59ac09aa40 0x7f59ac0cff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:20.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 >> 172.21.15.31:0/3564779967 conn(0x7f59ac073540 msgr2=0x7f59ac0b2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:20.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 shutdown_connections 2024-09-15T22:51:20.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:20.856+0000 7f59b4600640 1 -- 172.21.15.31:0/3564779967 wait complete. 2024-09-15T22:51:20.877 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-09-15T22:51:19.569266+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":36,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220680,"kb_used_data":4432,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754040,"statfs":{"total":773094113280,"available":772868136960,"internally_reserved":0,"allocated":4538368,"data_stored":2605898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.624999"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960093+0000","last_change":"2024-09-15T22:51:14.960093+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960093+0000","last_undegraded":"2024-09-15T22:51:14.960093+0000","last_fullsized":"2024-09-15T22:51:14.960093+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962022+0000","last_change":"2024-09-15T22:51:14.962022+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962022+0000","last_undegraded":"2024-09-15T22:51:14.962022+0000","last_fullsized":"2024-09-15T22:51:14.962022+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965376+0000","last_change":"2024-09-15T22:51:14.965376+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965376+0000","last_undegraded":"2024-09-15T22:51:14.965376+0000","last_fullsized":"2024-09-15T22:51:14.965376+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959294+0000","last_change":"2024-09-15T22:51:14.959294+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959294+0000","last_undegraded":"2024-09-15T22:51:14.959294+0000","last_fullsized":"2024-09-15T22:51:14.959294+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958919+0000","last_change":"2024-09-15T22:51:14.958919+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958919+0000","last_undegraded":"2024-09-15T22:51:14.958919+0000","last_fullsized":"2024-09-15T22:51:14.958919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960367+0000","last_change":"2024-09-15T22:51:14.960367+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960367+0000","last_undegraded":"2024-09-15T22:51:14.960367+0000","last_fullsized":"2024-09-15T22:51:14.960367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963179+0000","last_change":"2024-09-15T22:51:14.963179+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963179+0000","last_undegraded":"2024-09-15T22:51:14.963179+0000","last_fullsized":"2024-09-15T22:51:14.963179+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959534+0000","last_change":"2024-09-15T22:51:14.959534+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959534+0000","last_undegraded":"2024-09-15T22:51:14.959534+0000","last_fullsized":"2024-09-15T22:51:14.959534+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965805+0000","last_change":"2024-09-15T22:51:14.965805+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965805+0000","last_undegraded":"2024-09-15T22:51:14.965805+0000","last_fullsized":"2024-09-15T22:51:14.965805+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.971772+0000","last_change":"2024-09-15T22:51:14.971772+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.971772+0000","last_undegraded":"2024-09-15T22:51:14.971772+0000","last_fullsized":"2024-09-15T22:51:14.971772+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967862+0000","last_change":"2024-09-15T22:51:14.967862+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967862+0000","last_undegraded":"2024-09-15T22:51:14.967862+0000","last_fullsized":"2024-09-15T22:51:14.967862+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964856+0000","last_change":"2024-09-15T22:51:14.964856+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964856+0000","last_undegraded":"2024-09-15T22:51:14.964856+0000","last_fullsized":"2024-09-15T22:51:14.964856+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968343+0000","last_change":"2024-09-15T22:51:14.968343+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968343+0000","last_undegraded":"2024-09-15T22:51:14.968343+0000","last_fullsized":"2024-09-15T22:51:14.968343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969345+0000","last_change":"2024-09-15T22:51:14.969345+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969345+0000","last_undegraded":"2024-09-15T22:51:14.969345+0000","last_fullsized":"2024-09-15T22:51:14.969345+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962670+0000","last_change":"2024-09-15T22:51:14.962670+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962670+0000","last_undegraded":"2024-09-15T22:51:14.962670+0000","last_fullsized":"2024-09-15T22:51:14.962670+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.973428+0000","last_change":"2024-09-15T22:51:14.973428+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.973428+0000","last_undegraded":"2024-09-15T22:51:14.973428+0000","last_fullsized":"2024-09-15T22:51:14.973428+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975197+0000","last_change":"2024-09-15T22:51:14.975197+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975197+0000","last_undegraded":"2024-09-15T22:51:14.975197+0000","last_fullsized":"2024-09-15T22:51:14.975197+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958809+0000","last_change":"2024-09-15T22:51:14.958809+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958809+0000","last_undegraded":"2024-09-15T22:51:14.958809+0000","last_fullsized":"2024-09-15T22:51:14.958809+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964145+0000","last_change":"2024-09-15T22:51:14.964145+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964145+0000","last_undegraded":"2024-09-15T22:51:14.964145+0000","last_fullsized":"2024-09-15T22:51:14.964145+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967813+0000","last_change":"2024-09-15T22:51:14.967813+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967813+0000","last_undegraded":"2024-09-15T22:51:14.967813+0000","last_fullsized":"2024-09-15T22:51:14.967813+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965191+0000","last_change":"2024-09-15T22:51:14.965191+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965191+0000","last_undegraded":"2024-09-15T22:51:14.965191+0000","last_fullsized":"2024-09-15T22:51:14.965191+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977196+0000","last_change":"2024-09-15T22:51:14.977196+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977196+0000","last_undegraded":"2024-09-15T22:51:14.977196+0000","last_fullsized":"2024-09-15T22:51:14.977196+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959297+0000","last_change":"2024-09-15T22:51:14.959297+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959297+0000","last_undegraded":"2024-09-15T22:51:14.959297+0000","last_fullsized":"2024-09-15T22:51:14.959297+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964786+0000","last_change":"2024-09-15T22:51:14.964786+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964786+0000","last_undegraded":"2024-09-15T22:51:14.964786+0000","last_fullsized":"2024-09-15T22:51:14.964786+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962735+0000","last_change":"2024-09-15T22:51:14.962735+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962735+0000","last_undegraded":"2024-09-15T22:51:14.962735+0000","last_fullsized":"2024-09-15T22:51:14.962735+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.966193+0000","last_change":"2024-09-15T22:51:14.966193+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.966193+0000","last_undegraded":"2024-09-15T22:51:14.966193+0000","last_fullsized":"2024-09-15T22:51:14.966193+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.968563+0000","last_change":"2024-09-15T22:51:14.968563+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.968563+0000","last_undegraded":"2024-09-15T22:51:14.968563+0000","last_fullsized":"2024-09-15T22:51:14.968563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964135+0000","last_change":"2024-09-15T22:51:14.964135+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964135+0000","last_undegraded":"2024-09-15T22:51:14.964135+0000","last_fullsized":"2024-09-15T22:51:14.964135+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.965400+0000","last_change":"2024-09-15T22:51:14.965400+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.965400+0000","last_undegraded":"2024-09-15T22:51:14.965400+0000","last_fullsized":"2024-09-15T22:51:14.965400+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974352+0000","last_change":"2024-09-15T22:51:14.974352+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974352+0000","last_undegraded":"2024-09-15T22:51:14.974352+0000","last_fullsized":"2024-09-15T22:51:14.974352+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961903+0000","last_change":"2024-09-15T22:51:14.961903+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961903+0000","last_undegraded":"2024-09-15T22:51:14.961903+0000","last_fullsized":"2024-09-15T22:51:14.961903+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977273+0000","last_change":"2024-09-15T22:51:14.977273+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977273+0000","last_undegraded":"2024-09-15T22:51:14.977273+0000","last_fullsized":"2024-09-15T22:51:14.977273+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979097+0000","last_change":"2024-09-15T22:51:14.976712+0000","last_active":"2024-09-15T22:51:14.979097+0000","last_peered":"2024-09-15T22:51:14.979097+0000","last_clean":"2024-09-15T22:51:14.979097+0000","last_became_active":"2024-09-15T22:51:14.976384+0000","last_became_peered":"2024-09-15T22:51:14.976384+0000","last_unstale":"2024-09-15T22:51:14.979097+0000","last_undegraded":"2024-09-15T22:51:14.979097+0000","last_fullsized":"2024-09-15T22:51:14.979097+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964155+0000","last_change":"2024-09-15T22:51:14.964155+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964155+0000","last_undegraded":"2024-09-15T22:51:14.964155+0000","last_fullsized":"2024-09-15T22:51:14.964155+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982284+0000","last_change":"2024-09-15T22:51:14.981079+0000","last_active":"2024-09-15T22:51:14.982284+0000","last_peered":"2024-09-15T22:51:14.982284+0000","last_clean":"2024-09-15T22:51:14.982284+0000","last_became_active":"2024-09-15T22:51:14.980582+0000","last_became_peered":"2024-09-15T22:51:14.980582+0000","last_unstale":"2024-09-15T22:51:14.982284+0000","last_undegraded":"2024-09-15T22:51:14.982284+0000","last_fullsized":"2024-09-15T22:51:14.982284+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962897+0000","last_change":"2024-09-15T22:51:14.962897+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962897+0000","last_undegraded":"2024-09-15T22:51:14.962897+0000","last_fullsized":"2024-09-15T22:51:14.962897+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.982029+0000","last_change":"2024-09-15T22:51:14.978636+0000","last_active":"2024-09-15T22:51:14.982029+0000","last_peered":"2024-09-15T22:51:14.982029+0000","last_clean":"2024-09-15T22:51:14.982029+0000","last_became_active":"2024-09-15T22:51:14.978265+0000","last_became_peered":"2024-09-15T22:51:14.978265+0000","last_unstale":"2024-09-15T22:51:14.982029+0000","last_undegraded":"2024-09-15T22:51:14.982029+0000","last_fullsized":"2024-09-15T22:51:14.982029+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960964+0000","last_change":"2024-09-15T22:51:14.960964+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960964+0000","last_undegraded":"2024-09-15T22:51:14.960964+0000","last_fullsized":"2024-09-15T22:51:14.960964+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976881+0000","last_change":"2024-09-15T22:51:14.974047+0000","last_active":"2024-09-15T22:51:14.976881+0000","last_peered":"2024-09-15T22:51:14.976881+0000","last_clean":"2024-09-15T22:51:14.976881+0000","last_became_active":"2024-09-15T22:51:14.973769+0000","last_became_peered":"2024-09-15T22:51:14.973769+0000","last_unstale":"2024-09-15T22:51:14.976881+0000","last_undegraded":"2024-09-15T22:51:14.976881+0000","last_fullsized":"2024-09-15T22:51:14.976881+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963339+0000","last_change":"2024-09-15T22:51:14.963339+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963339+0000","last_undegraded":"2024-09-15T22:51:14.963339+0000","last_fullsized":"2024-09-15T22:51:14.963339+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981420+0000","last_change":"2024-09-15T22:51:14.974086+0000","last_active":"2024-09-15T22:51:14.981420+0000","last_peered":"2024-09-15T22:51:14.981420+0000","last_clean":"2024-09-15T22:51:14.981420+0000","last_became_active":"2024-09-15T22:51:14.973787+0000","last_became_peered":"2024-09-15T22:51:14.973787+0000","last_unstale":"2024-09-15T22:51:14.981420+0000","last_undegraded":"2024-09-15T22:51:14.981420+0000","last_fullsized":"2024-09-15T22:51:14.981420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:02.055900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962162+0000","last_change":"2024-09-15T22:51:14.962162+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962162+0000","last_undegraded":"2024-09-15T22:51:14.962162+0000","last_fullsized":"2024-09-15T22:51:14.962162+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989228+0000","last_change":"2024-09-15T22:51:14.986951+0000","last_active":"2024-09-15T22:51:14.989228+0000","last_peered":"2024-09-15T22:51:14.989228+0000","last_clean":"2024-09-15T22:51:14.989228+0000","last_became_active":"2024-09-15T22:51:14.986518+0000","last_became_peered":"2024-09-15T22:51:14.986518+0000","last_unstale":"2024-09-15T22:51:14.989228+0000","last_undegraded":"2024-09-15T22:51:14.989228+0000","last_fullsized":"2024-09-15T22:51:14.989228+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964195+0000","last_change":"2024-09-15T22:51:14.964195+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964195+0000","last_undegraded":"2024-09-15T22:51:14.964195+0000","last_fullsized":"2024-09-15T22:51:14.964195+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976684+0000","last_change":"2024-09-15T22:51:14.973894+0000","last_active":"2024-09-15T22:51:14.976684+0000","last_peered":"2024-09-15T22:51:14.976684+0000","last_clean":"2024-09-15T22:51:14.976684+0000","last_became_active":"2024-09-15T22:51:14.973577+0000","last_became_peered":"2024-09-15T22:51:14.973577+0000","last_unstale":"2024-09-15T22:51:14.976684+0000","last_undegraded":"2024-09-15T22:51:14.976684+0000","last_fullsized":"2024-09-15T22:51:14.976684+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961086+0000","last_change":"2024-09-15T22:51:14.961086+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961086+0000","last_undegraded":"2024-09-15T22:51:14.961086+0000","last_fullsized":"2024-09-15T22:51:14.961086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976811+0000","last_change":"2024-09-15T22:51:14.972066+0000","last_active":"2024-09-15T22:51:14.976811+0000","last_peered":"2024-09-15T22:51:14.976811+0000","last_clean":"2024-09-15T22:51:14.976811+0000","last_became_active":"2024-09-15T22:51:14.971640+0000","last_became_peered":"2024-09-15T22:51:14.971640+0000","last_unstale":"2024-09-15T22:51:14.976811+0000","last_undegraded":"2024-09-15T22:51:14.976811+0000","last_fullsized":"2024-09-15T22:51:14.976811+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958245+0000","last_change":"2024-09-15T22:51:14.958245+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958245+0000","last_undegraded":"2024-09-15T22:51:14.958245+0000","last_fullsized":"2024-09-15T22:51:14.958245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977235+0000","last_change":"2024-09-15T22:51:14.972265+0000","last_active":"2024-09-15T22:51:14.977235+0000","last_peered":"2024-09-15T22:51:14.977235+0000","last_clean":"2024-09-15T22:51:14.977235+0000","last_became_active":"2024-09-15T22:51:14.971919+0000","last_became_peered":"2024-09-15T22:51:14.971919+0000","last_unstale":"2024-09-15T22:51:14.977235+0000","last_undegraded":"2024-09-15T22:51:14.977235+0000","last_fullsized":"2024-09-15T22:51:14.977235+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.491357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.978317+0000","last_change":"2024-09-15T22:51:14.978317+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.978317+0000","last_undegraded":"2024-09-15T22:51:14.978317+0000","last_fullsized":"2024-09-15T22:51:14.978317+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985757+0000","last_change":"2024-09-15T22:51:14.979937+0000","last_active":"2024-09-15T22:51:14.985757+0000","last_peered":"2024-09-15T22:51:14.985757+0000","last_clean":"2024-09-15T22:51:14.985757+0000","last_became_active":"2024-09-15T22:51:14.979599+0000","last_became_peered":"2024-09-15T22:51:14.979599+0000","last_unstale":"2024-09-15T22:51:14.985757+0000","last_undegraded":"2024-09-15T22:51:14.985757+0000","last_fullsized":"2024-09-15T22:51:14.985757+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:29:28.714421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961676+0000","last_change":"2024-09-15T22:51:14.961676+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961676+0000","last_undegraded":"2024-09-15T22:51:14.961676+0000","last_fullsized":"2024-09-15T22:51:14.961676+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985795+0000","last_change":"2024-09-15T22:51:14.980163+0000","last_active":"2024-09-15T22:51:14.985795+0000","last_peered":"2024-09-15T22:51:14.985795+0000","last_clean":"2024-09-15T22:51:14.985795+0000","last_became_active":"2024-09-15T22:51:14.979726+0000","last_became_peered":"2024-09-15T22:51:14.979726+0000","last_unstale":"2024-09-15T22:51:14.985795+0000","last_undegraded":"2024-09-15T22:51:14.985795+0000","last_fullsized":"2024-09-15T22:51:14.985795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:37:03.182113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961440+0000","last_change":"2024-09-15T22:51:14.961440+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961440+0000","last_undegraded":"2024-09-15T22:51:14.961440+0000","last_fullsized":"2024-09-15T22:51:14.961440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.981142+0000","last_change":"2024-09-15T22:51:14.980076+0000","last_active":"2024-09-15T22:51:14.981142+0000","last_peered":"2024-09-15T22:51:14.981142+0000","last_clean":"2024-09-15T22:51:14.981142+0000","last_became_active":"2024-09-15T22:51:14.979781+0000","last_became_peered":"2024-09-15T22:51:14.979781+0000","last_unstale":"2024-09-15T22:51:14.981142+0000","last_undegraded":"2024-09-15T22:51:14.981142+0000","last_fullsized":"2024-09-15T22:51:14.981142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:21:06.565997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960407+0000","last_change":"2024-09-15T22:51:14.960407+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960407+0000","last_undegraded":"2024-09-15T22:51:14.960407+0000","last_fullsized":"2024-09-15T22:51:14.960407+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975741+0000","last_change":"2024-09-15T22:51:14.971500+0000","last_active":"2024-09-15T22:51:14.975741+0000","last_peered":"2024-09-15T22:51:14.975741+0000","last_clean":"2024-09-15T22:51:14.975741+0000","last_became_active":"2024-09-15T22:51:14.971212+0000","last_became_peered":"2024-09-15T22:51:14.971212+0000","last_unstale":"2024-09-15T22:51:14.975741+0000","last_undegraded":"2024-09-15T22:51:14.975741+0000","last_fullsized":"2024-09-15T22:51:14.975741+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959157+0000","last_change":"2024-09-15T22:51:14.959157+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959157+0000","last_undegraded":"2024-09-15T22:51:14.959157+0000","last_fullsized":"2024-09-15T22:51:14.959157+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.976720+0000","last_change":"2024-09-15T22:51:14.974430+0000","last_active":"2024-09-15T22:51:14.976720+0000","last_peered":"2024-09-15T22:51:14.976720+0000","last_clean":"2024-09-15T22:51:14.976720+0000","last_became_active":"2024-09-15T22:51:14.974129+0000","last_became_peered":"2024-09-15T22:51:14.974129+0000","last_unstale":"2024-09-15T22:51:14.976720+0000","last_undegraded":"2024-09-15T22:51:14.976720+0000","last_fullsized":"2024-09-15T22:51:14.976720+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.975580+0000","last_change":"2024-09-15T22:51:14.975580+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.975580+0000","last_undegraded":"2024-09-15T22:51:14.975580+0000","last_fullsized":"2024-09-15T22:51:14.975580+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978766+0000","last_change":"2024-09-15T22:51:14.973590+0000","last_active":"2024-09-15T22:51:14.978766+0000","last_peered":"2024-09-15T22:51:14.978766+0000","last_clean":"2024-09-15T22:51:14.978766+0000","last_became_active":"2024-09-15T22:51:14.973243+0000","last_became_peered":"2024-09-15T22:51:14.973243+0000","last_unstale":"2024-09-15T22:51:14.978766+0000","last_undegraded":"2024-09-15T22:51:14.978766+0000","last_fullsized":"2024-09-15T22:51:14.978766+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:36:50.409291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960536+0000","last_change":"2024-09-15T22:51:14.960536+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960536+0000","last_undegraded":"2024-09-15T22:51:14.960536+0000","last_fullsized":"2024-09-15T22:51:14.960536+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.987568+0000","last_change":"2024-09-15T22:51:14.985081+0000","last_active":"2024-09-15T22:51:14.987568+0000","last_peered":"2024-09-15T22:51:14.987568+0000","last_clean":"2024-09-15T22:51:14.987568+0000","last_became_active":"2024-09-15T22:51:14.984750+0000","last_became_peered":"2024-09-15T22:51:14.984750+0000","last_unstale":"2024-09-15T22:51:14.987568+0000","last_undegraded":"2024-09-15T22:51:14.987568+0000","last_fullsized":"2024-09-15T22:51:14.987568+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961252+0000","last_change":"2024-09-15T22:51:14.961252+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961252+0000","last_undegraded":"2024-09-15T22:51:14.961252+0000","last_fullsized":"2024-09-15T22:51:14.961252+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985949+0000","last_change":"2024-09-15T22:51:14.981702+0000","last_active":"2024-09-15T22:51:14.985949+0000","last_peered":"2024-09-15T22:51:14.985949+0000","last_clean":"2024-09-15T22:51:14.985949+0000","last_became_active":"2024-09-15T22:51:14.981473+0000","last_became_peered":"2024-09-15T22:51:14.981473+0000","last_unstale":"2024-09-15T22:51:14.985949+0000","last_undegraded":"2024-09-15T22:51:14.985949+0000","last_fullsized":"2024-09-15T22:51:14.985949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:48.535081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967496+0000","last_change":"2024-09-15T22:51:14.967496+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967496+0000","last_undegraded":"2024-09-15T22:51:14.967496+0000","last_fullsized":"2024-09-15T22:51:14.967496+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.978420+0000","last_change":"2024-09-15T22:51:14.975951+0000","last_active":"2024-09-15T22:51:14.978420+0000","last_peered":"2024-09-15T22:51:14.978420+0000","last_clean":"2024-09-15T22:51:14.978420+0000","last_became_active":"2024-09-15T22:51:14.975646+0000","last_became_peered":"2024-09-15T22:51:14.975646+0000","last_unstale":"2024-09-15T22:51:14.978420+0000","last_undegraded":"2024-09-15T22:51:14.978420+0000","last_fullsized":"2024-09-15T22:51:14.978420+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.962455+0000","last_change":"2024-09-15T22:51:14.962455+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.962455+0000","last_undegraded":"2024-09-15T22:51:14.962455+0000","last_fullsized":"2024-09-15T22:51:14.962455+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985444+0000","last_change":"2024-09-15T22:51:14.984134+0000","last_active":"2024-09-15T22:51:14.985444+0000","last_peered":"2024-09-15T22:51:14.985444+0000","last_clean":"2024-09-15T22:51:14.985444+0000","last_became_active":"2024-09-15T22:51:14.983836+0000","last_became_peered":"2024-09-15T22:51:14.983836+0000","last_unstale":"2024-09-15T22:51:14.985444+0000","last_undegraded":"2024-09-15T22:51:14.985444+0000","last_fullsized":"2024-09-15T22:51:14.985444+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:38:42.823356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.958046+0000","last_change":"2024-09-15T22:51:14.958046+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.958046+0000","last_undegraded":"2024-09-15T22:51:14.958046+0000","last_fullsized":"2024-09-15T22:51:14.958046+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979913+0000","last_change":"2024-09-15T22:51:14.976515+0000","last_active":"2024-09-15T22:51:14.979913+0000","last_peered":"2024-09-15T22:51:14.979913+0000","last_clean":"2024-09-15T22:51:14.979913+0000","last_became_active":"2024-09-15T22:51:14.976095+0000","last_became_peered":"2024-09-15T22:51:14.976095+0000","last_unstale":"2024-09-15T22:51:14.979913+0000","last_undegraded":"2024-09-15T22:51:14.979913+0000","last_fullsized":"2024-09-15T22:51:14.979913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.972865+0000","last_change":"2024-09-15T22:51:14.972865+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.972865+0000","last_undegraded":"2024-09-15T22:51:14.972865+0000","last_fullsized":"2024-09-15T22:51:14.972865+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977129+0000","last_change":"2024-09-15T22:51:14.970136+0000","last_active":"2024-09-15T22:51:14.977129+0000","last_peered":"2024-09-15T22:51:14.977129+0000","last_clean":"2024-09-15T22:51:14.977129+0000","last_became_active":"2024-09-15T22:51:14.969847+0000","last_became_peered":"2024-09-15T22:51:14.969847+0000","last_unstale":"2024-09-15T22:51:14.977129+0000","last_undegraded":"2024-09-15T22:51:14.977129+0000","last_fullsized":"2024-09-15T22:51:14.977129+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:52:06.617413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963147+0000","last_change":"2024-09-15T22:51:14.963147+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963147+0000","last_undegraded":"2024-09-15T22:51:14.963147+0000","last_fullsized":"2024-09-15T22:51:14.963147+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975374+0000","last_change":"2024-09-15T22:51:14.972795+0000","last_active":"2024-09-15T22:51:14.975374+0000","last_peered":"2024-09-15T22:51:14.975374+0000","last_clean":"2024-09-15T22:51:14.975374+0000","last_became_active":"2024-09-15T22:51:14.972530+0000","last_became_peered":"2024-09-15T22:51:14.972530+0000","last_unstale":"2024-09-15T22:51:14.975374+0000","last_undegraded":"2024-09-15T22:51:14.975374+0000","last_fullsized":"2024-09-15T22:51:14.975374+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:20.601266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.967000+0000","last_change":"2024-09-15T22:51:14.967000+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.967000+0000","last_undegraded":"2024-09-15T22:51:14.967000+0000","last_fullsized":"2024-09-15T22:51:14.967000+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989213+0000","last_change":"2024-09-15T22:51:14.986927+0000","last_active":"2024-09-15T22:51:14.989213+0000","last_peered":"2024-09-15T22:51:14.989213+0000","last_clean":"2024-09-15T22:51:14.989213+0000","last_became_active":"2024-09-15T22:51:14.986593+0000","last_became_peered":"2024-09-15T22:51:14.986593+0000","last_unstale":"2024-09-15T22:51:14.989213+0000","last_undegraded":"2024-09-15T22:51:14.989213+0000","last_fullsized":"2024-09-15T22:51:14.989213+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959682+0000","last_change":"2024-09-15T22:51:14.959682+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959682+0000","last_undegraded":"2024-09-15T22:51:14.959682+0000","last_fullsized":"2024-09-15T22:51:14.959682+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975337+0000","last_change":"2024-09-15T22:51:14.969964+0000","last_active":"2024-09-15T22:51:14.975337+0000","last_peered":"2024-09-15T22:51:14.975337+0000","last_clean":"2024-09-15T22:51:14.975337+0000","last_became_active":"2024-09-15T22:51:14.969593+0000","last_became_peered":"2024-09-15T22:51:14.969593+0000","last_unstale":"2024-09-15T22:51:14.975337+0000","last_undegraded":"2024-09-15T22:51:14.975337+0000","last_fullsized":"2024-09-15T22:51:14.975337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:24.050921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.961121+0000","last_change":"2024-09-15T22:51:14.961121+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.961121+0000","last_undegraded":"2024-09-15T22:51:14.961121+0000","last_fullsized":"2024-09-15T22:51:14.961121+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.985927+0000","last_change":"2024-09-15T22:51:14.981097+0000","last_active":"2024-09-15T22:51:14.985927+0000","last_peered":"2024-09-15T22:51:14.985927+0000","last_clean":"2024-09-15T22:51:14.985927+0000","last_became_active":"2024-09-15T22:51:14.980807+0000","last_became_peered":"2024-09-15T22:51:14.980807+0000","last_unstale":"2024-09-15T22:51:14.985927+0000","last_undegraded":"2024-09-15T22:51:14.985927+0000","last_fullsized":"2024-09-15T22:51:14.985927+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:57:36.425528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.977848+0000","last_change":"2024-09-15T22:51:14.977848+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.977848+0000","last_undegraded":"2024-09-15T22:51:14.977848+0000","last_fullsized":"2024-09-15T22:51:14.977848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.975326+0000","last_change":"2024-09-15T22:51:14.973168+0000","last_active":"2024-09-15T22:51:14.975326+0000","last_peered":"2024-09-15T22:51:14.975326+0000","last_clean":"2024-09-15T22:51:14.975326+0000","last_became_active":"2024-09-15T22:51:14.972888+0000","last_became_peered":"2024-09-15T22:51:14.972888+0000","last_unstale":"2024-09-15T22:51:14.975326+0000","last_undegraded":"2024-09-15T22:51:14.975326+0000","last_fullsized":"2024-09-15T22:51:14.975326+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:33:52.363473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.960896+0000","last_change":"2024-09-15T22:51:14.960896+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.960896+0000","last_undegraded":"2024-09-15T22:51:14.960896+0000","last_fullsized":"2024-09-15T22:51:14.960896+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980309+0000","last_change":"2024-09-15T22:51:14.977285+0000","last_active":"2024-09-15T22:51:14.980309+0000","last_peered":"2024-09-15T22:51:14.980309+0000","last_clean":"2024-09-15T22:51:14.980309+0000","last_became_active":"2024-09-15T22:51:14.976967+0000","last_became_peered":"2024-09-15T22:51:14.976967+0000","last_unstale":"2024-09-15T22:51:14.980309+0000","last_undegraded":"2024-09-15T22:51:14.980309+0000","last_fullsized":"2024-09-15T22:51:14.980309+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.959909+0000","last_change":"2024-09-15T22:51:14.959909+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.959909+0000","last_undegraded":"2024-09-15T22:51:14.959909+0000","last_fullsized":"2024-09-15T22:51:14.959909+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977463+0000","last_change":"2024-09-15T22:51:14.974881+0000","last_active":"2024-09-15T22:51:14.977463+0000","last_peered":"2024-09-15T22:51:14.977463+0000","last_clean":"2024-09-15T22:51:14.977463+0000","last_became_active":"2024-09-15T22:51:14.974621+0000","last_became_peered":"2024-09-15T22:51:14.974621+0000","last_unstale":"2024-09-15T22:51:14.977463+0000","last_undegraded":"2024-09-15T22:51:14.977463+0000","last_fullsized":"2024-09-15T22:51:14.977463+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:27:15.476895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.963279+0000","last_change":"2024-09-15T22:51:14.963279+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.963279+0000","last_undegraded":"2024-09-15T22:51:14.963279+0000","last_fullsized":"2024-09-15T22:51:14.963279+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.979066+0000","last_change":"2024-09-15T22:51:14.975174+0000","last_active":"2024-09-15T22:51:14.979066+0000","last_peered":"2024-09-15T22:51:14.979066+0000","last_clean":"2024-09-15T22:51:14.979066+0000","last_became_active":"2024-09-15T22:51:14.974907+0000","last_became_peered":"2024-09-15T22:51:14.974907+0000","last_unstale":"2024-09-15T22:51:14.979066+0000","last_undegraded":"2024-09-15T22:51:14.979066+0000","last_fullsized":"2024-09-15T22:51:14.979066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.964683+0000","last_change":"2024-09-15T22:51:14.964683+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.964683+0000","last_undegraded":"2024-09-15T22:51:14.964683+0000","last_fullsized":"2024-09-15T22:51:14.964683+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977114+0000","last_change":"2024-09-15T22:51:14.973229+0000","last_active":"2024-09-15T22:51:14.977114+0000","last_peered":"2024-09-15T22:51:14.977114+0000","last_clean":"2024-09-15T22:51:14.977114+0000","last_became_active":"2024-09-15T22:51:14.972952+0000","last_became_peered":"2024-09-15T22:51:14.972952+0000","last_unstale":"2024-09-15T22:51:14.977114+0000","last_undegraded":"2024-09-15T22:51:14.977114+0000","last_fullsized":"2024-09-15T22:51:14.977114+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:06:18.129310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.974438+0000","last_change":"2024-09-15T22:51:14.974438+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.974438+0000","last_undegraded":"2024-09-15T22:51:14.974438+0000","last_fullsized":"2024-09-15T22:51:14.974438+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.977168+0000","last_change":"2024-09-15T22:51:14.971981+0000","last_active":"2024-09-15T22:51:14.977168+0000","last_peered":"2024-09-15T22:51:14.977168+0000","last_clean":"2024-09-15T22:51:14.977168+0000","last_became_active":"2024-09-15T22:51:14.971568+0000","last_became_peered":"2024-09-15T22:51:14.971568+0000","last_unstale":"2024-09-15T22:51:14.977168+0000","last_undegraded":"2024-09-15T22:51:14.977168+0000","last_fullsized":"2024-09-15T22:51:14.977168+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":37,"state":"creating+peering","last_fresh":"2024-09-15T22:51:14.969071+0000","last_change":"2024-09-15T22:51:14.969071+0000","last_active":"2024-09-15T22:51:14.943289+0000","last_peered":"2024-09-15T22:51:14.943289+0000","last_clean":"2024-09-15T22:51:14.943289+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-15T22:51:14.969071+0000","last_undegraded":"2024-09-15T22:51:14.969071+0000","last_fullsized":"2024-09-15T22:51:14.969071+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.989242+0000","last_change":"2024-09-15T22:51:14.987009+0000","last_active":"2024-09-15T22:51:14.989242+0000","last_peered":"2024-09-15T22:51:14.989242+0000","last_clean":"2024-09-15T22:51:14.989242+0000","last_became_active":"2024-09-15T22:51:14.986692+0000","last_became_peered":"2024-09-15T22:51:14.986692+0000","last_unstale":"2024-09-15T22:51:14.989242+0000","last_undegraded":"2024-09-15T22:51:14.989242+0000","last_fullsized":"2024-09-15T22:51:14.989242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":199,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-15T22:51:14.980361+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:51:14.980361+0000","last_peered":"2024-09-15T22:51:14.980361+0000","last_clean":"2024-09-15T22:51:14.980361+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:51:14.980361+0000","last_undegraded":"2024-09-15T22:51:14.980361+0000","last_fullsized":"2024-09-15T22:51:14.980361+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542161,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27428,"kb_used_data":400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344412,"statfs":{"total":96636764160,"available":96608677888,"internally_reserved":0,"allocated":409600,"data_stored":173145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542161,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27444,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344396,"statfs":{"total":96636764160,"available":96608661504,"internally_reserved":0,"allocated":421888,"data_stored":179812,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542160,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28024,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343816,"statfs":{"total":96636764160,"available":96608067584,"internally_reserved":0,"allocated":1015808,"data_stored":770180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:51:20.881 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3f is not active+clean 2024-09-15T22:51:20.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960093+0000', 'last_change': '2024-09-15T22:51:14.960093+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960093+0000', 'last_undegraded': '2024-09-15T22:51:14.960093+0000', 'last_fullsized': '2024-09-15T22:51:14.960093+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.881 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3e is not active+clean 2024-09-15T22:51:20.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962022+0000', 'last_change': '2024-09-15T22:51:14.962022+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962022+0000', 'last_undegraded': '2024-09-15T22:51:14.962022+0000', 'last_fullsized': '2024-09-15T22:51:14.962022+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3d is not active+clean 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.965376+0000', 'last_change': '2024-09-15T22:51:14.965376+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.965376+0000', 'last_undegraded': '2024-09-15T22:51:14.965376+0000', 'last_fullsized': '2024-09-15T22:51:14.965376+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3c is not active+clean 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959294+0000', 'last_change': '2024-09-15T22:51:14.959294+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959294+0000', 'last_undegraded': '2024-09-15T22:51:14.959294+0000', 'last_fullsized': '2024-09-15T22:51:14.959294+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3b is not active+clean 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.958919+0000', 'last_change': '2024-09-15T22:51:14.958919+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.958919+0000', 'last_undegraded': '2024-09-15T22:51:14.958919+0000', 'last_fullsized': '2024-09-15T22:51:14.958919+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3a is not active+clean 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960367+0000', 'last_change': '2024-09-15T22:51:14.960367+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960367+0000', 'last_undegraded': '2024-09-15T22:51:14.960367+0000', 'last_fullsized': '2024-09-15T22:51:14.960367+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.39 is not active+clean 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.963179+0000', 'last_change': '2024-09-15T22:51:14.963179+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.963179+0000', 'last_undegraded': '2024-09-15T22:51:14.963179+0000', 'last_fullsized': '2024-09-15T22:51:14.963179+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.882 INFO:tasks.ceph.ceph_manager.ceph:PG 6.38 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959534+0000', 'last_change': '2024-09-15T22:51:14.959534+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959534+0000', 'last_undegraded': '2024-09-15T22:51:14.959534+0000', 'last_fullsized': '2024-09-15T22:51:14.959534+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.37 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.965805+0000', 'last_change': '2024-09-15T22:51:14.965805+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.965805+0000', 'last_undegraded': '2024-09-15T22:51:14.965805+0000', 'last_fullsized': '2024-09-15T22:51:14.965805+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.36 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.971772+0000', 'last_change': '2024-09-15T22:51:14.971772+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.971772+0000', 'last_undegraded': '2024-09-15T22:51:14.971772+0000', 'last_fullsized': '2024-09-15T22:51:14.971772+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.35 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.967862+0000', 'last_change': '2024-09-15T22:51:14.967862+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.967862+0000', 'last_undegraded': '2024-09-15T22:51:14.967862+0000', 'last_fullsized': '2024-09-15T22:51:14.967862+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.34 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964856+0000', 'last_change': '2024-09-15T22:51:14.964856+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964856+0000', 'last_undegraded': '2024-09-15T22:51:14.964856+0000', 'last_fullsized': '2024-09-15T22:51:14.964856+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.33 is not active+clean 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.968343+0000', 'last_change': '2024-09-15T22:51:14.968343+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.968343+0000', 'last_undegraded': '2024-09-15T22:51:14.968343+0000', 'last_fullsized': '2024-09-15T22:51:14.968343+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.883 INFO:tasks.ceph.ceph_manager.ceph:PG 6.32 is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.969345+0000', 'last_change': '2024-09-15T22:51:14.969345+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.969345+0000', 'last_undegraded': '2024-09-15T22:51:14.969345+0000', 'last_fullsized': '2024-09-15T22:51:14.969345+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:PG 6.31 is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962670+0000', 'last_change': '2024-09-15T22:51:14.962670+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962670+0000', 'last_undegraded': '2024-09-15T22:51:14.962670+0000', 'last_fullsized': '2024-09-15T22:51:14.962670+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:PG 6.30 is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.973428+0000', 'last_change': '2024-09-15T22:51:14.973428+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.973428+0000', 'last_undegraded': '2024-09-15T22:51:14.973428+0000', 'last_fullsized': '2024-09-15T22:51:14.973428+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2f is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.975197+0000', 'last_change': '2024-09-15T22:51:14.975197+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.975197+0000', 'last_undegraded': '2024-09-15T22:51:14.975197+0000', 'last_fullsized': '2024-09-15T22:51:14.975197+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2e is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964135+0000', 'last_change': '2024-09-15T22:51:14.964135+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964135+0000', 'last_undegraded': '2024-09-15T22:51:14.964135+0000', 'last_fullsized': '2024-09-15T22:51:14.964135+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2d is not active+clean 2024-09-15T22:51:20.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.958809+0000', 'last_change': '2024-09-15T22:51:14.958809+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.958809+0000', 'last_undegraded': '2024-09-15T22:51:14.958809+0000', 'last_fullsized': '2024-09-15T22:51:14.958809+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2c is not active+clean 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964145+0000', 'last_change': '2024-09-15T22:51:14.964145+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964145+0000', 'last_undegraded': '2024-09-15T22:51:14.964145+0000', 'last_fullsized': '2024-09-15T22:51:14.964145+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2b is not active+clean 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.967813+0000', 'last_change': '2024-09-15T22:51:14.967813+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.967813+0000', 'last_undegraded': '2024-09-15T22:51:14.967813+0000', 'last_fullsized': '2024-09-15T22:51:14.967813+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2a is not active+clean 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.965191+0000', 'last_change': '2024-09-15T22:51:14.965191+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.965191+0000', 'last_undegraded': '2024-09-15T22:51:14.965191+0000', 'last_fullsized': '2024-09-15T22:51:14.965191+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.29 is not active+clean 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.977196+0000', 'last_change': '2024-09-15T22:51:14.977196+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.977196+0000', 'last_undegraded': '2024-09-15T22:51:14.977196+0000', 'last_fullsized': '2024-09-15T22:51:14.977196+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.28 is not active+clean 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959297+0000', 'last_change': '2024-09-15T22:51:14.959297+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959297+0000', 'last_undegraded': '2024-09-15T22:51:14.959297+0000', 'last_fullsized': '2024-09-15T22:51:14.959297+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.885 INFO:tasks.ceph.ceph_manager.ceph:PG 6.27 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964786+0000', 'last_change': '2024-09-15T22:51:14.964786+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964786+0000', 'last_undegraded': '2024-09-15T22:51:14.964786+0000', 'last_fullsized': '2024-09-15T22:51:14.964786+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:PG 6.26 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962735+0000', 'last_change': '2024-09-15T22:51:14.962735+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962735+0000', 'last_undegraded': '2024-09-15T22:51:14.962735+0000', 'last_fullsized': '2024-09-15T22:51:14.962735+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:PG 6.25 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.966193+0000', 'last_change': '2024-09-15T22:51:14.966193+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.966193+0000', 'last_undegraded': '2024-09-15T22:51:14.966193+0000', 'last_fullsized': '2024-09-15T22:51:14.966193+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:PG 6.24 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.968563+0000', 'last_change': '2024-09-15T22:51:14.968563+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.968563+0000', 'last_undegraded': '2024-09-15T22:51:14.968563+0000', 'last_fullsized': '2024-09-15T22:51:14.968563+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:PG 6.23 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964135+0000', 'last_change': '2024-09-15T22:51:14.964135+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964135+0000', 'last_undegraded': '2024-09-15T22:51:14.964135+0000', 'last_fullsized': '2024-09-15T22:51:14.964135+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:PG 6.22 is not active+clean 2024-09-15T22:51:20.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.965400+0000', 'last_change': '2024-09-15T22:51:14.965400+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.965400+0000', 'last_undegraded': '2024-09-15T22:51:14.965400+0000', 'last_fullsized': '2024-09-15T22:51:14.965400+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.21 is not active+clean 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.974352+0000', 'last_change': '2024-09-15T22:51:14.974352+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.974352+0000', 'last_undegraded': '2024-09-15T22:51:14.974352+0000', 'last_fullsized': '2024-09-15T22:51:14.974352+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.20 is not active+clean 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961903+0000', 'last_change': '2024-09-15T22:51:14.961903+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961903+0000', 'last_undegraded': '2024-09-15T22:51:14.961903+0000', 'last_fullsized': '2024-09-15T22:51:14.961903+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1c is not active+clean 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.977273+0000', 'last_change': '2024-09-15T22:51:14.977273+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.977273+0000', 'last_undegraded': '2024-09-15T22:51:14.977273+0000', 'last_fullsized': '2024-09-15T22:51:14.977273+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1d is not active+clean 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964155+0000', 'last_change': '2024-09-15T22:51:14.964155+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964155+0000', 'last_undegraded': '2024-09-15T22:51:14.964155+0000', 'last_fullsized': '2024-09-15T22:51:14.964155+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1e is not active+clean 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962897+0000', 'last_change': '2024-09-15T22:51:14.962897+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962897+0000', 'last_undegraded': '2024-09-15T22:51:14.962897+0000', 'last_fullsized': '2024-09-15T22:51:14.962897+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.887 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1f is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960964+0000', 'last_change': '2024-09-15T22:51:14.960964+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960964+0000', 'last_undegraded': '2024-09-15T22:51:14.960964+0000', 'last_fullsized': '2024-09-15T22:51:14.960964+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.963339+0000', 'last_change': '2024-09-15T22:51:14.963339+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.963339+0000', 'last_undegraded': '2024-09-15T22:51:14.963339+0000', 'last_fullsized': '2024-09-15T22:51:14.963339+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:PG 6.19 is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962162+0000', 'last_change': '2024-09-15T22:51:14.962162+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962162+0000', 'last_undegraded': '2024-09-15T22:51:14.962162+0000', 'last_fullsized': '2024-09-15T22:51:14.962162+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1a is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964195+0000', 'last_change': '2024-09-15T22:51:14.964195+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964195+0000', 'last_undegraded': '2024-09-15T22:51:14.964195+0000', 'last_fullsized': '2024-09-15T22:51:14.964195+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1b is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961086+0000', 'last_change': '2024-09-15T22:51:14.961086+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961086+0000', 'last_undegraded': '2024-09-15T22:51:14.961086+0000', 'last_fullsized': '2024-09-15T22:51:14.961086+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:PG 6.14 is not active+clean 2024-09-15T22:51:20.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.958245+0000', 'last_change': '2024-09-15T22:51:14.958245+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.958245+0000', 'last_undegraded': '2024-09-15T22:51:14.958245+0000', 'last_fullsized': '2024-09-15T22:51:14.958245+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.15 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.978317+0000', 'last_change': '2024-09-15T22:51:14.978317+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.978317+0000', 'last_undegraded': '2024-09-15T22:51:14.978317+0000', 'last_fullsized': '2024-09-15T22:51:14.978317+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961676+0000', 'last_change': '2024-09-15T22:51:14.961676+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961676+0000', 'last_undegraded': '2024-09-15T22:51:14.961676+0000', 'last_fullsized': '2024-09-15T22:51:14.961676+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.17 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961440+0000', 'last_change': '2024-09-15T22:51:14.961440+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961440+0000', 'last_undegraded': '2024-09-15T22:51:14.961440+0000', 'last_fullsized': '2024-09-15T22:51:14.961440+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960407+0000', 'last_change': '2024-09-15T22:51:14.960407+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960407+0000', 'last_undegraded': '2024-09-15T22:51:14.960407+0000', 'last_fullsized': '2024-09-15T22:51:14.960407+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.11 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959157+0000', 'last_change': '2024-09-15T22:51:14.959157+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959157+0000', 'last_undegraded': '2024-09-15T22:51:14.959157+0000', 'last_fullsized': '2024-09-15T22:51:14.959157+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:PG 6.12 is not active+clean 2024-09-15T22:51:20.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.975580+0000', 'last_change': '2024-09-15T22:51:14.975580+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.975580+0000', 'last_undegraded': '2024-09-15T22:51:14.975580+0000', 'last_fullsized': '2024-09-15T22:51:14.975580+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.13 is not active+clean 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960536+0000', 'last_change': '2024-09-15T22:51:14.960536+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960536+0000', 'last_undegraded': '2024-09-15T22:51:14.960536+0000', 'last_fullsized': '2024-09-15T22:51:14.960536+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.c is not active+clean 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961252+0000', 'last_change': '2024-09-15T22:51:14.961252+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961252+0000', 'last_undegraded': '2024-09-15T22:51:14.961252+0000', 'last_fullsized': '2024-09-15T22:51:14.961252+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.d is not active+clean 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.967496+0000', 'last_change': '2024-09-15T22:51:14.967496+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.967496+0000', 'last_undegraded': '2024-09-15T22:51:14.967496+0000', 'last_fullsized': '2024-09-15T22:51:14.967496+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.e is not active+clean 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.962455+0000', 'last_change': '2024-09-15T22:51:14.962455+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.962455+0000', 'last_undegraded': '2024-09-15T22:51:14.962455+0000', 'last_fullsized': '2024-09-15T22:51:14.962455+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.f is not active+clean 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.958046+0000', 'last_change': '2024-09-15T22:51:14.958046+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.958046+0000', 'last_undegraded': '2024-09-15T22:51:14.958046+0000', 'last_fullsized': '2024-09-15T22:51:14.958046+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-15T22:51:20.890 INFO:tasks.ceph.ceph_manager.ceph:PG 6.8 is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.972865+0000', 'last_change': '2024-09-15T22:51:14.972865+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.972865+0000', 'last_undegraded': '2024-09-15T22:51:14.972865+0000', 'last_fullsized': '2024-09-15T22:51:14.972865+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.963147+0000', 'last_change': '2024-09-15T22:51:14.963147+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.963147+0000', 'last_undegraded': '2024-09-15T22:51:14.963147+0000', 'last_fullsized': '2024-09-15T22:51:14.963147+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:PG 6.a is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.967000+0000', 'last_change': '2024-09-15T22:51:14.967000+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.967000+0000', 'last_undegraded': '2024-09-15T22:51:14.967000+0000', 'last_fullsized': '2024-09-15T22:51:14.967000+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:PG 6.b is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959682+0000', 'last_change': '2024-09-15T22:51:14.959682+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959682+0000', 'last_undegraded': '2024-09-15T22:51:14.959682+0000', 'last_fullsized': '2024-09-15T22:51:14.959682+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:PG 6.4 is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.961121+0000', 'last_change': '2024-09-15T22:51:14.961121+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.961121+0000', 'last_undegraded': '2024-09-15T22:51:14.961121+0000', 'last_fullsized': '2024-09-15T22:51:14.961121+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:PG 6.5 is not active+clean 2024-09-15T22:51:20.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.977848+0000', 'last_change': '2024-09-15T22:51:14.977848+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.977848+0000', 'last_undegraded': '2024-09-15T22:51:14.977848+0000', 'last_fullsized': '2024-09-15T22:51:14.977848+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.6 is not active+clean 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.960896+0000', 'last_change': '2024-09-15T22:51:14.960896+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.960896+0000', 'last_undegraded': '2024-09-15T22:51:14.960896+0000', 'last_fullsized': '2024-09-15T22:51:14.960896+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.959909+0000', 'last_change': '2024-09-15T22:51:14.959909+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.959909+0000', 'last_undegraded': '2024-09-15T22:51:14.959909+0000', 'last_fullsized': '2024-09-15T22:51:14.959909+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.1 is not active+clean 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.963279+0000', 'last_change': '2024-09-15T22:51:14.963279+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.963279+0000', 'last_undegraded': '2024-09-15T22:51:14.963279+0000', 'last_fullsized': '2024-09-15T22:51:14.963279+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.2 is not active+clean 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.964683+0000', 'last_change': '2024-09-15T22:51:14.964683+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.964683+0000', 'last_undegraded': '2024-09-15T22:51:14.964683+0000', 'last_fullsized': '2024-09-15T22:51:14.964683+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.3 is not active+clean 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.974438+0000', 'last_change': '2024-09-15T22:51:14.974438+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.974438+0000', 'last_undegraded': '2024-09-15T22:51:14.974438+0000', 'last_fullsized': '2024-09-15T22:51:14.974438+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-15T22:51:20.892 INFO:tasks.ceph.ceph_manager.ceph:PG 6.7 is not active+clean 2024-09-15T22:51:20.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 37, 'state': 'creating+peering', 'last_fresh': '2024-09-15T22:51:14.969071+0000', 'last_change': '2024-09-15T22:51:14.969071+0000', 'last_active': '2024-09-15T22:51:14.943289+0000', 'last_peered': '2024-09-15T22:51:14.943289+0000', 'last_clean': '2024-09-15T22:51:14.943289+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-15T22:51:14.969071+0000', 'last_undegraded': '2024-09-15T22:51:14.969071+0000', 'last_fullsized': '2024-09-15T22:51:14.969071+0000', 'mapping_epoch': 37, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 37, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'last_clean_scrub_stamp': '2024-09-15T22:51:14.943289+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-15T22:51:20.893 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-15T22:51:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 Processor -- start 2024-09-15T22:51:21.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 -- start start 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 0x7f766409bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76640b2e60 0x7f766406d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76640b1dc0 con 0x7f766406d6d0 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f76640b29d0 con 0x7f76640b2e60 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f766ac00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f766406db00 con 0x7f7664161c00 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76640b2e60 0x7f766406d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f76640b2e60 0x7f766406d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54858/0 (socket says 172.21.15.31:54858) 2024-09-15T22:51:21.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 -- 172.21.15.31:0/2596933527 learned_addr learned my addr 172.21.15.31:0/2596933527 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:21.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f7668c00640 1 --1- 172.21.15.31:0/2596933527 >> v1:172.21.15.31:6789/0 conn(0x7f766406d6d0 0x7f766409aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33172/0 (socket says 172.21.15.31:33172) 2024-09-15T22:51:21.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f7663e00640 1 --2- 172.21.15.31:0/2596933527 >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 0x7f766409bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 -- 172.21.15.31:0/2596933527 >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 msgr2=0x7f766409bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:21.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 --2- 172.21.15.31:0/2596933527 >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 0x7f766409bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 -- 172.21.15.31:0/2596933527 >> v1:172.21.15.31:6789/0 conn(0x7f766406d6d0 legacy=0x7f766409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f765b400640 1 -- 172.21.15.31:0/2596933527 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76640b20a0 con 0x7f76640b2e60 2024-09-15T22:51:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f7663400640 1 -- 172.21.15.31:0/2596933527 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741687417 0 0) 0x7f76640b1dc0 con 0x7f766406d6d0 2024-09-15T22:51:21.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.060+0000 7f7663e00640 1 --2- 172.21.15.31:0/2596933527 >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 0x7f766409bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:21.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f765b400640 1 --2- 172.21.15.31:0/2596933527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76640b2e60 0x7f766406d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7664073530 tx=0x7f764c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34ce0032ade1591 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f7663400640 1 -- 172.21.15.31:0/2596933527 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0ab600 con 0x7f76640b2e60 2024-09-15T22:51:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f7663400640 1 -- 172.21.15.31:0/2596933527 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f764c0b0070 con 0x7f76640b2e60 2024-09-15T22:51:21.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f7663400640 1 -- 172.21.15.31:0/2596933527 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f764c0ab9c0 con 0x7f76640b2e60 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- 172.21.15.31:0/2596933527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76640b2e60 msgr2=0x7f766406d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 --2- 172.21.15.31:0/2596933527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76640b2e60 0x7f766406d190 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f7664073530 tx=0x7f764c01c4f0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- 172.21.15.31:0/2596933527 shutdown_connections 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 --2- 172.21.15.31:0/2596933527 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f76640b2e60 0x7f766406d190 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 --2- 172.21.15.31:0/2596933527 >> v2:172.21.15.102:3300/0 conn(0x7f7664161c00 0x7f766409bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- 172.21.15.31:0/2596933527 >> 172.21.15.31:0/2596933527 conn(0x7f76640b3e50 msgr2=0x7f76640b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- 172.21.15.31:0/2596933527 shutdown_connections 2024-09-15T22:51:21.067 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- 172.21.15.31:0/2596933527 wait complete. 2024-09-15T22:51:21.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 Processor -- start 2024-09-15T22:51:21.068 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.064+0000 7f766ac00640 1 -- start start 2024-09-15T22:51:21.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 0x7f766415a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 0x7f7664151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f76640b1b60 con 0x7f7664161c00 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f76640b19e0 con 0x7f766406d6d0 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f766416b350 con 0x7f76640b2e60 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54874/0 (socket says 172.21.15.31:54874) 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 -- 172.21.15.31:0/163768128 learned_addr learned my addr 172.21.15.31:0/163768128 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7663e00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 0x7f766415a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f765b400640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 0x7f7664151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 -- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 msgr2=0x7f7664151fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 0x7f7664151fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 -- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 msgr2=0x7f766415a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 0x7f766415a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 -- 172.21.15.31:0/163768128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7664152500 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f765b400640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 0x7f7664151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7663e00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 0x7f766415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7668c00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c700 tx=0x7f765c00cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c018070 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f765c00ce10 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766415bf40 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765c00a860 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7664159d50 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.068+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76640b1dc0 con 0x7f7664161c00 2024-09-15T22:51:21.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.072+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f765c01b070 con 0x7f7664161c00 2024-09-15T22:51:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.072+0000 7f7660c00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 0x7f7640069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.072+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f765c0853b0 con 0x7f7664161c00 2024-09-15T22:51:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.072+0000 7f7663e00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 0x7f7640069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.072+0000 7f7663e00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 0x7f7640069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7654008890 tx=0x7f7654008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.078 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.076+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f765c055d50 con 0x7f7664161c00 2024-09-15T22:51:21.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.300+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f76641603b0 con 0x7f7664161c00 2024-09-15T22:51:21.304 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.300+0000 7f7660c00640 1 -- 172.21.15.31:0/163768128 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1623 (secure 0 0 0) 0x7f765c055650 con 0x7f7664161c00 2024-09-15T22:51:21.304 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:21.304 INFO:teuthology.orchestra.run.smithi031.stdout:{"fsid":"e1487968-efb4-47ad-8070-6e7082115957","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":88,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":39,"num_osds":8,"num_up_osds":8,"osd_up_since":1726440605,"num_in_osds":8,"osd_in_since":1726440595,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":225976320,"bytes_avail":772868136960,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":17,"btime":"2024-09-15T22:51:18:986929+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4872}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-09-15T22:51:07.567001+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 msgr2=0x7f7640069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 0x7f7640069d80 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7654008890 tx=0x7f7654008040 comp rx=0 tx=0).stop 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 msgr2=0x7f766415b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f765c00c700 tx=0x7f765c00cbc0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 shutdown_connections 2024-09-15T22:51:21.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f76400678c0 0x7f7640069d80 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7664161c00 0x7f766415b360 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f76640b2e60 0x7f7664151fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 --2- 172.21.15.31:0/163768128 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f766406d6d0 0x7f766415a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 >> 172.21.15.31:0/163768128 conn(0x7f76640b3e50 msgr2=0x7f76640706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 shutdown_connections 2024-09-15T22:51:21.307 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.304+0000 7f766ac00640 1 -- 172.21.15.31:0/163768128 wait complete. 2024-09-15T22:51:21.326 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-15T22:51:21.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:51:21.466 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 Processor -- start 2024-09-15T22:51:21.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 -- start start 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 0x7ff308072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7ff30806e160 0x7ff30806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff308072a80 con 0x7ff30813fa40 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7ff30813f640 con 0x7ff30806e160 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff30ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff3081413c0 con 0x7ff308072160 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff2fd400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff30813fa40 0x7ff30813fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:33182/0 (socket says 172.21.15.31:33182) 2024-09-15T22:51:21.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff2fd400640 1 -- 172.21.15.31:0/205096717 learned_addr learned my addr 172.21.15.31:0/205096717 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff305e00640 1 --2- 172.21.15.31:0/205096717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 0x7ff308072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.464+0000 7ff306800640 1 --2- 172.21.15.31:0/205096717 >> v2:172.21.15.102:3300/0 conn(0x7ff30806e160 0x7ff30806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305400640 1 -- 172.21.15.31:0/205096717 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035584448 0 0) 0x7ff308072a80 con 0x7ff30813fa40 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305400640 1 -- 172.21.15.31:0/205096717 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff2ec003530 con 0x7ff30813fa40 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305e00640 1 -- 172.21.15.31:0/205096717 >> v2:172.21.15.102:3300/0 conn(0x7ff30806e160 msgr2=0x7ff30806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:21.469 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305e00640 1 --2- 172.21.15.31:0/205096717 >> v2:172.21.15.102:3300/0 conn(0x7ff30806e160 0x7ff30806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305e00640 1 -- 172.21.15.31:0/205096717 >> v1:172.21.15.31:6789/0 conn(0x7ff30813fa40 legacy=0x7ff30813fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.470 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305e00640 1 -- 172.21.15.31:0/205096717 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3081407b0 con 0x7ff308072160 2024-09-15T22:51:21.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305e00640 1 --2- 172.21.15.31:0/205096717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 0x7ff308072540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097c0 tx=0x7ff2f801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55b48519264ba2bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305400640 1 -- 172.21.15.31:0/205096717 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b0070 con 0x7ff308072160 2024-09-15T22:51:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305400640 1 -- 172.21.15.31:0/205096717 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80ab600 con 0x7ff308072160 2024-09-15T22:51:21.472 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.468+0000 7ff305400640 1 -- 172.21.15.31:0/205096717 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80ab9b0 con 0x7ff308072160 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- 172.21.15.31:0/205096717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 msgr2=0x7ff308072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- 172.21.15.31:0/205096717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 0x7ff308072540 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80097c0 tx=0x7ff2f801c410 comp rx=0 tx=0).stop 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- 172.21.15.31:0/205096717 shutdown_connections 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- 172.21.15.31:0/205096717 >> v2:172.21.15.102:3300/0 conn(0x7ff30806e160 0x7ff30806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- 172.21.15.31:0/205096717 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff308072160 0x7ff308072540 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- 172.21.15.31:0/205096717 >> 172.21.15.31:0/205096717 conn(0x7ff308067e00 msgr2=0x7ff30806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- 172.21.15.31:0/205096717 shutdown_connections 2024-09-15T22:51:21.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- 172.21.15.31:0/205096717 wait complete. 2024-09-15T22:51:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 Processor -- start 2024-09-15T22:51:21.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- start start 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff308072160 0x7ff30813e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff30813fa40 0x7ff308154bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff308168ee0 con 0x7ff30806e160 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff308168d60 con 0x7ff308072160 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff30ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff308169060 con 0x7ff30813fa40 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:54880/0 (socket says 172.21.15.31:54880) 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 -- 172.21.15.31:0/3993576911 learned_addr learned my addr 172.21.15.31:0/3993576911 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff2fd400640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff308072160 0x7ff30813e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff306800640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff30813fa40 0x7ff308154bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 -- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff30813fa40 msgr2=0x7ff308154bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff30813fa40 0x7ff308154bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 -- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff308072160 msgr2=0x7ff30813e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff308072160 0x7ff30813e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 -- 172.21.15.31:0/3993576911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff308138e30 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.472+0000 7ff305e00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80ae040 tx=0x7ff2f80191b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b9020 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2f80ab9b0 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f80b0040 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081390d0 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff308139690 con 0x7ff30806e160 2024-09-15T22:51:21.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30806e610 con 0x7ff30806e160 2024-09-15T22:51:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff2f80bc020 con 0x7ff30806e160 2024-09-15T22:51:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 0x7ff2e4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:21.479 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7ff2f811fdd0 con 0x7ff30806e160 2024-09-15T22:51:21.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.476+0000 7ff2fd400640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 0x7ff2e4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:21.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.480+0000 7ff2fd400640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 0x7ff2e4069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff30806c2f0 tx=0x7ff2f0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:21.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.480+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff2f80c3030 con 0x7ff30806e160 2024-09-15T22:51:21.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.644+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff30806c040 con 0x7ff2e40678c0 2024-09-15T22:51:21.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff2fea00640 1 -- 172.21.15.31:0/3993576911 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7ff30806c040 con 0x7ff2e40678c0 2024-09-15T22:51:21.655 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:21.657 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 msgr2=0x7ff2e4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 0x7ff2e4069d80 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff30806c2f0 tx=0x7ff2f0009040 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 msgr2=0x7ff3080a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80ae040 tx=0x7ff2f80191b0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 shutdown_connections 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff2e40678c0 0x7ff2e4069d80 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff30813fa40 0x7ff308154bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff308072160 0x7ff30813e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 --2- 172.21.15.31:0/3993576911 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff30806e160 0x7ff3080a94a0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:21.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 >> 172.21.15.31:0/3993576911 conn(0x7ff308067e00 msgr2=0x7ff308159300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.652+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 shutdown_connections 2024-09-15T22:51:21.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:21.656+0000 7ff30ce00640 1 -- 172.21.15.31:0/3993576911 wait complete. 2024-09-15T22:51:21.675 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2024-09-15T22:51:21.569783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220952,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753768,"statfs":{"total":773094113280,"available":772867858432,"internally_reserved":0,"allocated":4825088,"data_stored":2734924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.612415"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084834+0000","last_change":"2024-09-15T22:51:15.992182+0000","last_active":"2024-09-15T22:51:17.084834+0000","last_peered":"2024-09-15T22:51:17.084834+0000","last_clean":"2024-09-15T22:51:17.084834+0000","last_became_active":"2024-09-15T22:51:15.991879+0000","last_became_peered":"2024-09-15T22:51:15.991879+0000","last_unstale":"2024-09-15T22:51:17.084834+0000","last_undegraded":"2024-09-15T22:51:17.084834+0000","last_fullsized":"2024-09-15T22:51:17.084834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:07.942771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084519+0000","last_change":"2024-09-15T22:51:15.968684+0000","last_active":"2024-09-15T22:51:17.084519+0000","last_peered":"2024-09-15T22:51:17.084519+0000","last_clean":"2024-09-15T22:51:17.084519+0000","last_became_active":"2024-09-15T22:51:15.968423+0000","last_became_peered":"2024-09-15T22:51:15.968423+0000","last_unstale":"2024-09-15T22:51:17.084519+0000","last_undegraded":"2024-09-15T22:51:17.084519+0000","last_fullsized":"2024-09-15T22:51:17.084519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:02.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006190+0000","last_change":"2024-09-15T22:51:15.991509+0000","last_active":"2024-09-15T22:51:17.006190+0000","last_peered":"2024-09-15T22:51:17.006190+0000","last_clean":"2024-09-15T22:51:17.006190+0000","last_became_active":"2024-09-15T22:51:15.991200+0000","last_became_peered":"2024-09-15T22:51:15.991200+0000","last_unstale":"2024-09-15T22:51:17.006190+0000","last_undegraded":"2024-09-15T22:51:17.006190+0000","last_fullsized":"2024-09-15T22:51:17.006190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958748+0000","last_change":"2024-09-15T22:51:15.963947+0000","last_active":"2024-09-15T22:51:16.958748+0000","last_peered":"2024-09-15T22:51:16.958748+0000","last_clean":"2024-09-15T22:51:16.958748+0000","last_became_active":"2024-09-15T22:51:15.963664+0000","last_became_peered":"2024-09-15T22:51:15.963664+0000","last_unstale":"2024-09-15T22:51:16.958748+0000","last_undegraded":"2024-09-15T22:51:16.958748+0000","last_fullsized":"2024-09-15T22:51:16.958748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:40.788325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958559+0000","last_change":"2024-09-15T22:51:15.965348+0000","last_active":"2024-09-15T22:51:16.958559+0000","last_peered":"2024-09-15T22:51:16.958559+0000","last_clean":"2024-09-15T22:51:16.958559+0000","last_became_active":"2024-09-15T22:51:15.964577+0000","last_became_peered":"2024-09-15T22:51:15.964577+0000","last_unstale":"2024-09-15T22:51:16.958559+0000","last_undegraded":"2024-09-15T22:51:16.958559+0000","last_fullsized":"2024-09-15T22:51:16.958559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:21.338007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271501+0000","last_change":"2024-09-15T22:51:15.977007+0000","last_active":"2024-09-15T22:51:17.271501+0000","last_peered":"2024-09-15T22:51:17.271501+0000","last_clean":"2024-09-15T22:51:17.271501+0000","last_became_active":"2024-09-15T22:51:15.976571+0000","last_became_peered":"2024-09-15T22:51:15.976571+0000","last_unstale":"2024-09-15T22:51:17.271501+0000","last_undegraded":"2024-09-15T22:51:17.271501+0000","last_fullsized":"2024-09-15T22:51:17.271501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960130+0000","last_change":"2024-09-15T22:51:15.969743+0000","last_active":"2024-09-15T22:51:16.960130+0000","last_peered":"2024-09-15T22:51:16.960130+0000","last_clean":"2024-09-15T22:51:16.960130+0000","last_became_active":"2024-09-15T22:51:15.969472+0000","last_became_peered":"2024-09-15T22:51:15.969472+0000","last_unstale":"2024-09-15T22:51:16.960130+0000","last_undegraded":"2024-09-15T22:51:16.960130+0000","last_fullsized":"2024-09-15T22:51:16.960130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:54.330237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084447+0000","last_change":"2024-09-15T22:51:15.977566+0000","last_active":"2024-09-15T22:51:17.084447+0000","last_peered":"2024-09-15T22:51:17.084447+0000","last_clean":"2024-09-15T22:51:17.084447+0000","last_became_active":"2024-09-15T22:51:15.977270+0000","last_became_peered":"2024-09-15T22:51:15.977270+0000","last_unstale":"2024-09-15T22:51:17.084447+0000","last_undegraded":"2024-09-15T22:51:17.084447+0000","last_fullsized":"2024-09-15T22:51:17.084447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:48.792581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006446+0000","last_change":"2024-09-15T22:51:15.995960+0000","last_active":"2024-09-15T22:51:17.006446+0000","last_peered":"2024-09-15T22:51:17.006446+0000","last_clean":"2024-09-15T22:51:17.006446+0000","last_became_active":"2024-09-15T22:51:15.991488+0000","last_became_peered":"2024-09-15T22:51:15.991488+0000","last_unstale":"2024-09-15T22:51:17.006446+0000","last_undegraded":"2024-09-15T22:51:17.006446+0000","last_fullsized":"2024-09-15T22:51:17.006446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:08.531903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960450+0000","last_change":"2024-09-15T22:51:15.976097+0000","last_active":"2024-09-15T22:51:16.960450+0000","last_peered":"2024-09-15T22:51:16.960450+0000","last_clean":"2024-09-15T22:51:16.960450+0000","last_became_active":"2024-09-15T22:51:15.975783+0000","last_became_peered":"2024-09-15T22:51:15.975783+0000","last_unstale":"2024-09-15T22:51:16.960450+0000","last_undegraded":"2024-09-15T22:51:16.960450+0000","last_fullsized":"2024-09-15T22:51:16.960450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.661681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960459+0000","last_change":"2024-09-15T22:51:15.967103+0000","last_active":"2024-09-15T22:51:16.960459+0000","last_peered":"2024-09-15T22:51:16.960459+0000","last_clean":"2024-09-15T22:51:16.960459+0000","last_became_active":"2024-09-15T22:51:15.966774+0000","last_became_peered":"2024-09-15T22:51:15.966774+0000","last_unstale":"2024-09-15T22:51:16.960459+0000","last_undegraded":"2024-09-15T22:51:16.960459+0000","last_fullsized":"2024-09-15T22:51:16.960459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:33.866771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006246+0000","last_change":"2024-09-15T22:51:15.996985+0000","last_active":"2024-09-15T22:51:17.006246+0000","last_peered":"2024-09-15T22:51:17.006246+0000","last_clean":"2024-09-15T22:51:17.006246+0000","last_became_active":"2024-09-15T22:51:15.996695+0000","last_became_peered":"2024-09-15T22:51:15.996695+0000","last_unstale":"2024-09-15T22:51:17.006246+0000","last_undegraded":"2024-09-15T22:51:17.006246+0000","last_fullsized":"2024-09-15T22:51:17.006246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960292+0000","last_change":"2024-09-15T22:51:15.977665+0000","last_active":"2024-09-15T22:51:16.960292+0000","last_peered":"2024-09-15T22:51:16.960292+0000","last_clean":"2024-09-15T22:51:16.960292+0000","last_became_active":"2024-09-15T22:51:15.977315+0000","last_became_peered":"2024-09-15T22:51:15.977315+0000","last_unstale":"2024-09-15T22:51:16.960292+0000","last_undegraded":"2024-09-15T22:51:16.960292+0000","last_fullsized":"2024-09-15T22:51:16.960292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:46.264001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272336+0000","last_change":"2024-09-15T22:51:15.971218+0000","last_active":"2024-09-15T22:51:17.272336+0000","last_peered":"2024-09-15T22:51:17.272336+0000","last_clean":"2024-09-15T22:51:17.272336+0000","last_became_active":"2024-09-15T22:51:15.970973+0000","last_became_peered":"2024-09-15T22:51:15.970973+0000","last_unstale":"2024-09-15T22:51:17.272336+0000","last_undegraded":"2024-09-15T22:51:17.272336+0000","last_fullsized":"2024-09-15T22:51:17.272336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:43.208399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960371+0000","last_change":"2024-09-15T22:51:15.969015+0000","last_active":"2024-09-15T22:51:16.960371+0000","last_peered":"2024-09-15T22:51:16.960371+0000","last_clean":"2024-09-15T22:51:16.960371+0000","last_became_active":"2024-09-15T22:51:15.967009+0000","last_became_peered":"2024-09-15T22:51:15.967009+0000","last_unstale":"2024-09-15T22:51:16.960371+0000","last_undegraded":"2024-09-15T22:51:16.960371+0000","last_fullsized":"2024-09-15T22:51:16.960371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.992432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272331+0000","last_change":"2024-09-15T22:51:15.984579+0000","last_active":"2024-09-15T22:51:17.272331+0000","last_peered":"2024-09-15T22:51:17.272331+0000","last_clean":"2024-09-15T22:51:17.272331+0000","last_became_active":"2024-09-15T22:51:15.982978+0000","last_became_peered":"2024-09-15T22:51:15.982978+0000","last_unstale":"2024-09-15T22:51:17.272331+0000","last_undegraded":"2024-09-15T22:51:17.272331+0000","last_fullsized":"2024-09-15T22:51:17.272331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273226+0000","last_change":"2024-09-15T22:51:15.983371+0000","last_active":"2024-09-15T22:51:17.273226+0000","last_peered":"2024-09-15T22:51:17.273226+0000","last_clean":"2024-09-15T22:51:17.273226+0000","last_became_active":"2024-09-15T22:51:15.983072+0000","last_became_peered":"2024-09-15T22:51:15.983072+0000","last_unstale":"2024-09-15T22:51:17.273226+0000","last_undegraded":"2024-09-15T22:51:17.273226+0000","last_fullsized":"2024-09-15T22:51:17.273226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:48.792581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961367+0000","last_change":"2024-09-15T22:51:15.980693+0000","last_active":"2024-09-15T22:51:16.961367+0000","last_peered":"2024-09-15T22:51:16.961367+0000","last_clean":"2024-09-15T22:51:16.961367+0000","last_became_active":"2024-09-15T22:51:15.979299+0000","last_became_peered":"2024-09-15T22:51:15.979299+0000","last_unstale":"2024-09-15T22:51:16.961367+0000","last_undegraded":"2024-09-15T22:51:16.961367+0000","last_fullsized":"2024-09-15T22:51:16.961367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:40.184879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958987+0000","last_change":"2024-09-15T22:51:15.969922+0000","last_active":"2024-09-15T22:51:16.958987+0000","last_peered":"2024-09-15T22:51:16.958987+0000","last_clean":"2024-09-15T22:51:16.958987+0000","last_became_active":"2024-09-15T22:51:15.969658+0000","last_became_peered":"2024-09-15T22:51:15.969658+0000","last_unstale":"2024-09-15T22:51:16.958987+0000","last_undegraded":"2024-09-15T22:51:16.958987+0000","last_fullsized":"2024-09-15T22:51:16.958987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:43.770898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960928+0000","last_change":"2024-09-15T22:51:15.979414+0000","last_active":"2024-09-15T22:51:16.960928+0000","last_peered":"2024-09-15T22:51:16.960928+0000","last_clean":"2024-09-15T22:51:16.960928+0000","last_became_active":"2024-09-15T22:51:15.979092+0000","last_became_peered":"2024-09-15T22:51:15.979092+0000","last_unstale":"2024-09-15T22:51:16.960928+0000","last_undegraded":"2024-09-15T22:51:16.960928+0000","last_fullsized":"2024-09-15T22:51:16.960928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:43.153927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960650+0000","last_change":"2024-09-15T22:51:15.976178+0000","last_active":"2024-09-15T22:51:16.960650+0000","last_peered":"2024-09-15T22:51:16.960650+0000","last_clean":"2024-09-15T22:51:16.960650+0000","last_became_active":"2024-09-15T22:51:15.975881+0000","last_became_peered":"2024-09-15T22:51:15.975881+0000","last_unstale":"2024-09-15T22:51:16.960650+0000","last_undegraded":"2024-09-15T22:51:16.960650+0000","last_fullsized":"2024-09-15T22:51:16.960650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:24.943813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272440+0000","last_change":"2024-09-15T22:51:15.969563+0000","last_active":"2024-09-15T22:51:17.272440+0000","last_peered":"2024-09-15T22:51:17.272440+0000","last_clean":"2024-09-15T22:51:17.272440+0000","last_became_active":"2024-09-15T22:51:15.969191+0000","last_became_peered":"2024-09-15T22:51:15.969191+0000","last_unstale":"2024-09-15T22:51:17.272440+0000","last_undegraded":"2024-09-15T22:51:17.272440+0000","last_fullsized":"2024-09-15T22:51:17.272440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:40.184879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272803+0000","last_change":"2024-09-15T22:51:15.981065+0000","last_active":"2024-09-15T22:51:17.272803+0000","last_peered":"2024-09-15T22:51:17.272803+0000","last_clean":"2024-09-15T22:51:17.272803+0000","last_became_active":"2024-09-15T22:51:15.980784+0000","last_became_peered":"2024-09-15T22:51:15.980784+0000","last_unstale":"2024-09-15T22:51:17.272803+0000","last_undegraded":"2024-09-15T22:51:17.272803+0000","last_fullsized":"2024-09-15T22:51:17.272803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:49.231179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958592+0000","last_change":"2024-09-15T22:51:15.979333+0000","last_active":"2024-09-15T22:51:16.958592+0000","last_peered":"2024-09-15T22:51:16.958592+0000","last_clean":"2024-09-15T22:51:16.958592+0000","last_became_active":"2024-09-15T22:51:15.979014+0000","last_became_peered":"2024-09-15T22:51:15.979014+0000","last_unstale":"2024-09-15T22:51:16.958592+0000","last_undegraded":"2024-09-15T22:51:16.958592+0000","last_fullsized":"2024-09-15T22:51:16.958592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:10.676037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961419+0000","last_change":"2024-09-15T22:51:15.992590+0000","last_active":"2024-09-15T22:51:16.961419+0000","last_peered":"2024-09-15T22:51:16.961419+0000","last_clean":"2024-09-15T22:51:16.961419+0000","last_became_active":"2024-09-15T22:51:15.992281+0000","last_became_peered":"2024-09-15T22:51:15.992281+0000","last_unstale":"2024-09-15T22:51:16.961419+0000","last_undegraded":"2024-09-15T22:51:16.961419+0000","last_fullsized":"2024-09-15T22:51:16.961419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271606+0000","last_change":"2024-09-15T22:51:15.981066+0000","last_active":"2024-09-15T22:51:17.271606+0000","last_peered":"2024-09-15T22:51:17.271606+0000","last_clean":"2024-09-15T22:51:17.271606+0000","last_became_active":"2024-09-15T22:51:15.980786+0000","last_became_peered":"2024-09-15T22:51:15.980786+0000","last_unstale":"2024-09-15T22:51:17.271606+0000","last_undegraded":"2024-09-15T22:51:17.271606+0000","last_fullsized":"2024-09-15T22:51:17.271606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961285+0000","last_change":"2024-09-15T22:51:15.982585+0000","last_active":"2024-09-15T22:51:16.961285+0000","last_peered":"2024-09-15T22:51:16.961285+0000","last_clean":"2024-09-15T22:51:16.961285+0000","last_became_active":"2024-09-15T22:51:15.982343+0000","last_became_peered":"2024-09-15T22:51:15.982343+0000","last_unstale":"2024-09-15T22:51:16.961285+0000","last_undegraded":"2024-09-15T22:51:16.961285+0000","last_fullsized":"2024-09-15T22:51:16.961285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:43.208399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960371+0000","last_change":"2024-09-15T22:51:15.977890+0000","last_active":"2024-09-15T22:51:16.960371+0000","last_peered":"2024-09-15T22:51:16.960371+0000","last_clean":"2024-09-15T22:51:16.960371+0000","last_became_active":"2024-09-15T22:51:15.977579+0000","last_became_peered":"2024-09-15T22:51:15.977579+0000","last_unstale":"2024-09-15T22:51:16.960371+0000","last_undegraded":"2024-09-15T22:51:16.960371+0000","last_fullsized":"2024-09-15T22:51:16.960371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:57.254015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961006+0000","last_change":"2024-09-15T22:51:15.974901+0000","last_active":"2024-09-15T22:51:16.961006+0000","last_peered":"2024-09-15T22:51:16.961006+0000","last_clean":"2024-09-15T22:51:16.961006+0000","last_became_active":"2024-09-15T22:51:15.974591+0000","last_became_peered":"2024-09-15T22:51:15.974591+0000","last_unstale":"2024-09-15T22:51:16.961006+0000","last_undegraded":"2024-09-15T22:51:16.961006+0000","last_fullsized":"2024-09-15T22:51:16.961006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:32.579236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960696+0000","last_change":"2024-09-15T22:51:15.980095+0000","last_active":"2024-09-15T22:51:16.960696+0000","last_peered":"2024-09-15T22:51:16.960696+0000","last_clean":"2024-09-15T22:51:16.960696+0000","last_became_active":"2024-09-15T22:51:15.979844+0000","last_became_peered":"2024-09-15T22:51:15.979844+0000","last_unstale":"2024-09-15T22:51:16.960696+0000","last_undegraded":"2024-09-15T22:51:16.960696+0000","last_fullsized":"2024-09-15T22:51:16.960696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:18.521487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272800+0000","last_change":"2024-09-15T22:51:15.995188+0000","last_active":"2024-09-15T22:51:17.272800+0000","last_peered":"2024-09-15T22:51:17.272800+0000","last_clean":"2024-09-15T22:51:17.272800+0000","last_became_active":"2024-09-15T22:51:15.994806+0000","last_became_peered":"2024-09-15T22:51:15.994806+0000","last_unstale":"2024-09-15T22:51:17.272800+0000","last_undegraded":"2024-09-15T22:51:17.272800+0000","last_fullsized":"2024-09-15T22:51:17.272800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:08.531903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271472+0000","last_change":"2024-09-15T22:51:15.980214+0000","last_active":"2024-09-15T22:51:17.271472+0000","last_peered":"2024-09-15T22:51:17.271472+0000","last_clean":"2024-09-15T22:51:17.271472+0000","last_became_active":"2024-09-15T22:51:15.979948+0000","last_became_peered":"2024-09-15T22:51:15.979948+0000","last_unstale":"2024-09-15T22:51:17.271472+0000","last_undegraded":"2024-09-15T22:51:17.271472+0000","last_fullsized":"2024-09-15T22:51:17.271472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273118+0000","last_change":"2024-09-15T22:51:15.983420+0000","last_active":"2024-09-15T22:51:17.273118+0000","last_peered":"2024-09-15T22:51:17.273118+0000","last_clean":"2024-09-15T22:51:17.273118+0000","last_became_active":"2024-09-15T22:51:15.983125+0000","last_became_peered":"2024-09-15T22:51:15.983125+0000","last_unstale":"2024-09-15T22:51:17.273118+0000","last_undegraded":"2024-09-15T22:51:17.273118+0000","last_fullsized":"2024-09-15T22:51:17.273118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:59.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961390+0000","last_change":"2024-09-15T22:51:14.976712+0000","last_active":"2024-09-15T22:51:16.961390+0000","last_peered":"2024-09-15T22:51:16.961390+0000","last_clean":"2024-09-15T22:51:16.961390+0000","last_became_active":"2024-09-15T22:51:14.976384+0000","last_became_peered":"2024-09-15T22:51:14.976384+0000","last_unstale":"2024-09-15T22:51:16.961390+0000","last_undegraded":"2024-09-15T22:51:16.961390+0000","last_fullsized":"2024-09-15T22:51:16.961390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271728+0000","last_change":"2024-09-15T22:51:15.981524+0000","last_active":"2024-09-15T22:51:17.271728+0000","last_peered":"2024-09-15T22:51:17.271728+0000","last_clean":"2024-09-15T22:51:17.271728+0000","last_became_active":"2024-09-15T22:51:15.981277+0000","last_became_peered":"2024-09-15T22:51:15.981277+0000","last_unstale":"2024-09-15T22:51:17.271728+0000","last_undegraded":"2024-09-15T22:51:17.271728+0000","last_fullsized":"2024-09-15T22:51:17.271728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006223+0000","last_change":"2024-09-15T22:51:14.981079+0000","last_active":"2024-09-15T22:51:17.006223+0000","last_peered":"2024-09-15T22:51:17.006223+0000","last_clean":"2024-09-15T22:51:17.006223+0000","last_became_active":"2024-09-15T22:51:14.980582+0000","last_became_peered":"2024-09-15T22:51:14.980582+0000","last_unstale":"2024-09-15T22:51:17.006223+0000","last_undegraded":"2024-09-15T22:51:17.006223+0000","last_fullsized":"2024-09-15T22:51:17.006223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273078+0000","last_change":"2024-09-15T22:51:15.969552+0000","last_active":"2024-09-15T22:51:17.273078+0000","last_peered":"2024-09-15T22:51:17.273078+0000","last_clean":"2024-09-15T22:51:17.273078+0000","last_became_active":"2024-09-15T22:51:15.969271+0000","last_became_peered":"2024-09-15T22:51:15.969271+0000","last_unstale":"2024-09-15T22:51:17.273078+0000","last_undegraded":"2024-09-15T22:51:17.273078+0000","last_fullsized":"2024-09-15T22:51:17.273078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271767+0000","last_change":"2024-09-15T22:51:14.978636+0000","last_active":"2024-09-15T22:51:17.271767+0000","last_peered":"2024-09-15T22:51:17.271767+0000","last_clean":"2024-09-15T22:51:17.271767+0000","last_became_active":"2024-09-15T22:51:14.978265+0000","last_became_peered":"2024-09-15T22:51:14.978265+0000","last_unstale":"2024-09-15T22:51:17.271767+0000","last_undegraded":"2024-09-15T22:51:17.271767+0000","last_fullsized":"2024-09-15T22:51:17.271767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084823+0000","last_change":"2024-09-15T22:51:15.970465+0000","last_active":"2024-09-15T22:51:17.084823+0000","last_peered":"2024-09-15T22:51:17.084823+0000","last_clean":"2024-09-15T22:51:17.084823+0000","last_became_active":"2024-09-15T22:51:15.970193+0000","last_became_peered":"2024-09-15T22:51:15.970193+0000","last_unstale":"2024-09-15T22:51:17.084823+0000","last_undegraded":"2024-09-15T22:51:17.084823+0000","last_fullsized":"2024-09-15T22:51:17.084823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:41.016389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272700+0000","last_change":"2024-09-15T22:51:14.974047+0000","last_active":"2024-09-15T22:51:17.272700+0000","last_peered":"2024-09-15T22:51:17.272700+0000","last_clean":"2024-09-15T22:51:17.272700+0000","last_became_active":"2024-09-15T22:51:14.973769+0000","last_became_peered":"2024-09-15T22:51:14.973769+0000","last_unstale":"2024-09-15T22:51:17.272700+0000","last_undegraded":"2024-09-15T22:51:17.272700+0000","last_fullsized":"2024-09-15T22:51:17.272700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005818+0000","last_change":"2024-09-15T22:51:15.986684+0000","last_active":"2024-09-15T22:51:17.005818+0000","last_peered":"2024-09-15T22:51:17.005818+0000","last_clean":"2024-09-15T22:51:17.005818+0000","last_became_active":"2024-09-15T22:51:15.984872+0000","last_became_peered":"2024-09-15T22:51:15.984872+0000","last_unstale":"2024-09-15T22:51:17.005818+0000","last_undegraded":"2024-09-15T22:51:17.005818+0000","last_fullsized":"2024-09-15T22:51:17.005818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961106+0000","last_change":"2024-09-15T22:51:14.974086+0000","last_active":"2024-09-15T22:51:16.961106+0000","last_peered":"2024-09-15T22:51:16.961106+0000","last_clean":"2024-09-15T22:51:16.961106+0000","last_became_active":"2024-09-15T22:51:14.973787+0000","last_became_peered":"2024-09-15T22:51:14.973787+0000","last_unstale":"2024-09-15T22:51:16.961106+0000","last_undegraded":"2024-09-15T22:51:16.961106+0000","last_fullsized":"2024-09-15T22:51:16.961106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:46.921646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960825+0000","last_change":"2024-09-15T22:51:15.975182+0000","last_active":"2024-09-15T22:51:16.960825+0000","last_peered":"2024-09-15T22:51:16.960825+0000","last_clean":"2024-09-15T22:51:16.960825+0000","last_became_active":"2024-09-15T22:51:15.973693+0000","last_became_peered":"2024-09-15T22:51:15.973693+0000","last_unstale":"2024-09-15T22:51:16.960825+0000","last_undegraded":"2024-09-15T22:51:16.960825+0000","last_fullsized":"2024-09-15T22:51:16.960825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:30.467553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272892+0000","last_change":"2024-09-15T22:51:14.986951+0000","last_active":"2024-09-15T22:51:17.272892+0000","last_peered":"2024-09-15T22:51:17.272892+0000","last_clean":"2024-09-15T22:51:17.272892+0000","last_became_active":"2024-09-15T22:51:14.986518+0000","last_became_peered":"2024-09-15T22:51:14.986518+0000","last_unstale":"2024-09-15T22:51:17.272892+0000","last_undegraded":"2024-09-15T22:51:17.272892+0000","last_fullsized":"2024-09-15T22:51:17.272892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.491357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272608+0000","last_change":"2024-09-15T22:51:15.965032+0000","last_active":"2024-09-15T22:51:17.272608+0000","last_peered":"2024-09-15T22:51:17.272608+0000","last_clean":"2024-09-15T22:51:17.272608+0000","last_became_active":"2024-09-15T22:51:15.964779+0000","last_became_peered":"2024-09-15T22:51:15.964779+0000","last_unstale":"2024-09-15T22:51:17.272608+0000","last_undegraded":"2024-09-15T22:51:17.272608+0000","last_fullsized":"2024-09-15T22:51:17.272608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271408+0000","last_change":"2024-09-15T22:51:14.973894+0000","last_active":"2024-09-15T22:51:17.271408+0000","last_peered":"2024-09-15T22:51:17.271408+0000","last_clean":"2024-09-15T22:51:17.271408+0000","last_became_active":"2024-09-15T22:51:14.973577+0000","last_became_peered":"2024-09-15T22:51:14.973577+0000","last_unstale":"2024-09-15T22:51:17.271408+0000","last_undegraded":"2024-09-15T22:51:17.271408+0000","last_fullsized":"2024-09-15T22:51:17.271408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084555+0000","last_change":"2024-09-15T22:51:15.985380+0000","last_active":"2024-09-15T22:51:17.084555+0000","last_peered":"2024-09-15T22:51:17.084555+0000","last_clean":"2024-09-15T22:51:17.084555+0000","last_became_active":"2024-09-15T22:51:15.978918+0000","last_became_peered":"2024-09-15T22:51:15.978918+0000","last_unstale":"2024-09-15T22:51:17.084555+0000","last_undegraded":"2024-09-15T22:51:17.084555+0000","last_fullsized":"2024-09-15T22:51:17.084555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:06.975780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272181+0000","last_change":"2024-09-15T22:51:14.972066+0000","last_active":"2024-09-15T22:51:17.272181+0000","last_peered":"2024-09-15T22:51:17.272181+0000","last_clean":"2024-09-15T22:51:17.272181+0000","last_became_active":"2024-09-15T22:51:14.971640+0000","last_became_peered":"2024-09-15T22:51:14.971640+0000","last_unstale":"2024-09-15T22:51:17.272181+0000","last_undegraded":"2024-09-15T22:51:17.272181+0000","last_fullsized":"2024-09-15T22:51:17.272181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958782+0000","last_change":"2024-09-15T22:51:15.965032+0000","last_active":"2024-09-15T22:51:16.958782+0000","last_peered":"2024-09-15T22:51:16.958782+0000","last_clean":"2024-09-15T22:51:16.958782+0000","last_became_active":"2024-09-15T22:51:15.964336+0000","last_became_peered":"2024-09-15T22:51:15.964336+0000","last_unstale":"2024-09-15T22:51:16.958782+0000","last_undegraded":"2024-09-15T22:51:16.958782+0000","last_fullsized":"2024-09-15T22:51:16.958782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:52.656628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084878+0000","last_change":"2024-09-15T22:51:14.972265+0000","last_active":"2024-09-15T22:51:17.084878+0000","last_peered":"2024-09-15T22:51:17.084878+0000","last_clean":"2024-09-15T22:51:17.084878+0000","last_became_active":"2024-09-15T22:51:14.971919+0000","last_became_peered":"2024-09-15T22:51:14.971919+0000","last_unstale":"2024-09-15T22:51:17.084878+0000","last_undegraded":"2024-09-15T22:51:17.084878+0000","last_fullsized":"2024-09-15T22:51:17.084878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:42.145788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273429+0000","last_change":"2024-09-15T22:51:15.984922+0000","last_active":"2024-09-15T22:51:17.273429+0000","last_peered":"2024-09-15T22:51:17.273429+0000","last_clean":"2024-09-15T22:51:17.273429+0000","last_became_active":"2024-09-15T22:51:15.984641+0000","last_became_peered":"2024-09-15T22:51:15.984641+0000","last_unstale":"2024-09-15T22:51:17.273429+0000","last_undegraded":"2024-09-15T22:51:17.273429+0000","last_fullsized":"2024-09-15T22:51:17.273429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:02.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960902+0000","last_change":"2024-09-15T22:51:14.979937+0000","last_active":"2024-09-15T22:51:16.960902+0000","last_peered":"2024-09-15T22:51:16.960902+0000","last_clean":"2024-09-15T22:51:16.960902+0000","last_became_active":"2024-09-15T22:51:14.979599+0000","last_became_peered":"2024-09-15T22:51:14.979599+0000","last_unstale":"2024-09-15T22:51:16.960902+0000","last_undegraded":"2024-09-15T22:51:16.960902+0000","last_fullsized":"2024-09-15T22:51:16.960902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:31.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006271+0000","last_change":"2024-09-15T22:51:15.993029+0000","last_active":"2024-09-15T22:51:17.006271+0000","last_peered":"2024-09-15T22:51:17.006271+0000","last_clean":"2024-09-15T22:51:17.006271+0000","last_became_active":"2024-09-15T22:51:15.992759+0000","last_became_peered":"2024-09-15T22:51:15.992759+0000","last_unstale":"2024-09-15T22:51:17.006271+0000","last_undegraded":"2024-09-15T22:51:17.006271+0000","last_fullsized":"2024-09-15T22:51:17.006271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:49.231179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961407+0000","last_change":"2024-09-15T22:51:14.980163+0000","last_active":"2024-09-15T22:51:16.961407+0000","last_peered":"2024-09-15T22:51:16.961407+0000","last_clean":"2024-09-15T22:51:16.961407+0000","last_became_active":"2024-09-15T22:51:14.979726+0000","last_became_peered":"2024-09-15T22:51:14.979726+0000","last_unstale":"2024-09-15T22:51:16.961407+0000","last_undegraded":"2024-09-15T22:51:16.961407+0000","last_fullsized":"2024-09-15T22:51:16.961407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:56.714868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273129+0000","last_change":"2024-09-15T22:51:15.970080+0000","last_active":"2024-09-15T22:51:17.273129+0000","last_peered":"2024-09-15T22:51:17.273129+0000","last_clean":"2024-09-15T22:51:17.273129+0000","last_became_active":"2024-09-15T22:51:15.969805+0000","last_became_peered":"2024-09-15T22:51:15.969805+0000","last_unstale":"2024-09-15T22:51:17.273129+0000","last_undegraded":"2024-09-15T22:51:17.273129+0000","last_fullsized":"2024-09-15T22:51:17.273129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084506+0000","last_change":"2024-09-15T22:51:14.980076+0000","last_active":"2024-09-15T22:51:17.084506+0000","last_peered":"2024-09-15T22:51:17.084506+0000","last_clean":"2024-09-15T22:51:17.084506+0000","last_became_active":"2024-09-15T22:51:14.979781+0000","last_became_peered":"2024-09-15T22:51:14.979781+0000","last_unstale":"2024-09-15T22:51:17.084506+0000","last_undegraded":"2024-09-15T22:51:17.084506+0000","last_fullsized":"2024-09-15T22:51:17.084506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:39.176740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005874+0000","last_change":"2024-09-15T22:51:15.985513+0000","last_active":"2024-09-15T22:51:17.005874+0000","last_peered":"2024-09-15T22:51:17.005874+0000","last_clean":"2024-09-15T22:51:17.005874+0000","last_became_active":"2024-09-15T22:51:15.984875+0000","last_became_peered":"2024-09-15T22:51:15.984875+0000","last_unstale":"2024-09-15T22:51:17.005874+0000","last_undegraded":"2024-09-15T22:51:17.005874+0000","last_fullsized":"2024-09-15T22:51:17.005874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084665+0000","last_change":"2024-09-15T22:51:14.971500+0000","last_active":"2024-09-15T22:51:17.084665+0000","last_peered":"2024-09-15T22:51:17.084665+0000","last_clean":"2024-09-15T22:51:17.084665+0000","last_became_active":"2024-09-15T22:51:14.971212+0000","last_became_peered":"2024-09-15T22:51:14.971212+0000","last_unstale":"2024-09-15T22:51:17.084665+0000","last_undegraded":"2024-09-15T22:51:17.084665+0000","last_fullsized":"2024-09-15T22:51:17.084665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:42.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084623+0000","last_change":"2024-09-15T22:51:15.992196+0000","last_active":"2024-09-15T22:51:17.084623+0000","last_peered":"2024-09-15T22:51:17.084623+0000","last_clean":"2024-09-15T22:51:17.084623+0000","last_became_active":"2024-09-15T22:51:15.991924+0000","last_became_peered":"2024-09-15T22:51:15.991924+0000","last_unstale":"2024-09-15T22:51:17.084623+0000","last_undegraded":"2024-09-15T22:51:17.084623+0000","last_fullsized":"2024-09-15T22:51:17.084623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:45.283641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271331+0000","last_change":"2024-09-15T22:51:14.974430+0000","last_active":"2024-09-15T22:51:17.271331+0000","last_peered":"2024-09-15T22:51:17.271331+0000","last_clean":"2024-09-15T22:51:17.271331+0000","last_became_active":"2024-09-15T22:51:14.974129+0000","last_became_peered":"2024-09-15T22:51:14.974129+0000","last_unstale":"2024-09-15T22:51:17.271331+0000","last_undegraded":"2024-09-15T22:51:17.271331+0000","last_fullsized":"2024-09-15T22:51:17.271331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272830+0000","last_change":"2024-09-15T22:51:15.995127+0000","last_active":"2024-09-15T22:51:17.272830+0000","last_peered":"2024-09-15T22:51:17.272830+0000","last_clean":"2024-09-15T22:51:17.272830+0000","last_became_active":"2024-09-15T22:51:15.994855+0000","last_became_peered":"2024-09-15T22:51:15.994855+0000","last_unstale":"2024-09-15T22:51:17.272830+0000","last_undegraded":"2024-09-15T22:51:17.272830+0000","last_fullsized":"2024-09-15T22:51:17.272830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:06.455654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960496+0000","last_change":"2024-09-15T22:51:14.973590+0000","last_active":"2024-09-15T22:51:16.960496+0000","last_peered":"2024-09-15T22:51:16.960496+0000","last_clean":"2024-09-15T22:51:16.960496+0000","last_became_active":"2024-09-15T22:51:14.973243+0000","last_became_peered":"2024-09-15T22:51:14.973243+0000","last_unstale":"2024-09-15T22:51:16.960496+0000","last_undegraded":"2024-09-15T22:51:16.960496+0000","last_fullsized":"2024-09-15T22:51:16.960496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084547+0000","last_change":"2024-09-15T22:51:15.992281+0000","last_active":"2024-09-15T22:51:17.084547+0000","last_peered":"2024-09-15T22:51:17.084547+0000","last_clean":"2024-09-15T22:51:17.084547+0000","last_became_active":"2024-09-15T22:51:15.991963+0000","last_became_peered":"2024-09-15T22:51:15.991963+0000","last_unstale":"2024-09-15T22:51:17.084547+0000","last_undegraded":"2024-09-15T22:51:17.084547+0000","last_fullsized":"2024-09-15T22:51:17.084547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:25.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272267+0000","last_change":"2024-09-15T22:51:14.985081+0000","last_active":"2024-09-15T22:51:17.272267+0000","last_peered":"2024-09-15T22:51:17.272267+0000","last_clean":"2024-09-15T22:51:17.272267+0000","last_became_active":"2024-09-15T22:51:14.984750+0000","last_became_peered":"2024-09-15T22:51:14.984750+0000","last_unstale":"2024-09-15T22:51:17.272267+0000","last_undegraded":"2024-09-15T22:51:17.272267+0000","last_fullsized":"2024-09-15T22:51:17.272267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084535+0000","last_change":"2024-09-15T22:51:15.972721+0000","last_active":"2024-09-15T22:51:17.084535+0000","last_peered":"2024-09-15T22:51:17.084535+0000","last_clean":"2024-09-15T22:51:17.084535+0000","last_became_active":"2024-09-15T22:51:15.972405+0000","last_became_peered":"2024-09-15T22:51:15.972405+0000","last_unstale":"2024-09-15T22:51:17.084535+0000","last_undegraded":"2024-09-15T22:51:17.084535+0000","last_fullsized":"2024-09-15T22:51:17.084535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:43.741896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960608+0000","last_change":"2024-09-15T22:51:14.981702+0000","last_active":"2024-09-15T22:51:16.960608+0000","last_peered":"2024-09-15T22:51:16.960608+0000","last_clean":"2024-09-15T22:51:16.960608+0000","last_became_active":"2024-09-15T22:51:14.981473+0000","last_became_peered":"2024-09-15T22:51:14.981473+0000","last_unstale":"2024-09-15T22:51:16.960608+0000","last_undegraded":"2024-09-15T22:51:16.960608+0000","last_fullsized":"2024-09-15T22:51:16.960608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:02.426844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961095+0000","last_change":"2024-09-15T22:51:15.973207+0000","last_active":"2024-09-15T22:51:16.961095+0000","last_peered":"2024-09-15T22:51:16.961095+0000","last_clean":"2024-09-15T22:51:16.961095+0000","last_became_active":"2024-09-15T22:51:15.972882+0000","last_became_peered":"2024-09-15T22:51:15.972882+0000","last_unstale":"2024-09-15T22:51:16.961095+0000","last_undegraded":"2024-09-15T22:51:16.961095+0000","last_fullsized":"2024-09-15T22:51:16.961095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:19.087500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273135+0000","last_change":"2024-09-15T22:51:14.975951+0000","last_active":"2024-09-15T22:51:17.273135+0000","last_peered":"2024-09-15T22:51:17.273135+0000","last_clean":"2024-09-15T22:51:17.273135+0000","last_became_active":"2024-09-15T22:51:14.975646+0000","last_became_peered":"2024-09-15T22:51:14.975646+0000","last_unstale":"2024-09-15T22:51:17.273135+0000","last_undegraded":"2024-09-15T22:51:17.273135+0000","last_fullsized":"2024-09-15T22:51:17.273135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272785+0000","last_change":"2024-09-15T22:51:15.980141+0000","last_active":"2024-09-15T22:51:17.272785+0000","last_peered":"2024-09-15T22:51:17.272785+0000","last_clean":"2024-09-15T22:51:17.272785+0000","last_became_active":"2024-09-15T22:51:15.979753+0000","last_became_peered":"2024-09-15T22:51:15.979753+0000","last_unstale":"2024-09-15T22:51:17.272785+0000","last_undegraded":"2024-09-15T22:51:17.272785+0000","last_fullsized":"2024-09-15T22:51:17.272785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959074+0000","last_change":"2024-09-15T22:51:14.984134+0000","last_active":"2024-09-15T22:51:16.959074+0000","last_peered":"2024-09-15T22:51:16.959074+0000","last_clean":"2024-09-15T22:51:16.959074+0000","last_became_active":"2024-09-15T22:51:14.983836+0000","last_became_peered":"2024-09-15T22:51:14.983836+0000","last_unstale":"2024-09-15T22:51:16.959074+0000","last_undegraded":"2024-09-15T22:51:16.959074+0000","last_fullsized":"2024-09-15T22:51:16.959074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.024552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959141+0000","last_change":"2024-09-15T22:51:15.973591+0000","last_active":"2024-09-15T22:51:16.959141+0000","last_peered":"2024-09-15T22:51:16.959141+0000","last_clean":"2024-09-15T22:51:16.959141+0000","last_became_active":"2024-09-15T22:51:15.973400+0000","last_became_peered":"2024-09-15T22:51:15.973400+0000","last_unstale":"2024-09-15T22:51:16.959141+0000","last_undegraded":"2024-09-15T22:51:16.959141+0000","last_fullsized":"2024-09-15T22:51:16.959141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:45.849466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271563+0000","last_change":"2024-09-15T22:51:14.976515+0000","last_active":"2024-09-15T22:51:17.271563+0000","last_peered":"2024-09-15T22:51:17.271563+0000","last_clean":"2024-09-15T22:51:17.271563+0000","last_became_active":"2024-09-15T22:51:14.976095+0000","last_became_peered":"2024-09-15T22:51:14.976095+0000","last_unstale":"2024-09-15T22:51:17.271563+0000","last_undegraded":"2024-09-15T22:51:17.271563+0000","last_fullsized":"2024-09-15T22:51:17.271563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272445+0000","last_change":"2024-09-15T22:51:15.991358+0000","last_active":"2024-09-15T22:51:17.272445+0000","last_peered":"2024-09-15T22:51:17.272445+0000","last_clean":"2024-09-15T22:51:17.272445+0000","last_became_active":"2024-09-15T22:51:15.991092+0000","last_became_peered":"2024-09-15T22:51:15.991092+0000","last_unstale":"2024-09-15T22:51:17.272445+0000","last_undegraded":"2024-09-15T22:51:17.272445+0000","last_fullsized":"2024-09-15T22:51:17.272445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958672+0000","last_change":"2024-09-15T22:51:14.970136+0000","last_active":"2024-09-15T22:51:16.958672+0000","last_peered":"2024-09-15T22:51:16.958672+0000","last_clean":"2024-09-15T22:51:16.958672+0000","last_became_active":"2024-09-15T22:51:14.969847+0000","last_became_peered":"2024-09-15T22:51:14.969847+0000","last_unstale":"2024-09-15T22:51:16.958672+0000","last_undegraded":"2024-09-15T22:51:16.958672+0000","last_fullsized":"2024-09-15T22:51:16.958672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:50.714579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005900+0000","last_change":"2024-09-15T22:51:15.991833+0000","last_active":"2024-09-15T22:51:17.005900+0000","last_peered":"2024-09-15T22:51:17.005900+0000","last_clean":"2024-09-15T22:51:17.005900+0000","last_became_active":"2024-09-15T22:51:15.991493+0000","last_became_peered":"2024-09-15T22:51:15.991493+0000","last_unstale":"2024-09-15T22:51:17.005900+0000","last_undegraded":"2024-09-15T22:51:17.005900+0000","last_fullsized":"2024-09-15T22:51:17.005900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958594+0000","last_change":"2024-09-15T22:51:14.972795+0000","last_active":"2024-09-15T22:51:16.958594+0000","last_peered":"2024-09-15T22:51:16.958594+0000","last_clean":"2024-09-15T22:51:16.958594+0000","last_became_active":"2024-09-15T22:51:14.972530+0000","last_became_peered":"2024-09-15T22:51:14.972530+0000","last_unstale":"2024-09-15T22:51:16.958594+0000","last_undegraded":"2024-09-15T22:51:16.958594+0000","last_fullsized":"2024-09-15T22:51:16.958594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:04.280878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960169+0000","last_change":"2024-09-15T22:51:15.978730+0000","last_active":"2024-09-15T22:51:16.960169+0000","last_peered":"2024-09-15T22:51:16.960169+0000","last_clean":"2024-09-15T22:51:16.960169+0000","last_became_active":"2024-09-15T22:51:15.974000+0000","last_became_peered":"2024-09-15T22:51:15.974000+0000","last_unstale":"2024-09-15T22:51:16.960169+0000","last_undegraded":"2024-09-15T22:51:16.960169+0000","last_fullsized":"2024-09-15T22:51:16.960169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:37.790013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272918+0000","last_change":"2024-09-15T22:51:14.986927+0000","last_active":"2024-09-15T22:51:17.272918+0000","last_peered":"2024-09-15T22:51:17.272918+0000","last_clean":"2024-09-15T22:51:17.272918+0000","last_became_active":"2024-09-15T22:51:14.986593+0000","last_became_peered":"2024-09-15T22:51:14.986593+0000","last_unstale":"2024-09-15T22:51:17.272918+0000","last_undegraded":"2024-09-15T22:51:17.272918+0000","last_fullsized":"2024-09-15T22:51:17.272918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084756+0000","last_change":"2024-09-15T22:51:15.985692+0000","last_active":"2024-09-15T22:51:17.084756+0000","last_peered":"2024-09-15T22:51:17.084756+0000","last_clean":"2024-09-15T22:51:17.084756+0000","last_became_active":"2024-09-15T22:51:15.978277+0000","last_became_peered":"2024-09-15T22:51:15.978277+0000","last_unstale":"2024-09-15T22:51:17.084756+0000","last_undegraded":"2024-09-15T22:51:17.084756+0000","last_fullsized":"2024-09-15T22:51:17.084756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:13.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958457+0000","last_change":"2024-09-15T22:51:14.969964+0000","last_active":"2024-09-15T22:51:16.958457+0000","last_peered":"2024-09-15T22:51:16.958457+0000","last_clean":"2024-09-15T22:51:16.958457+0000","last_became_active":"2024-09-15T22:51:14.969593+0000","last_became_peered":"2024-09-15T22:51:14.969593+0000","last_unstale":"2024-09-15T22:51:16.958457+0000","last_undegraded":"2024-09-15T22:51:16.958457+0000","last_fullsized":"2024-09-15T22:51:16.958457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:05.355838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271516+0000","last_change":"2024-09-15T22:51:15.986341+0000","last_active":"2024-09-15T22:51:17.271516+0000","last_peered":"2024-09-15T22:51:17.271516+0000","last_clean":"2024-09-15T22:51:17.271516+0000","last_became_active":"2024-09-15T22:51:15.986044+0000","last_became_peered":"2024-09-15T22:51:15.986044+0000","last_unstale":"2024-09-15T22:51:17.271516+0000","last_undegraded":"2024-09-15T22:51:17.271516+0000","last_fullsized":"2024-09-15T22:51:17.271516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960795+0000","last_change":"2024-09-15T22:51:14.981097+0000","last_active":"2024-09-15T22:51:16.960795+0000","last_peered":"2024-09-15T22:51:16.960795+0000","last_clean":"2024-09-15T22:51:16.960795+0000","last_became_active":"2024-09-15T22:51:14.980807+0000","last_became_peered":"2024-09-15T22:51:14.980807+0000","last_unstale":"2024-09-15T22:51:16.960795+0000","last_undegraded":"2024-09-15T22:51:16.960795+0000","last_fullsized":"2024-09-15T22:51:16.960795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:16.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273563+0000","last_change":"2024-09-15T22:51:15.985023+0000","last_active":"2024-09-15T22:51:17.273563+0000","last_peered":"2024-09-15T22:51:17.273563+0000","last_clean":"2024-09-15T22:51:17.273563+0000","last_became_active":"2024-09-15T22:51:15.984704+0000","last_became_peered":"2024-09-15T22:51:15.984704+0000","last_unstale":"2024-09-15T22:51:17.273563+0000","last_undegraded":"2024-09-15T22:51:17.273563+0000","last_fullsized":"2024-09-15T22:51:17.273563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:43.741896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959027+0000","last_change":"2024-09-15T22:51:14.973168+0000","last_active":"2024-09-15T22:51:16.959027+0000","last_peered":"2024-09-15T22:51:16.959027+0000","last_clean":"2024-09-15T22:51:16.959027+0000","last_became_active":"2024-09-15T22:51:14.972888+0000","last_became_peered":"2024-09-15T22:51:14.972888+0000","last_unstale":"2024-09-15T22:51:16.959027+0000","last_undegraded":"2024-09-15T22:51:16.959027+0000","last_fullsized":"2024-09-15T22:51:16.959027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:18.635455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084690+0000","last_change":"2024-09-15T22:51:15.972891+0000","last_active":"2024-09-15T22:51:17.084690+0000","last_peered":"2024-09-15T22:51:17.084690+0000","last_clean":"2024-09-15T22:51:17.084690+0000","last_became_active":"2024-09-15T22:51:15.972625+0000","last_became_peered":"2024-09-15T22:51:15.972625+0000","last_unstale":"2024-09-15T22:51:17.084690+0000","last_undegraded":"2024-09-15T22:51:17.084690+0000","last_fullsized":"2024-09-15T22:51:17.084690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:42.097735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006172+0000","last_change":"2024-09-15T22:51:14.977285+0000","last_active":"2024-09-15T22:51:17.006172+0000","last_peered":"2024-09-15T22:51:17.006172+0000","last_clean":"2024-09-15T22:51:17.006172+0000","last_became_active":"2024-09-15T22:51:14.976967+0000","last_became_peered":"2024-09-15T22:51:14.976967+0000","last_unstale":"2024-09-15T22:51:17.006172+0000","last_undegraded":"2024-09-15T22:51:17.006172+0000","last_fullsized":"2024-09-15T22:51:17.006172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005955+0000","last_change":"2024-09-15T22:51:15.983908+0000","last_active":"2024-09-15T22:51:17.005955+0000","last_peered":"2024-09-15T22:51:17.005955+0000","last_clean":"2024-09-15T22:51:17.005955+0000","last_became_active":"2024-09-15T22:51:15.983403+0000","last_became_peered":"2024-09-15T22:51:15.983403+0000","last_unstale":"2024-09-15T22:51:17.005955+0000","last_undegraded":"2024-09-15T22:51:17.005955+0000","last_fullsized":"2024-09-15T22:51:17.005955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006120+0000","last_change":"2024-09-15T22:51:14.974881+0000","last_active":"2024-09-15T22:51:17.006120+0000","last_peered":"2024-09-15T22:51:17.006120+0000","last_clean":"2024-09-15T22:51:17.006120+0000","last_became_active":"2024-09-15T22:51:14.974621+0000","last_became_peered":"2024-09-15T22:51:14.974621+0000","last_unstale":"2024-09-15T22:51:17.006120+0000","last_undegraded":"2024-09-15T22:51:17.006120+0000","last_fullsized":"2024-09-15T22:51:17.006120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271393+0000","last_change":"2024-09-15T22:51:15.980723+0000","last_active":"2024-09-15T22:51:17.271393+0000","last_peered":"2024-09-15T22:51:17.271393+0000","last_clean":"2024-09-15T22:51:17.271393+0000","last_became_active":"2024-09-15T22:51:15.980235+0000","last_became_peered":"2024-09-15T22:51:15.980235+0000","last_unstale":"2024-09-15T22:51:17.271393+0000","last_undegraded":"2024-09-15T22:51:17.271393+0000","last_fullsized":"2024-09-15T22:51:17.271393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960658+0000","last_change":"2024-09-15T22:51:14.975174+0000","last_active":"2024-09-15T22:51:16.960658+0000","last_peered":"2024-09-15T22:51:16.960658+0000","last_clean":"2024-09-15T22:51:16.960658+0000","last_became_active":"2024-09-15T22:51:14.974907+0000","last_became_peered":"2024-09-15T22:51:14.974907+0000","last_unstale":"2024-09-15T22:51:16.960658+0000","last_undegraded":"2024-09-15T22:51:16.960658+0000","last_fullsized":"2024-09-15T22:51:16.960658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272518+0000","last_change":"2024-09-15T22:51:15.974821+0000","last_active":"2024-09-15T22:51:17.272518+0000","last_peered":"2024-09-15T22:51:17.272518+0000","last_clean":"2024-09-15T22:51:17.272518+0000","last_became_active":"2024-09-15T22:51:15.974565+0000","last_became_peered":"2024-09-15T22:51:15.974565+0000","last_unstale":"2024-09-15T22:51:17.272518+0000","last_undegraded":"2024-09-15T22:51:17.272518+0000","last_fullsized":"2024-09-15T22:51:17.272518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272242+0000","last_change":"2024-09-15T22:51:14.973229+0000","last_active":"2024-09-15T22:51:17.272242+0000","last_peered":"2024-09-15T22:51:17.272242+0000","last_clean":"2024-09-15T22:51:17.272242+0000","last_became_active":"2024-09-15T22:51:14.972952+0000","last_became_peered":"2024-09-15T22:51:14.972952+0000","last_unstale":"2024-09-15T22:51:17.272242+0000","last_undegraded":"2024-09-15T22:51:17.272242+0000","last_fullsized":"2024-09-15T22:51:17.272242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273056+0000","last_change":"2024-09-15T22:51:15.983534+0000","last_active":"2024-09-15T22:51:17.273056+0000","last_peered":"2024-09-15T22:51:17.273056+0000","last_clean":"2024-09-15T22:51:17.273056+0000","last_became_active":"2024-09-15T22:51:15.983225+0000","last_became_peered":"2024-09-15T22:51:15.983225+0000","last_unstale":"2024-09-15T22:51:17.273056+0000","last_undegraded":"2024-09-15T22:51:17.273056+0000","last_fullsized":"2024-09-15T22:51:17.273056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:06.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084361+0000","last_change":"2024-09-15T22:51:14.971981+0000","last_active":"2024-09-15T22:51:17.084361+0000","last_peered":"2024-09-15T22:51:17.084361+0000","last_clean":"2024-09-15T22:51:17.084361+0000","last_became_active":"2024-09-15T22:51:14.971568+0000","last_became_peered":"2024-09-15T22:51:14.971568+0000","last_unstale":"2024-09-15T22:51:17.084361+0000","last_undegraded":"2024-09-15T22:51:17.084361+0000","last_fullsized":"2024-09-15T22:51:17.084361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:31.571097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960547+0000","last_change":"2024-09-15T22:51:15.976778+0000","last_active":"2024-09-15T22:51:16.960547+0000","last_peered":"2024-09-15T22:51:16.960547+0000","last_clean":"2024-09-15T22:51:16.960547+0000","last_became_active":"2024-09-15T22:51:15.976531+0000","last_became_peered":"2024-09-15T22:51:15.976531+0000","last_unstale":"2024-09-15T22:51:16.960547+0000","last_undegraded":"2024-09-15T22:51:16.960547+0000","last_fullsized":"2024-09-15T22:51:16.960547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:23.782432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273206+0000","last_change":"2024-09-15T22:51:14.987009+0000","last_active":"2024-09-15T22:51:17.273206+0000","last_peered":"2024-09-15T22:51:17.273206+0000","last_clean":"2024-09-15T22:51:17.273206+0000","last_became_active":"2024-09-15T22:51:14.986692+0000","last_became_peered":"2024-09-15T22:51:14.986692+0000","last_unstale":"2024-09-15T22:51:17.273206+0000","last_undegraded":"2024-09-15T22:51:17.273206+0000","last_fullsized":"2024-09-15T22:51:17.273206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272464+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:51:17.272464+0000","last_peered":"2024-09-15T22:51:17.272464+0000","last_clean":"2024-09-15T22:51:17.272464+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:51:17.272464+0000","last_undegraded":"2024-09-15T22:51:17.272464+0000","last_fullsized":"2024-09-15T22:51:17.272464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1056768,"data_stored":785721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":194253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":193783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":195317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":193761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1044480,"data_stored":784073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:51:24.680 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:51:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 Processor -- start 2024-09-15T22:51:24.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 -- start start 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f591c06f270 0x7f591c06f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f591c072870 0x7f591c15c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f591c06fb90 con 0x7f591c0b47a0 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f591c15ba60 con 0x7f591c072870 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5922a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f591c0affa0 con 0x7f591c06f270 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f591c072870 0x7f591c15c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f591c072870 0x7f591c15c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42474/0 (socket says 172.21.15.31:42474) 2024-09-15T22:51:24.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 -- 172.21.15.31:0/3400444626 learned_addr learned my addr 172.21.15.31:0/3400444626 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:24.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f591be00640 1 --2- 172.21.15.31:0/3400444626 >> v2:172.21.15.102:3300/0 conn(0x7f591c06f270 0x7f591c06f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 -- 172.21.15.31:0/3400444626 >> v2:172.21.15.102:3300/0 conn(0x7f591c06f270 msgr2=0x7f591c06f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:24.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 --2- 172.21.15.31:0/3400444626 >> v2:172.21.15.102:3300/0 conn(0x7f591c06f270 0x7f591c06f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 -- 172.21.15.31:0/3400444626 >> v1:172.21.15.102:6789/0 conn(0x7f591c0b47a0 legacy=0x7f591c072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:24.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.832+0000 7f5920a00640 1 -- 172.21.15.31:0/3400444626 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c072d40 con 0x7f591c072870 2024-09-15T22:51:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5920a00640 1 --2- 172.21.15.31:0/3400444626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c072870 0x7f591c15c840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f591c0702e0 tx=0x7f591401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8bceddc94586884 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:24.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f591b400640 1 -- 172.21.15.31:0/3400444626 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59140a57a0 con 0x7f591c072870 2024-09-15T22:51:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f591b400640 1 -- 172.21.15.31:0/3400444626 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59140a5940 con 0x7f591c072870 2024-09-15T22:51:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f591b400640 1 -- 172.21.15.31:0/3400444626 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59140a5d10 con 0x7f591c072870 2024-09-15T22:51:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 -- 172.21.15.31:0/3400444626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c072870 msgr2=0x7f591c15c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 --2- 172.21.15.31:0/3400444626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c072870 0x7f591c15c840 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f591c0702e0 tx=0x7f591401c9f0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 -- 172.21.15.31:0/3400444626 shutdown_connections 2024-09-15T22:51:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 --2- 172.21.15.31:0/3400444626 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c072870 0x7f591c15c840 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 --2- 172.21.15.31:0/3400444626 >> v2:172.21.15.102:3300/0 conn(0x7f591c06f270 0x7f591c06f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 -- 172.21.15.31:0/3400444626 >> 172.21.15.31:0/3400444626 conn(0x7f591c067e00 msgr2=0x7f591c06bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 -- 172.21.15.31:0/3400444626 shutdown_connections 2024-09-15T22:51:24.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.836+0000 7f5922a00640 1 -- 172.21.15.31:0/3400444626 wait complete. 2024-09-15T22:51:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 Processor -- start 2024-09-15T22:51:24.841 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- start start 2024-09-15T22:51:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f591c072870 0x7f591c151d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f591c0b47a0 0x7f591c0b2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f591c155b90 con 0x7f591c06f270 2024-09-15T22:51:24.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f591c155a10 con 0x7f591c072870 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f591c0b4bb0 con 0x7f591c0b47a0 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42490/0 (socket says 172.21.15.31:42490) 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 -- 172.21.15.31:0/2079372544 learned_addr learned my addr 172.21.15.31:0/2079372544 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5920a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f591c0b47a0 0x7f591c0b2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5913400640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f591c072870 0x7f591c151d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 -- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f591c0b47a0 msgr2=0x7f591c0b2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f591c0b47a0 0x7f591c0b2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 -- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f591c072870 msgr2=0x7f591c151d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f591c072870 0x7f591c151d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 -- 172.21.15.31:0/2079372544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c1522d0 con 0x7f591c06f270 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f591be00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f590c00d800 tx=0x7f590c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:24.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c00b6c0 con 0x7f591c06f270 2024-09-15T22:51:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f590c019070 con 0x7f591c06f270 2024-09-15T22:51:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c14bf40 con 0x7f591c06f270 2024-09-15T22:51:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f590c00bae0 con 0x7f591c06f270 2024-09-15T22:51:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c167140 con 0x7f591c06f270 2024-09-15T22:51:24.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.840+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591c15d190 con 0x7f591c06f270 2024-09-15T22:51:24.846 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.844+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f590c00bc80 con 0x7f591c06f270 2024-09-15T22:51:24.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.844+0000 7f5918c00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 0x7f58f8069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:24.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.844+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f590c086240 con 0x7f591c06f270 2024-09-15T22:51:24.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.844+0000 7f5913400640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 0x7f58f8069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:24.847 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.844+0000 7f5913400640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 0x7f58f8069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f591c14d320 tx=0x7f5904009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:24.851 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:24.848+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f590c056be0 con 0x7f591c06f270 2024-09-15T22:51:25.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.012+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f591c0b2e60 con 0x7f58f80678f0 2024-09-15T22:51:25.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.020+0000 7f5918c00640 1 -- 172.21.15.31:0/2079372544 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251959 (secure 0 0 0) 0x7f591c0b2e60 con 0x7f58f80678f0 2024-09-15T22:51:25.024 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:25.025 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 msgr2=0x7f58f8069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 0x7f58f8069db0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f591c14d320 tx=0x7f5904009040 comp rx=0 tx=0).stop 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 msgr2=0x7f591c14b960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f590c00d800 tx=0x7f590c00dcc0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 shutdown_connections 2024-09-15T22:51:25.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f58f80678f0 0x7f58f8069db0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f591c0b47a0 0x7f591c0b2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f591c072870 0x7f591c151d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 --2- 172.21.15.31:0/2079372544 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f591c06f270 0x7f591c14b960 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 >> 172.21.15.31:0/2079372544 conn(0x7f591c067e00 msgr2=0x7f591c15e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 shutdown_connections 2024-09-15T22:51:25.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.024+0000 7f5922a00640 1 -- 172.21.15.31:0/2079372544 wait complete. 2024-09-15T22:51:25.045 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":71,"stamp":"2024-09-15T22:51:23.570297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220952,"kb_used_data":4712,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753768,"statfs":{"total":773094113280,"available":772867858432,"internally_reserved":0,"allocated":4825088,"data_stored":2734924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":33,"apply_latency_ms":33,"commit_latency_ns":33000000,"apply_latency_ns":33000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001783"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084834+0000","last_change":"2024-09-15T22:51:15.992182+0000","last_active":"2024-09-15T22:51:17.084834+0000","last_peered":"2024-09-15T22:51:17.084834+0000","last_clean":"2024-09-15T22:51:17.084834+0000","last_became_active":"2024-09-15T22:51:15.991879+0000","last_became_peered":"2024-09-15T22:51:15.991879+0000","last_unstale":"2024-09-15T22:51:17.084834+0000","last_undegraded":"2024-09-15T22:51:17.084834+0000","last_fullsized":"2024-09-15T22:51:17.084834+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:05:07.942771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084519+0000","last_change":"2024-09-15T22:51:15.968684+0000","last_active":"2024-09-15T22:51:17.084519+0000","last_peered":"2024-09-15T22:51:17.084519+0000","last_clean":"2024-09-15T22:51:17.084519+0000","last_became_active":"2024-09-15T22:51:15.968423+0000","last_became_peered":"2024-09-15T22:51:15.968423+0000","last_unstale":"2024-09-15T22:51:17.084519+0000","last_undegraded":"2024-09-15T22:51:17.084519+0000","last_fullsized":"2024-09-15T22:51:17.084519+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:02.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006190+0000","last_change":"2024-09-15T22:51:15.991509+0000","last_active":"2024-09-15T22:51:17.006190+0000","last_peered":"2024-09-15T22:51:17.006190+0000","last_clean":"2024-09-15T22:51:17.006190+0000","last_became_active":"2024-09-15T22:51:15.991200+0000","last_became_peered":"2024-09-15T22:51:15.991200+0000","last_unstale":"2024-09-15T22:51:17.006190+0000","last_undegraded":"2024-09-15T22:51:17.006190+0000","last_fullsized":"2024-09-15T22:51:17.006190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958748+0000","last_change":"2024-09-15T22:51:15.963947+0000","last_active":"2024-09-15T22:51:16.958748+0000","last_peered":"2024-09-15T22:51:16.958748+0000","last_clean":"2024-09-15T22:51:16.958748+0000","last_became_active":"2024-09-15T22:51:15.963664+0000","last_became_peered":"2024-09-15T22:51:15.963664+0000","last_unstale":"2024-09-15T22:51:16.958748+0000","last_undegraded":"2024-09-15T22:51:16.958748+0000","last_fullsized":"2024-09-15T22:51:16.958748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:40.788325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958559+0000","last_change":"2024-09-15T22:51:15.965348+0000","last_active":"2024-09-15T22:51:16.958559+0000","last_peered":"2024-09-15T22:51:16.958559+0000","last_clean":"2024-09-15T22:51:16.958559+0000","last_became_active":"2024-09-15T22:51:15.964577+0000","last_became_peered":"2024-09-15T22:51:15.964577+0000","last_unstale":"2024-09-15T22:51:16.958559+0000","last_undegraded":"2024-09-15T22:51:16.958559+0000","last_fullsized":"2024-09-15T22:51:16.958559+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:21.338007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271501+0000","last_change":"2024-09-15T22:51:15.977007+0000","last_active":"2024-09-15T22:51:17.271501+0000","last_peered":"2024-09-15T22:51:17.271501+0000","last_clean":"2024-09-15T22:51:17.271501+0000","last_became_active":"2024-09-15T22:51:15.976571+0000","last_became_peered":"2024-09-15T22:51:15.976571+0000","last_unstale":"2024-09-15T22:51:17.271501+0000","last_undegraded":"2024-09-15T22:51:17.271501+0000","last_fullsized":"2024-09-15T22:51:17.271501+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960130+0000","last_change":"2024-09-15T22:51:15.969743+0000","last_active":"2024-09-15T22:51:16.960130+0000","last_peered":"2024-09-15T22:51:16.960130+0000","last_clean":"2024-09-15T22:51:16.960130+0000","last_became_active":"2024-09-15T22:51:15.969472+0000","last_became_peered":"2024-09-15T22:51:15.969472+0000","last_unstale":"2024-09-15T22:51:16.960130+0000","last_undegraded":"2024-09-15T22:51:16.960130+0000","last_fullsized":"2024-09-15T22:51:16.960130+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:54.330237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084447+0000","last_change":"2024-09-15T22:51:15.977566+0000","last_active":"2024-09-15T22:51:17.084447+0000","last_peered":"2024-09-15T22:51:17.084447+0000","last_clean":"2024-09-15T22:51:17.084447+0000","last_became_active":"2024-09-15T22:51:15.977270+0000","last_became_peered":"2024-09-15T22:51:15.977270+0000","last_unstale":"2024-09-15T22:51:17.084447+0000","last_undegraded":"2024-09-15T22:51:17.084447+0000","last_fullsized":"2024-09-15T22:51:17.084447+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:48.792581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006446+0000","last_change":"2024-09-15T22:51:15.995960+0000","last_active":"2024-09-15T22:51:17.006446+0000","last_peered":"2024-09-15T22:51:17.006446+0000","last_clean":"2024-09-15T22:51:17.006446+0000","last_became_active":"2024-09-15T22:51:15.991488+0000","last_became_peered":"2024-09-15T22:51:15.991488+0000","last_unstale":"2024-09-15T22:51:17.006446+0000","last_undegraded":"2024-09-15T22:51:17.006446+0000","last_fullsized":"2024-09-15T22:51:17.006446+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:08.531903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960450+0000","last_change":"2024-09-15T22:51:15.976097+0000","last_active":"2024-09-15T22:51:16.960450+0000","last_peered":"2024-09-15T22:51:16.960450+0000","last_clean":"2024-09-15T22:51:16.960450+0000","last_became_active":"2024-09-15T22:51:15.975783+0000","last_became_peered":"2024-09-15T22:51:15.975783+0000","last_unstale":"2024-09-15T22:51:16.960450+0000","last_undegraded":"2024-09-15T22:51:16.960450+0000","last_fullsized":"2024-09-15T22:51:16.960450+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:45:35.661681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960459+0000","last_change":"2024-09-15T22:51:15.967103+0000","last_active":"2024-09-15T22:51:16.960459+0000","last_peered":"2024-09-15T22:51:16.960459+0000","last_clean":"2024-09-15T22:51:16.960459+0000","last_became_active":"2024-09-15T22:51:15.966774+0000","last_became_peered":"2024-09-15T22:51:15.966774+0000","last_unstale":"2024-09-15T22:51:16.960459+0000","last_undegraded":"2024-09-15T22:51:16.960459+0000","last_fullsized":"2024-09-15T22:51:16.960459+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:15:33.866771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006246+0000","last_change":"2024-09-15T22:51:15.996985+0000","last_active":"2024-09-15T22:51:17.006246+0000","last_peered":"2024-09-15T22:51:17.006246+0000","last_clean":"2024-09-15T22:51:17.006246+0000","last_became_active":"2024-09-15T22:51:15.996695+0000","last_became_peered":"2024-09-15T22:51:15.996695+0000","last_unstale":"2024-09-15T22:51:17.006246+0000","last_undegraded":"2024-09-15T22:51:17.006246+0000","last_fullsized":"2024-09-15T22:51:17.006246+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960292+0000","last_change":"2024-09-15T22:51:15.977665+0000","last_active":"2024-09-15T22:51:16.960292+0000","last_peered":"2024-09-15T22:51:16.960292+0000","last_clean":"2024-09-15T22:51:16.960292+0000","last_became_active":"2024-09-15T22:51:15.977315+0000","last_became_peered":"2024-09-15T22:51:15.977315+0000","last_unstale":"2024-09-15T22:51:16.960292+0000","last_undegraded":"2024-09-15T22:51:16.960292+0000","last_fullsized":"2024-09-15T22:51:16.960292+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:53:46.264001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272336+0000","last_change":"2024-09-15T22:51:15.971218+0000","last_active":"2024-09-15T22:51:17.272336+0000","last_peered":"2024-09-15T22:51:17.272336+0000","last_clean":"2024-09-15T22:51:17.272336+0000","last_became_active":"2024-09-15T22:51:15.970973+0000","last_became_peered":"2024-09-15T22:51:15.970973+0000","last_unstale":"2024-09-15T22:51:17.272336+0000","last_undegraded":"2024-09-15T22:51:17.272336+0000","last_fullsized":"2024-09-15T22:51:17.272336+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:43.208399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960371+0000","last_change":"2024-09-15T22:51:15.969015+0000","last_active":"2024-09-15T22:51:16.960371+0000","last_peered":"2024-09-15T22:51:16.960371+0000","last_clean":"2024-09-15T22:51:16.960371+0000","last_became_active":"2024-09-15T22:51:15.967009+0000","last_became_peered":"2024-09-15T22:51:15.967009+0000","last_unstale":"2024-09-15T22:51:16.960371+0000","last_undegraded":"2024-09-15T22:51:16.960371+0000","last_fullsized":"2024-09-15T22:51:16.960371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:04:42.992432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272331+0000","last_change":"2024-09-15T22:51:15.984579+0000","last_active":"2024-09-15T22:51:17.272331+0000","last_peered":"2024-09-15T22:51:17.272331+0000","last_clean":"2024-09-15T22:51:17.272331+0000","last_became_active":"2024-09-15T22:51:15.982978+0000","last_became_peered":"2024-09-15T22:51:15.982978+0000","last_unstale":"2024-09-15T22:51:17.272331+0000","last_undegraded":"2024-09-15T22:51:17.272331+0000","last_fullsized":"2024-09-15T22:51:17.272331+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273226+0000","last_change":"2024-09-15T22:51:15.983371+0000","last_active":"2024-09-15T22:51:17.273226+0000","last_peered":"2024-09-15T22:51:17.273226+0000","last_clean":"2024-09-15T22:51:17.273226+0000","last_became_active":"2024-09-15T22:51:15.983072+0000","last_became_peered":"2024-09-15T22:51:15.983072+0000","last_unstale":"2024-09-15T22:51:17.273226+0000","last_undegraded":"2024-09-15T22:51:17.273226+0000","last_fullsized":"2024-09-15T22:51:17.273226+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:31:48.792581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961367+0000","last_change":"2024-09-15T22:51:15.980693+0000","last_active":"2024-09-15T22:51:16.961367+0000","last_peered":"2024-09-15T22:51:16.961367+0000","last_clean":"2024-09-15T22:51:16.961367+0000","last_became_active":"2024-09-15T22:51:15.979299+0000","last_became_peered":"2024-09-15T22:51:15.979299+0000","last_unstale":"2024-09-15T22:51:16.961367+0000","last_undegraded":"2024-09-15T22:51:16.961367+0000","last_fullsized":"2024-09-15T22:51:16.961367+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:40.184879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958987+0000","last_change":"2024-09-15T22:51:15.969922+0000","last_active":"2024-09-15T22:51:16.958987+0000","last_peered":"2024-09-15T22:51:16.958987+0000","last_clean":"2024-09-15T22:51:16.958987+0000","last_became_active":"2024-09-15T22:51:15.969658+0000","last_became_peered":"2024-09-15T22:51:15.969658+0000","last_unstale":"2024-09-15T22:51:16.958987+0000","last_undegraded":"2024-09-15T22:51:16.958987+0000","last_fullsized":"2024-09-15T22:51:16.958987+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:43.770898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960928+0000","last_change":"2024-09-15T22:51:15.979414+0000","last_active":"2024-09-15T22:51:16.960928+0000","last_peered":"2024-09-15T22:51:16.960928+0000","last_clean":"2024-09-15T22:51:16.960928+0000","last_became_active":"2024-09-15T22:51:15.979092+0000","last_became_peered":"2024-09-15T22:51:15.979092+0000","last_unstale":"2024-09-15T22:51:16.960928+0000","last_undegraded":"2024-09-15T22:51:16.960928+0000","last_fullsized":"2024-09-15T22:51:16.960928+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:43.153927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960650+0000","last_change":"2024-09-15T22:51:15.976178+0000","last_active":"2024-09-15T22:51:16.960650+0000","last_peered":"2024-09-15T22:51:16.960650+0000","last_clean":"2024-09-15T22:51:16.960650+0000","last_became_active":"2024-09-15T22:51:15.975881+0000","last_became_peered":"2024-09-15T22:51:15.975881+0000","last_unstale":"2024-09-15T22:51:16.960650+0000","last_undegraded":"2024-09-15T22:51:16.960650+0000","last_fullsized":"2024-09-15T22:51:16.960650+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:25:24.943813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272440+0000","last_change":"2024-09-15T22:51:15.969563+0000","last_active":"2024-09-15T22:51:17.272440+0000","last_peered":"2024-09-15T22:51:17.272440+0000","last_clean":"2024-09-15T22:51:17.272440+0000","last_became_active":"2024-09-15T22:51:15.969191+0000","last_became_peered":"2024-09-15T22:51:15.969191+0000","last_unstale":"2024-09-15T22:51:17.272440+0000","last_undegraded":"2024-09-15T22:51:17.272440+0000","last_fullsized":"2024-09-15T22:51:17.272440+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:40.184879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272803+0000","last_change":"2024-09-15T22:51:15.981065+0000","last_active":"2024-09-15T22:51:17.272803+0000","last_peered":"2024-09-15T22:51:17.272803+0000","last_clean":"2024-09-15T22:51:17.272803+0000","last_became_active":"2024-09-15T22:51:15.980784+0000","last_became_peered":"2024-09-15T22:51:15.980784+0000","last_unstale":"2024-09-15T22:51:17.272803+0000","last_undegraded":"2024-09-15T22:51:17.272803+0000","last_fullsized":"2024-09-15T22:51:17.272803+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:49.231179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958592+0000","last_change":"2024-09-15T22:51:15.979333+0000","last_active":"2024-09-15T22:51:16.958592+0000","last_peered":"2024-09-15T22:51:16.958592+0000","last_clean":"2024-09-15T22:51:16.958592+0000","last_became_active":"2024-09-15T22:51:15.979014+0000","last_became_peered":"2024-09-15T22:51:15.979014+0000","last_unstale":"2024-09-15T22:51:16.958592+0000","last_undegraded":"2024-09-15T22:51:16.958592+0000","last_fullsized":"2024-09-15T22:51:16.958592+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:10.676037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961419+0000","last_change":"2024-09-15T22:51:15.992590+0000","last_active":"2024-09-15T22:51:16.961419+0000","last_peered":"2024-09-15T22:51:16.961419+0000","last_clean":"2024-09-15T22:51:16.961419+0000","last_became_active":"2024-09-15T22:51:15.992281+0000","last_became_peered":"2024-09-15T22:51:15.992281+0000","last_unstale":"2024-09-15T22:51:16.961419+0000","last_undegraded":"2024-09-15T22:51:16.961419+0000","last_fullsized":"2024-09-15T22:51:16.961419+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271606+0000","last_change":"2024-09-15T22:51:15.981066+0000","last_active":"2024-09-15T22:51:17.271606+0000","last_peered":"2024-09-15T22:51:17.271606+0000","last_clean":"2024-09-15T22:51:17.271606+0000","last_became_active":"2024-09-15T22:51:15.980786+0000","last_became_peered":"2024-09-15T22:51:15.980786+0000","last_unstale":"2024-09-15T22:51:17.271606+0000","last_undegraded":"2024-09-15T22:51:17.271606+0000","last_fullsized":"2024-09-15T22:51:17.271606+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961285+0000","last_change":"2024-09-15T22:51:15.982585+0000","last_active":"2024-09-15T22:51:16.961285+0000","last_peered":"2024-09-15T22:51:16.961285+0000","last_clean":"2024-09-15T22:51:16.961285+0000","last_became_active":"2024-09-15T22:51:15.982343+0000","last_became_peered":"2024-09-15T22:51:15.982343+0000","last_unstale":"2024-09-15T22:51:16.961285+0000","last_undegraded":"2024-09-15T22:51:16.961285+0000","last_fullsized":"2024-09-15T22:51:16.961285+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:43.208399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960371+0000","last_change":"2024-09-15T22:51:15.977890+0000","last_active":"2024-09-15T22:51:16.960371+0000","last_peered":"2024-09-15T22:51:16.960371+0000","last_clean":"2024-09-15T22:51:16.960371+0000","last_became_active":"2024-09-15T22:51:15.977579+0000","last_became_peered":"2024-09-15T22:51:15.977579+0000","last_unstale":"2024-09-15T22:51:16.960371+0000","last_undegraded":"2024-09-15T22:51:16.960371+0000","last_fullsized":"2024-09-15T22:51:16.960371+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:20:57.254015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961006+0000","last_change":"2024-09-15T22:51:15.974901+0000","last_active":"2024-09-15T22:51:16.961006+0000","last_peered":"2024-09-15T22:51:16.961006+0000","last_clean":"2024-09-15T22:51:16.961006+0000","last_became_active":"2024-09-15T22:51:15.974591+0000","last_became_peered":"2024-09-15T22:51:15.974591+0000","last_unstale":"2024-09-15T22:51:16.961006+0000","last_undegraded":"2024-09-15T22:51:16.961006+0000","last_fullsized":"2024-09-15T22:51:16.961006+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:32.579236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960696+0000","last_change":"2024-09-15T22:51:15.980095+0000","last_active":"2024-09-15T22:51:16.960696+0000","last_peered":"2024-09-15T22:51:16.960696+0000","last_clean":"2024-09-15T22:51:16.960696+0000","last_became_active":"2024-09-15T22:51:15.979844+0000","last_became_peered":"2024-09-15T22:51:15.979844+0000","last_unstale":"2024-09-15T22:51:16.960696+0000","last_undegraded":"2024-09-15T22:51:16.960696+0000","last_fullsized":"2024-09-15T22:51:16.960696+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:18.521487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272800+0000","last_change":"2024-09-15T22:51:15.995188+0000","last_active":"2024-09-15T22:51:17.272800+0000","last_peered":"2024-09-15T22:51:17.272800+0000","last_clean":"2024-09-15T22:51:17.272800+0000","last_became_active":"2024-09-15T22:51:15.994806+0000","last_became_peered":"2024-09-15T22:51:15.994806+0000","last_unstale":"2024-09-15T22:51:17.272800+0000","last_undegraded":"2024-09-15T22:51:17.272800+0000","last_fullsized":"2024-09-15T22:51:17.272800+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:03:08.531903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271472+0000","last_change":"2024-09-15T22:51:15.980214+0000","last_active":"2024-09-15T22:51:17.271472+0000","last_peered":"2024-09-15T22:51:17.271472+0000","last_clean":"2024-09-15T22:51:17.271472+0000","last_became_active":"2024-09-15T22:51:15.979948+0000","last_became_peered":"2024-09-15T22:51:15.979948+0000","last_unstale":"2024-09-15T22:51:17.271472+0000","last_undegraded":"2024-09-15T22:51:17.271472+0000","last_fullsized":"2024-09-15T22:51:17.271472+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273118+0000","last_change":"2024-09-15T22:51:15.983420+0000","last_active":"2024-09-15T22:51:17.273118+0000","last_peered":"2024-09-15T22:51:17.273118+0000","last_clean":"2024-09-15T22:51:17.273118+0000","last_became_active":"2024-09-15T22:51:15.983125+0000","last_became_peered":"2024-09-15T22:51:15.983125+0000","last_unstale":"2024-09-15T22:51:17.273118+0000","last_undegraded":"2024-09-15T22:51:17.273118+0000","last_fullsized":"2024-09-15T22:51:17.273118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:58:59.952592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961390+0000","last_change":"2024-09-15T22:51:14.976712+0000","last_active":"2024-09-15T22:51:16.961390+0000","last_peered":"2024-09-15T22:51:16.961390+0000","last_clean":"2024-09-15T22:51:16.961390+0000","last_became_active":"2024-09-15T22:51:14.976384+0000","last_became_peered":"2024-09-15T22:51:14.976384+0000","last_unstale":"2024-09-15T22:51:16.961390+0000","last_undegraded":"2024-09-15T22:51:16.961390+0000","last_fullsized":"2024-09-15T22:51:16.961390+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:51:30.766182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271728+0000","last_change":"2024-09-15T22:51:15.981524+0000","last_active":"2024-09-15T22:51:17.271728+0000","last_peered":"2024-09-15T22:51:17.271728+0000","last_clean":"2024-09-15T22:51:17.271728+0000","last_became_active":"2024-09-15T22:51:15.981277+0000","last_became_peered":"2024-09-15T22:51:15.981277+0000","last_unstale":"2024-09-15T22:51:17.271728+0000","last_undegraded":"2024-09-15T22:51:17.271728+0000","last_fullsized":"2024-09-15T22:51:17.271728+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006223+0000","last_change":"2024-09-15T22:51:14.981079+0000","last_active":"2024-09-15T22:51:17.006223+0000","last_peered":"2024-09-15T22:51:17.006223+0000","last_clean":"2024-09-15T22:51:17.006223+0000","last_became_active":"2024-09-15T22:51:14.980582+0000","last_became_peered":"2024-09-15T22:51:14.980582+0000","last_unstale":"2024-09-15T22:51:17.006223+0000","last_undegraded":"2024-09-15T22:51:17.006223+0000","last_fullsized":"2024-09-15T22:51:17.006223+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273078+0000","last_change":"2024-09-15T22:51:15.969552+0000","last_active":"2024-09-15T22:51:17.273078+0000","last_peered":"2024-09-15T22:51:17.273078+0000","last_clean":"2024-09-15T22:51:17.273078+0000","last_became_active":"2024-09-15T22:51:15.969271+0000","last_became_peered":"2024-09-15T22:51:15.969271+0000","last_unstale":"2024-09-15T22:51:17.273078+0000","last_undegraded":"2024-09-15T22:51:17.273078+0000","last_fullsized":"2024-09-15T22:51:17.273078+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271767+0000","last_change":"2024-09-15T22:51:14.978636+0000","last_active":"2024-09-15T22:51:17.271767+0000","last_peered":"2024-09-15T22:51:17.271767+0000","last_clean":"2024-09-15T22:51:17.271767+0000","last_became_active":"2024-09-15T22:51:14.978265+0000","last_became_peered":"2024-09-15T22:51:14.978265+0000","last_unstale":"2024-09-15T22:51:17.271767+0000","last_undegraded":"2024-09-15T22:51:17.271767+0000","last_fullsized":"2024-09-15T22:51:17.271767+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084823+0000","last_change":"2024-09-15T22:51:15.970465+0000","last_active":"2024-09-15T22:51:17.084823+0000","last_peered":"2024-09-15T22:51:17.084823+0000","last_clean":"2024-09-15T22:51:17.084823+0000","last_became_active":"2024-09-15T22:51:15.970193+0000","last_became_peered":"2024-09-15T22:51:15.970193+0000","last_unstale":"2024-09-15T22:51:17.084823+0000","last_undegraded":"2024-09-15T22:51:17.084823+0000","last_fullsized":"2024-09-15T22:51:17.084823+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:49:41.016389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272700+0000","last_change":"2024-09-15T22:51:14.974047+0000","last_active":"2024-09-15T22:51:17.272700+0000","last_peered":"2024-09-15T22:51:17.272700+0000","last_clean":"2024-09-15T22:51:17.272700+0000","last_became_active":"2024-09-15T22:51:14.973769+0000","last_became_peered":"2024-09-15T22:51:14.973769+0000","last_unstale":"2024-09-15T22:51:17.272700+0000","last_undegraded":"2024-09-15T22:51:17.272700+0000","last_fullsized":"2024-09-15T22:51:17.272700+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005818+0000","last_change":"2024-09-15T22:51:15.986684+0000","last_active":"2024-09-15T22:51:17.005818+0000","last_peered":"2024-09-15T22:51:17.005818+0000","last_clean":"2024-09-15T22:51:17.005818+0000","last_became_active":"2024-09-15T22:51:15.984872+0000","last_became_peered":"2024-09-15T22:51:15.984872+0000","last_unstale":"2024-09-15T22:51:17.005818+0000","last_undegraded":"2024-09-15T22:51:17.005818+0000","last_fullsized":"2024-09-15T22:51:17.005818+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961106+0000","last_change":"2024-09-15T22:51:14.974086+0000","last_active":"2024-09-15T22:51:16.961106+0000","last_peered":"2024-09-15T22:51:16.961106+0000","last_clean":"2024-09-15T22:51:16.961106+0000","last_became_active":"2024-09-15T22:51:14.973787+0000","last_became_peered":"2024-09-15T22:51:14.973787+0000","last_unstale":"2024-09-15T22:51:16.961106+0000","last_undegraded":"2024-09-15T22:51:16.961106+0000","last_fullsized":"2024-09-15T22:51:16.961106+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:47:46.921646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960825+0000","last_change":"2024-09-15T22:51:15.975182+0000","last_active":"2024-09-15T22:51:16.960825+0000","last_peered":"2024-09-15T22:51:16.960825+0000","last_clean":"2024-09-15T22:51:16.960825+0000","last_became_active":"2024-09-15T22:51:15.973693+0000","last_became_peered":"2024-09-15T22:51:15.973693+0000","last_unstale":"2024-09-15T22:51:16.960825+0000","last_undegraded":"2024-09-15T22:51:16.960825+0000","last_fullsized":"2024-09-15T22:51:16.960825+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:20:30.467553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272892+0000","last_change":"2024-09-15T22:51:14.986951+0000","last_active":"2024-09-15T22:51:17.272892+0000","last_peered":"2024-09-15T22:51:17.272892+0000","last_clean":"2024-09-15T22:51:17.272892+0000","last_became_active":"2024-09-15T22:51:14.986518+0000","last_became_peered":"2024-09-15T22:51:14.986518+0000","last_unstale":"2024-09-15T22:51:17.272892+0000","last_undegraded":"2024-09-15T22:51:17.272892+0000","last_fullsized":"2024-09-15T22:51:17.272892+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:06:38.491357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272608+0000","last_change":"2024-09-15T22:51:15.965032+0000","last_active":"2024-09-15T22:51:17.272608+0000","last_peered":"2024-09-15T22:51:17.272608+0000","last_clean":"2024-09-15T22:51:17.272608+0000","last_became_active":"2024-09-15T22:51:15.964779+0000","last_became_peered":"2024-09-15T22:51:15.964779+0000","last_unstale":"2024-09-15T22:51:17.272608+0000","last_undegraded":"2024-09-15T22:51:17.272608+0000","last_fullsized":"2024-09-15T22:51:17.272608+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271408+0000","last_change":"2024-09-15T22:51:14.973894+0000","last_active":"2024-09-15T22:51:17.271408+0000","last_peered":"2024-09-15T22:51:17.271408+0000","last_clean":"2024-09-15T22:51:17.271408+0000","last_became_active":"2024-09-15T22:51:14.973577+0000","last_became_peered":"2024-09-15T22:51:14.973577+0000","last_unstale":"2024-09-15T22:51:17.271408+0000","last_undegraded":"2024-09-15T22:51:17.271408+0000","last_fullsized":"2024-09-15T22:51:17.271408+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:38:39.780186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084555+0000","last_change":"2024-09-15T22:51:15.985380+0000","last_active":"2024-09-15T22:51:17.084555+0000","last_peered":"2024-09-15T22:51:17.084555+0000","last_clean":"2024-09-15T22:51:17.084555+0000","last_became_active":"2024-09-15T22:51:15.978918+0000","last_became_peered":"2024-09-15T22:51:15.978918+0000","last_unstale":"2024-09-15T22:51:17.084555+0000","last_undegraded":"2024-09-15T22:51:17.084555+0000","last_fullsized":"2024-09-15T22:51:17.084555+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:02:06.975780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272181+0000","last_change":"2024-09-15T22:51:14.972066+0000","last_active":"2024-09-15T22:51:17.272181+0000","last_peered":"2024-09-15T22:51:17.272181+0000","last_clean":"2024-09-15T22:51:17.272181+0000","last_became_active":"2024-09-15T22:51:14.971640+0000","last_became_peered":"2024-09-15T22:51:14.971640+0000","last_unstale":"2024-09-15T22:51:17.272181+0000","last_undegraded":"2024-09-15T22:51:17.272181+0000","last_fullsized":"2024-09-15T22:51:17.272181+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958782+0000","last_change":"2024-09-15T22:51:15.965032+0000","last_active":"2024-09-15T22:51:16.958782+0000","last_peered":"2024-09-15T22:51:16.958782+0000","last_clean":"2024-09-15T22:51:16.958782+0000","last_became_active":"2024-09-15T22:51:15.964336+0000","last_became_peered":"2024-09-15T22:51:15.964336+0000","last_unstale":"2024-09-15T22:51:16.958782+0000","last_undegraded":"2024-09-15T22:51:16.958782+0000","last_fullsized":"2024-09-15T22:51:16.958782+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:52.656628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084878+0000","last_change":"2024-09-15T22:51:14.972265+0000","last_active":"2024-09-15T22:51:17.084878+0000","last_peered":"2024-09-15T22:51:17.084878+0000","last_clean":"2024-09-15T22:51:17.084878+0000","last_became_active":"2024-09-15T22:51:14.971919+0000","last_became_peered":"2024-09-15T22:51:14.971919+0000","last_unstale":"2024-09-15T22:51:17.084878+0000","last_undegraded":"2024-09-15T22:51:17.084878+0000","last_fullsized":"2024-09-15T22:51:17.084878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:49:42.145788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273429+0000","last_change":"2024-09-15T22:51:15.984922+0000","last_active":"2024-09-15T22:51:17.273429+0000","last_peered":"2024-09-15T22:51:17.273429+0000","last_clean":"2024-09-15T22:51:17.273429+0000","last_became_active":"2024-09-15T22:51:15.984641+0000","last_became_peered":"2024-09-15T22:51:15.984641+0000","last_unstale":"2024-09-15T22:51:17.273429+0000","last_undegraded":"2024-09-15T22:51:17.273429+0000","last_fullsized":"2024-09-15T22:51:17.273429+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:02.781599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960902+0000","last_change":"2024-09-15T22:51:14.979937+0000","last_active":"2024-09-15T22:51:16.960902+0000","last_peered":"2024-09-15T22:51:16.960902+0000","last_clean":"2024-09-15T22:51:16.960902+0000","last_became_active":"2024-09-15T22:51:14.979599+0000","last_became_peered":"2024-09-15T22:51:14.979599+0000","last_unstale":"2024-09-15T22:51:16.960902+0000","last_undegraded":"2024-09-15T22:51:16.960902+0000","last_fullsized":"2024-09-15T22:51:16.960902+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:50:31.799998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006271+0000","last_change":"2024-09-15T22:51:15.993029+0000","last_active":"2024-09-15T22:51:17.006271+0000","last_peered":"2024-09-15T22:51:17.006271+0000","last_clean":"2024-09-15T22:51:17.006271+0000","last_became_active":"2024-09-15T22:51:15.992759+0000","last_became_peered":"2024-09-15T22:51:15.992759+0000","last_unstale":"2024-09-15T22:51:17.006271+0000","last_undegraded":"2024-09-15T22:51:17.006271+0000","last_fullsized":"2024-09-15T22:51:17.006271+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T22:55:49.231179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":17,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961407+0000","last_change":"2024-09-15T22:51:14.980163+0000","last_active":"2024-09-15T22:51:16.961407+0000","last_peered":"2024-09-15T22:51:16.961407+0000","last_clean":"2024-09-15T22:51:16.961407+0000","last_became_active":"2024-09-15T22:51:14.979726+0000","last_became_peered":"2024-09-15T22:51:14.979726+0000","last_unstale":"2024-09-15T22:51:16.961407+0000","last_undegraded":"2024-09-15T22:51:16.961407+0000","last_fullsized":"2024-09-15T22:51:16.961407+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:27:56.714868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273129+0000","last_change":"2024-09-15T22:51:15.970080+0000","last_active":"2024-09-15T22:51:17.273129+0000","last_peered":"2024-09-15T22:51:17.273129+0000","last_clean":"2024-09-15T22:51:17.273129+0000","last_became_active":"2024-09-15T22:51:15.969805+0000","last_became_peered":"2024-09-15T22:51:15.969805+0000","last_unstale":"2024-09-15T22:51:17.273129+0000","last_undegraded":"2024-09-15T22:51:17.273129+0000","last_fullsized":"2024-09-15T22:51:17.273129+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:19:31.752494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":20,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084506+0000","last_change":"2024-09-15T22:51:14.980076+0000","last_active":"2024-09-15T22:51:17.084506+0000","last_peered":"2024-09-15T22:51:17.084506+0000","last_clean":"2024-09-15T22:51:17.084506+0000","last_became_active":"2024-09-15T22:51:14.979781+0000","last_became_peered":"2024-09-15T22:51:14.979781+0000","last_unstale":"2024-09-15T22:51:17.084506+0000","last_undegraded":"2024-09-15T22:51:17.084506+0000","last_fullsized":"2024-09-15T22:51:17.084506+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:32:39.176740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005874+0000","last_change":"2024-09-15T22:51:15.985513+0000","last_active":"2024-09-15T22:51:17.005874+0000","last_peered":"2024-09-15T22:51:17.005874+0000","last_clean":"2024-09-15T22:51:17.005874+0000","last_became_active":"2024-09-15T22:51:15.984875+0000","last_became_peered":"2024-09-15T22:51:15.984875+0000","last_unstale":"2024-09-15T22:51:17.005874+0000","last_undegraded":"2024-09-15T22:51:17.005874+0000","last_fullsized":"2024-09-15T22:51:17.005874+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:36:53.324170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084665+0000","last_change":"2024-09-15T22:51:14.971500+0000","last_active":"2024-09-15T22:51:17.084665+0000","last_peered":"2024-09-15T22:51:17.084665+0000","last_clean":"2024-09-15T22:51:17.084665+0000","last_became_active":"2024-09-15T22:51:14.971212+0000","last_became_peered":"2024-09-15T22:51:14.971212+0000","last_unstale":"2024-09-15T22:51:17.084665+0000","last_undegraded":"2024-09-15T22:51:17.084665+0000","last_fullsized":"2024-09-15T22:51:17.084665+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:35:42.200260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084623+0000","last_change":"2024-09-15T22:51:15.992196+0000","last_active":"2024-09-15T22:51:17.084623+0000","last_peered":"2024-09-15T22:51:17.084623+0000","last_clean":"2024-09-15T22:51:17.084623+0000","last_became_active":"2024-09-15T22:51:15.991924+0000","last_became_peered":"2024-09-15T22:51:15.991924+0000","last_unstale":"2024-09-15T22:51:17.084623+0000","last_undegraded":"2024-09-15T22:51:17.084623+0000","last_fullsized":"2024-09-15T22:51:17.084623+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:06:45.283641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271331+0000","last_change":"2024-09-15T22:51:14.974430+0000","last_active":"2024-09-15T22:51:17.271331+0000","last_peered":"2024-09-15T22:51:17.271331+0000","last_clean":"2024-09-15T22:51:17.271331+0000","last_became_active":"2024-09-15T22:51:14.974129+0000","last_became_peered":"2024-09-15T22:51:14.974129+0000","last_unstale":"2024-09-15T22:51:17.271331+0000","last_undegraded":"2024-09-15T22:51:17.271331+0000","last_fullsized":"2024-09-15T22:51:17.271331+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272830+0000","last_change":"2024-09-15T22:51:15.995127+0000","last_active":"2024-09-15T22:51:17.272830+0000","last_peered":"2024-09-15T22:51:17.272830+0000","last_clean":"2024-09-15T22:51:17.272830+0000","last_became_active":"2024-09-15T22:51:15.994855+0000","last_became_peered":"2024-09-15T22:51:15.994855+0000","last_unstale":"2024-09-15T22:51:17.272830+0000","last_undegraded":"2024-09-15T22:51:17.272830+0000","last_fullsized":"2024-09-15T22:51:17.272830+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:28:06.455654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960496+0000","last_change":"2024-09-15T22:51:14.973590+0000","last_active":"2024-09-15T22:51:16.960496+0000","last_peered":"2024-09-15T22:51:16.960496+0000","last_clean":"2024-09-15T22:51:16.960496+0000","last_became_active":"2024-09-15T22:51:14.973243+0000","last_became_peered":"2024-09-15T22:51:14.973243+0000","last_unstale":"2024-09-15T22:51:16.960496+0000","last_undegraded":"2024-09-15T22:51:16.960496+0000","last_fullsized":"2024-09-15T22:51:16.960496+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:44:20.329867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084547+0000","last_change":"2024-09-15T22:51:15.992281+0000","last_active":"2024-09-15T22:51:17.084547+0000","last_peered":"2024-09-15T22:51:17.084547+0000","last_clean":"2024-09-15T22:51:17.084547+0000","last_became_active":"2024-09-15T22:51:15.991963+0000","last_became_peered":"2024-09-15T22:51:15.991963+0000","last_unstale":"2024-09-15T22:51:17.084547+0000","last_undegraded":"2024-09-15T22:51:17.084547+0000","last_fullsized":"2024-09-15T22:51:17.084547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:17:25.266702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":22,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272267+0000","last_change":"2024-09-15T22:51:14.985081+0000","last_active":"2024-09-15T22:51:17.272267+0000","last_peered":"2024-09-15T22:51:17.272267+0000","last_clean":"2024-09-15T22:51:17.272267+0000","last_became_active":"2024-09-15T22:51:14.984750+0000","last_became_peered":"2024-09-15T22:51:14.984750+0000","last_unstale":"2024-09-15T22:51:17.272267+0000","last_undegraded":"2024-09-15T22:51:17.272267+0000","last_fullsized":"2024-09-15T22:51:17.272267+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084535+0000","last_change":"2024-09-15T22:51:15.972721+0000","last_active":"2024-09-15T22:51:17.084535+0000","last_peered":"2024-09-15T22:51:17.084535+0000","last_clean":"2024-09-15T22:51:17.084535+0000","last_became_active":"2024-09-15T22:51:15.972405+0000","last_became_peered":"2024-09-15T22:51:15.972405+0000","last_unstale":"2024-09-15T22:51:17.084535+0000","last_undegraded":"2024-09-15T22:51:17.084535+0000","last_fullsized":"2024-09-15T22:51:17.084535+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:43.741896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960608+0000","last_change":"2024-09-15T22:51:14.981702+0000","last_active":"2024-09-15T22:51:16.960608+0000","last_peered":"2024-09-15T22:51:16.960608+0000","last_clean":"2024-09-15T22:51:16.960608+0000","last_became_active":"2024-09-15T22:51:14.981473+0000","last_became_peered":"2024-09-15T22:51:14.981473+0000","last_unstale":"2024-09-15T22:51:16.960608+0000","last_undegraded":"2024-09-15T22:51:16.960608+0000","last_fullsized":"2024-09-15T22:51:16.960608+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:02.426844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.961095+0000","last_change":"2024-09-15T22:51:15.973207+0000","last_active":"2024-09-15T22:51:16.961095+0000","last_peered":"2024-09-15T22:51:16.961095+0000","last_clean":"2024-09-15T22:51:16.961095+0000","last_became_active":"2024-09-15T22:51:15.972882+0000","last_became_peered":"2024-09-15T22:51:15.972882+0000","last_unstale":"2024-09-15T22:51:16.961095+0000","last_undegraded":"2024-09-15T22:51:16.961095+0000","last_fullsized":"2024-09-15T22:51:16.961095+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:37:19.087500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273135+0000","last_change":"2024-09-15T22:51:14.975951+0000","last_active":"2024-09-15T22:51:17.273135+0000","last_peered":"2024-09-15T22:51:17.273135+0000","last_clean":"2024-09-15T22:51:17.273135+0000","last_became_active":"2024-09-15T22:51:14.975646+0000","last_became_peered":"2024-09-15T22:51:14.975646+0000","last_unstale":"2024-09-15T22:51:17.273135+0000","last_undegraded":"2024-09-15T22:51:17.273135+0000","last_fullsized":"2024-09-15T22:51:17.273135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272785+0000","last_change":"2024-09-15T22:51:15.980141+0000","last_active":"2024-09-15T22:51:17.272785+0000","last_peered":"2024-09-15T22:51:17.272785+0000","last_clean":"2024-09-15T22:51:17.272785+0000","last_became_active":"2024-09-15T22:51:15.979753+0000","last_became_peered":"2024-09-15T22:51:15.979753+0000","last_unstale":"2024-09-15T22:51:17.272785+0000","last_undegraded":"2024-09-15T22:51:17.272785+0000","last_fullsized":"2024-09-15T22:51:17.272785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959074+0000","last_change":"2024-09-15T22:51:14.984134+0000","last_active":"2024-09-15T22:51:16.959074+0000","last_peered":"2024-09-15T22:51:16.959074+0000","last_clean":"2024-09-15T22:51:16.959074+0000","last_became_active":"2024-09-15T22:51:14.983836+0000","last_became_peered":"2024-09-15T22:51:14.983836+0000","last_unstale":"2024-09-15T22:51:16.959074+0000","last_undegraded":"2024-09-15T22:51:16.959074+0000","last_fullsized":"2024-09-15T22:51:16.959074+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:37:31.024552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959141+0000","last_change":"2024-09-15T22:51:15.973591+0000","last_active":"2024-09-15T22:51:16.959141+0000","last_peered":"2024-09-15T22:51:16.959141+0000","last_clean":"2024-09-15T22:51:16.959141+0000","last_became_active":"2024-09-15T22:51:15.973400+0000","last_became_peered":"2024-09-15T22:51:15.973400+0000","last_unstale":"2024-09-15T22:51:16.959141+0000","last_undegraded":"2024-09-15T22:51:16.959141+0000","last_fullsized":"2024-09-15T22:51:16.959141+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:45.849466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271563+0000","last_change":"2024-09-15T22:51:14.976515+0000","last_active":"2024-09-15T22:51:17.271563+0000","last_peered":"2024-09-15T22:51:17.271563+0000","last_clean":"2024-09-15T22:51:17.271563+0000","last_became_active":"2024-09-15T22:51:14.976095+0000","last_became_peered":"2024-09-15T22:51:14.976095+0000","last_unstale":"2024-09-15T22:51:17.271563+0000","last_undegraded":"2024-09-15T22:51:17.271563+0000","last_fullsized":"2024-09-15T22:51:17.271563+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272445+0000","last_change":"2024-09-15T22:51:15.991358+0000","last_active":"2024-09-15T22:51:17.272445+0000","last_peered":"2024-09-15T22:51:17.272445+0000","last_clean":"2024-09-15T22:51:17.272445+0000","last_became_active":"2024-09-15T22:51:15.991092+0000","last_became_peered":"2024-09-15T22:51:15.991092+0000","last_unstale":"2024-09-15T22:51:17.272445+0000","last_undegraded":"2024-09-15T22:51:17.272445+0000","last_fullsized":"2024-09-15T22:51:17.272445+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:21:01.755329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958672+0000","last_change":"2024-09-15T22:51:14.970136+0000","last_active":"2024-09-15T22:51:16.958672+0000","last_peered":"2024-09-15T22:51:16.958672+0000","last_clean":"2024-09-15T22:51:16.958672+0000","last_became_active":"2024-09-15T22:51:14.969847+0000","last_became_peered":"2024-09-15T22:51:14.969847+0000","last_unstale":"2024-09-15T22:51:16.958672+0000","last_undegraded":"2024-09-15T22:51:16.958672+0000","last_fullsized":"2024-09-15T22:51:16.958672+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:34:50.714579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005900+0000","last_change":"2024-09-15T22:51:15.991833+0000","last_active":"2024-09-15T22:51:17.005900+0000","last_peered":"2024-09-15T22:51:17.005900+0000","last_clean":"2024-09-15T22:51:17.005900+0000","last_became_active":"2024-09-15T22:51:15.991493+0000","last_became_peered":"2024-09-15T22:51:15.991493+0000","last_unstale":"2024-09-15T22:51:17.005900+0000","last_undegraded":"2024-09-15T22:51:17.005900+0000","last_fullsized":"2024-09-15T22:51:17.005900+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958594+0000","last_change":"2024-09-15T22:51:14.972795+0000","last_active":"2024-09-15T22:51:16.958594+0000","last_peered":"2024-09-15T22:51:16.958594+0000","last_clean":"2024-09-15T22:51:16.958594+0000","last_became_active":"2024-09-15T22:51:14.972530+0000","last_became_peered":"2024-09-15T22:51:14.972530+0000","last_unstale":"2024-09-15T22:51:16.958594+0000","last_undegraded":"2024-09-15T22:51:16.958594+0000","last_fullsized":"2024-09-15T22:51:16.958594+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:54:04.280878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960169+0000","last_change":"2024-09-15T22:51:15.978730+0000","last_active":"2024-09-15T22:51:16.960169+0000","last_peered":"2024-09-15T22:51:16.960169+0000","last_clean":"2024-09-15T22:51:16.960169+0000","last_became_active":"2024-09-15T22:51:15.974000+0000","last_became_peered":"2024-09-15T22:51:15.974000+0000","last_unstale":"2024-09-15T22:51:16.960169+0000","last_undegraded":"2024-09-15T22:51:16.960169+0000","last_fullsized":"2024-09-15T22:51:16.960169+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:37.790013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272918+0000","last_change":"2024-09-15T22:51:14.986927+0000","last_active":"2024-09-15T22:51:17.272918+0000","last_peered":"2024-09-15T22:51:17.272918+0000","last_clean":"2024-09-15T22:51:17.272918+0000","last_became_active":"2024-09-15T22:51:14.986593+0000","last_became_peered":"2024-09-15T22:51:14.986593+0000","last_unstale":"2024-09-15T22:51:17.272918+0000","last_undegraded":"2024-09-15T22:51:17.272918+0000","last_fullsized":"2024-09-15T22:51:17.272918+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:18:42.762759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084756+0000","last_change":"2024-09-15T22:51:15.985692+0000","last_active":"2024-09-15T22:51:17.084756+0000","last_peered":"2024-09-15T22:51:17.084756+0000","last_clean":"2024-09-15T22:51:17.084756+0000","last_became_active":"2024-09-15T22:51:15.978277+0000","last_became_peered":"2024-09-15T22:51:15.978277+0000","last_unstale":"2024-09-15T22:51:17.084756+0000","last_undegraded":"2024-09-15T22:51:17.084756+0000","last_fullsized":"2024-09-15T22:51:17.084756+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:55:13.370477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.958457+0000","last_change":"2024-09-15T22:51:14.969964+0000","last_active":"2024-09-15T22:51:16.958457+0000","last_peered":"2024-09-15T22:51:16.958457+0000","last_clean":"2024-09-15T22:51:16.958457+0000","last_became_active":"2024-09-15T22:51:14.969593+0000","last_became_peered":"2024-09-15T22:51:14.969593+0000","last_unstale":"2024-09-15T22:51:16.958457+0000","last_undegraded":"2024-09-15T22:51:16.958457+0000","last_fullsized":"2024-09-15T22:51:16.958457+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:47:05.355838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271516+0000","last_change":"2024-09-15T22:51:15.986341+0000","last_active":"2024-09-15T22:51:17.271516+0000","last_peered":"2024-09-15T22:51:17.271516+0000","last_clean":"2024-09-15T22:51:17.271516+0000","last_became_active":"2024-09-15T22:51:15.986044+0000","last_became_peered":"2024-09-15T22:51:15.986044+0000","last_unstale":"2024-09-15T22:51:17.271516+0000","last_undegraded":"2024-09-15T22:51:17.271516+0000","last_fullsized":"2024-09-15T22:51:17.271516+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:33:32.867122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960795+0000","last_change":"2024-09-15T22:51:14.981097+0000","last_active":"2024-09-15T22:51:16.960795+0000","last_peered":"2024-09-15T22:51:16.960795+0000","last_clean":"2024-09-15T22:51:16.960795+0000","last_became_active":"2024-09-15T22:51:14.980807+0000","last_became_peered":"2024-09-15T22:51:14.980807+0000","last_unstale":"2024-09-15T22:51:16.960795+0000","last_undegraded":"2024-09-15T22:51:16.960795+0000","last_fullsized":"2024-09-15T22:51:16.960795+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:29:16.007982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273563+0000","last_change":"2024-09-15T22:51:15.985023+0000","last_active":"2024-09-15T22:51:17.273563+0000","last_peered":"2024-09-15T22:51:17.273563+0000","last_clean":"2024-09-15T22:51:17.273563+0000","last_became_active":"2024-09-15T22:51:15.984704+0000","last_became_peered":"2024-09-15T22:51:15.984704+0000","last_unstale":"2024-09-15T22:51:17.273563+0000","last_undegraded":"2024-09-15T22:51:17.273563+0000","last_fullsized":"2024-09-15T22:51:17.273563+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:30:43.741896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"39'1","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.959027+0000","last_change":"2024-09-15T22:51:14.973168+0000","last_active":"2024-09-15T22:51:16.959027+0000","last_peered":"2024-09-15T22:51:16.959027+0000","last_clean":"2024-09-15T22:51:16.959027+0000","last_became_active":"2024-09-15T22:51:14.972888+0000","last_became_peered":"2024-09-15T22:51:14.972888+0000","last_unstale":"2024-09-15T22:51:16.959027+0000","last_undegraded":"2024-09-15T22:51:16.959027+0000","last_fullsized":"2024-09-15T22:51:16.959027+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:58:18.635455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084690+0000","last_change":"2024-09-15T22:51:15.972891+0000","last_active":"2024-09-15T22:51:17.084690+0000","last_peered":"2024-09-15T22:51:17.084690+0000","last_clean":"2024-09-15T22:51:17.084690+0000","last_became_active":"2024-09-15T22:51:15.972625+0000","last_became_peered":"2024-09-15T22:51:15.972625+0000","last_unstale":"2024-09-15T22:51:17.084690+0000","last_undegraded":"2024-09-15T22:51:17.084690+0000","last_fullsized":"2024-09-15T22:51:17.084690+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:17:42.097735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006172+0000","last_change":"2024-09-15T22:51:14.977285+0000","last_active":"2024-09-15T22:51:17.006172+0000","last_peered":"2024-09-15T22:51:17.006172+0000","last_clean":"2024-09-15T22:51:17.006172+0000","last_became_active":"2024-09-15T22:51:14.976967+0000","last_became_peered":"2024-09-15T22:51:14.976967+0000","last_unstale":"2024-09-15T22:51:17.006172+0000","last_undegraded":"2024-09-15T22:51:17.006172+0000","last_fullsized":"2024-09-15T22:51:17.006172+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.005955+0000","last_change":"2024-09-15T22:51:15.983908+0000","last_active":"2024-09-15T22:51:17.005955+0000","last_peered":"2024-09-15T22:51:17.005955+0000","last_clean":"2024-09-15T22:51:17.005955+0000","last_became_active":"2024-09-15T22:51:15.983403+0000","last_became_peered":"2024-09-15T22:51:15.983403+0000","last_unstale":"2024-09-15T22:51:17.005955+0000","last_undegraded":"2024-09-15T22:51:17.005955+0000","last_fullsized":"2024-09-15T22:51:17.005955+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:52:58.885471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.006120+0000","last_change":"2024-09-15T22:51:14.974881+0000","last_active":"2024-09-15T22:51:17.006120+0000","last_peered":"2024-09-15T22:51:17.006120+0000","last_clean":"2024-09-15T22:51:17.006120+0000","last_became_active":"2024-09-15T22:51:14.974621+0000","last_became_peered":"2024-09-15T22:51:14.974621+0000","last_unstale":"2024-09-15T22:51:17.006120+0000","last_undegraded":"2024-09-15T22:51:17.006120+0000","last_fullsized":"2024-09-15T22:51:17.006120+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:16:51.648489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.271393+0000","last_change":"2024-09-15T22:51:15.980723+0000","last_active":"2024-09-15T22:51:17.271393+0000","last_peered":"2024-09-15T22:51:17.271393+0000","last_clean":"2024-09-15T22:51:17.271393+0000","last_became_active":"2024-09-15T22:51:15.980235+0000","last_became_peered":"2024-09-15T22:51:15.980235+0000","last_unstale":"2024-09-15T22:51:17.271393+0000","last_undegraded":"2024-09-15T22:51:17.271393+0000","last_fullsized":"2024-09-15T22:51:17.271393+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960658+0000","last_change":"2024-09-15T22:51:14.975174+0000","last_active":"2024-09-15T22:51:16.960658+0000","last_peered":"2024-09-15T22:51:16.960658+0000","last_clean":"2024-09-15T22:51:16.960658+0000","last_became_active":"2024-09-15T22:51:14.974907+0000","last_became_peered":"2024-09-15T22:51:14.974907+0000","last_unstale":"2024-09-15T22:51:16.960658+0000","last_undegraded":"2024-09-15T22:51:16.960658+0000","last_fullsized":"2024-09-15T22:51:16.960658+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272518+0000","last_change":"2024-09-15T22:51:15.974821+0000","last_active":"2024-09-15T22:51:17.272518+0000","last_peered":"2024-09-15T22:51:17.272518+0000","last_clean":"2024-09-15T22:51:17.272518+0000","last_became_active":"2024-09-15T22:51:15.974565+0000","last_became_peered":"2024-09-15T22:51:15.974565+0000","last_unstale":"2024-09-15T22:51:17.272518+0000","last_undegraded":"2024-09-15T22:51:17.272518+0000","last_fullsized":"2024-09-15T22:51:17.272518+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:52.219375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272242+0000","last_change":"2024-09-15T22:51:14.973229+0000","last_active":"2024-09-15T22:51:17.272242+0000","last_peered":"2024-09-15T22:51:17.272242+0000","last_clean":"2024-09-15T22:51:17.272242+0000","last_became_active":"2024-09-15T22:51:14.972952+0000","last_became_peered":"2024-09-15T22:51:14.972952+0000","last_unstale":"2024-09-15T22:51:17.272242+0000","last_undegraded":"2024-09-15T22:51:17.272242+0000","last_fullsized":"2024-09-15T22:51:17.272242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:34:09.667897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273056+0000","last_change":"2024-09-15T22:51:15.983534+0000","last_active":"2024-09-15T22:51:17.273056+0000","last_peered":"2024-09-15T22:51:17.273056+0000","last_clean":"2024-09-15T22:51:17.273056+0000","last_became_active":"2024-09-15T22:51:15.983225+0000","last_became_peered":"2024-09-15T22:51:15.983225+0000","last_unstale":"2024-09-15T22:51:17.273056+0000","last_undegraded":"2024-09-15T22:51:17.273056+0000","last_fullsized":"2024-09-15T22:51:17.273056+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:42:06.320582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.084361+0000","last_change":"2024-09-15T22:51:14.971981+0000","last_active":"2024-09-15T22:51:17.084361+0000","last_peered":"2024-09-15T22:51:17.084361+0000","last_clean":"2024-09-15T22:51:17.084361+0000","last_became_active":"2024-09-15T22:51:14.971568+0000","last_became_peered":"2024-09-15T22:51:14.971568+0000","last_unstale":"2024-09-15T22:51:17.084361+0000","last_undegraded":"2024-09-15T22:51:17.084361+0000","last_fullsized":"2024-09-15T22:51:17.084361+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:41:31.571097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:16.960547+0000","last_change":"2024-09-15T22:51:15.976778+0000","last_active":"2024-09-15T22:51:16.960547+0000","last_peered":"2024-09-15T22:51:16.960547+0000","last_clean":"2024-09-15T22:51:16.960547+0000","last_became_active":"2024-09-15T22:51:15.976531+0000","last_became_peered":"2024-09-15T22:51:15.976531+0000","last_unstale":"2024-09-15T22:51:16.960547+0000","last_undegraded":"2024-09-15T22:51:16.960547+0000","last_fullsized":"2024-09-15T22:51:16.960547+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:14.943289+0000","last_clean_scrub_stamp":"2024-09-15T22:51:14.943289+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:05:23.782432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.273206+0000","last_change":"2024-09-15T22:51:14.987009+0000","last_active":"2024-09-15T22:51:17.273206+0000","last_peered":"2024-09-15T22:51:17.273206+0000","last_clean":"2024-09-15T22:51:17.273206+0000","last_became_active":"2024-09-15T22:51:14.986692+0000","last_became_peered":"2024-09-15T22:51:14.986692+0000","last_unstale":"2024-09-15T22:51:17.273206+0000","last_undegraded":"2024-09-15T22:51:17.273206+0000","last_fullsized":"2024-09-15T22:51:17.273206+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:51:13.935150+0000","last_clean_scrub_stamp":"2024-09-15T22:51:13.935150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:52:44.841327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":203,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-09-15T22:51:17.272464+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:51:17.272464+0000","last_peered":"2024-09-15T22:51:17.272464+0000","last_clean":"2024-09-15T22:51:17.272464+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:51:17.272464+0000","last_undegraded":"2024-09-15T22:51:17.272464+0000","last_fullsized":"2024-09-15T22:51:17.272464+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28060,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343780,"statfs":{"total":96636764160,"available":96608030720,"internally_reserved":0,"allocated":1056768,"data_stored":785721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":194253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542162,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":193783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":194275,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542162,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27484,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344356,"statfs":{"total":96636764160,"available":96608620544,"internally_reserved":0,"allocated":462848,"data_stored":195317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542163,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27468,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344372,"statfs":{"total":96636764160,"available":96608636928,"internally_reserved":0,"allocated":450560,"data_stored":193741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542162,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":450560,"data_stored":193761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542161,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1020,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1044480,"data_stored":784073,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:51:25.050 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:51:25.050 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:51:25.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.232+0000 7f54fc600640 1 Processor -- start 2024-09-15T22:51:25.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.232+0000 7f54fc600640 1 -- start start 2024-09-15T22:51:25.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fc600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54f415ed40 0x7f54f40d0070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fc600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fc600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54f40ce310 con 0x7f54f41522d0 2024-09-15T22:51:25.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fc600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f54f40d0a00 con 0x7f54f415ed40 2024-09-15T22:51:25.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fc600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f54f415f1d0 con 0x7f54f40d05b0 2024-09-15T22:51:25.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54f415ed40 0x7f54f40d0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54f415ed40 0x7f54f40d0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42504/0 (socket says 172.21.15.31:42504) 2024-09-15T22:51:25.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 -- 172.21.15.31:0/4164370036 learned_addr learned my addr 172.21.15.31:0/4164370036 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:25.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 -- 172.21.15.31:0/4164370036 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 msgr2=0x7f54f415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fa600640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 -- 172.21.15.31:0/4164370036 >> v1:172.21.15.102:6789/0 conn(0x7f54f41522d0 legacy=0x7f54f40b4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54f9200640 1 -- 172.21.15.31:0/4164370036 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f40ce5f0 con 0x7f54f415ed40 2024-09-15T22:51:25.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.236+0000 7f54fa600640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:25.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54f9200640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f40d0070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009870 tx=0x7f54e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7b8e8241a403fa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54f3e00640 1 -- 172.21.15.31:0/4164370036 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e00b0070 con 0x7f54f415ed40 2024-09-15T22:51:25.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54f3e00640 1 -- 172.21.15.31:0/4164370036 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e00ab600 con 0x7f54f415ed40 2024-09-15T22:51:25.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54f3e00640 1 -- 172.21.15.31:0/4164370036 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54e00ab9d0 con 0x7f54f415ed40 2024-09-15T22:51:25.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- 172.21.15.31:0/4164370036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 msgr2=0x7f54f40d0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f40d0070 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f54e0009870 tx=0x7f54e001c520 comp rx=0 tx=0).stop 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- 172.21.15.31:0/4164370036 shutdown_connections 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- 172.21.15.31:0/4164370036 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f40d0070 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- 172.21.15.31:0/4164370036 >> 172.21.15.31:0/4164370036 conn(0x7f54f406be90 msgr2=0x7f54f406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- 172.21.15.31:0/4164370036 shutdown_connections 2024-09-15T22:51:25.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- 172.21.15.31:0/4164370036 wait complete. 2024-09-15T22:51:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 Processor -- start 2024-09-15T22:51:25.243 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- start start 2024-09-15T22:51:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f4099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54f41522d0 0x7f54f41f72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f54f40b3230 con 0x7f54f415ed40 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f54f40cdfe0 con 0x7f54f41522d0 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fc600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f54f40b33b0 con 0x7f54f40d05b0 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fa600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fa600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42518/0 (socket says 172.21.15.31:42518) 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.240+0000 7f54fa600640 1 -- 172.21.15.31:0/1506324420 learned_addr learned my addr 172.21.15.31:0/1506324420 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f9c00640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f4099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f9200640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54f41522d0 0x7f54f41f72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 -- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 msgr2=0x7f54f4099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f4099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 -- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54f41522d0 msgr2=0x7f54f41f72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54f41522d0 0x7f54f41f72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 -- 172.21.15.31:0/1506324420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54f4099ec0 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fa600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00cef0 tx=0x7f54ec00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec01a070 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec00d860 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54ec00dc50 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54f40ad0d0 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54f40ad690 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54f40cfc90 con 0x7f54f415ed40 2024-09-15T22:51:25.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54ec01d070 con 0x7f54f415ed40 2024-09-15T22:51:25.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 0x7f54d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.244+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f54ec0866d0 con 0x7f54f415ed40 2024-09-15T22:51:25.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.248+0000 7f54f9c00640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 0x7f54d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.248+0000 7f54f9c00640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 0x7f54d4069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54e8007fd0 tx=0x7f54e8007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.252+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54ec056a50 con 0x7f54f415ed40 2024-09-15T22:51:25.478 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.476+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f54f40b4fa0 con 0x7f54f415ed40 2024-09-15T22:51:25.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54f1600640 1 -- 172.21.15.31:0/1506324420 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) ==== 190+0+147 (secure 0 0 0) 0x7f54ec05ad50 con 0x7f54f415ed40 2024-09-15T22:51:25.481 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-15T22:51:25.482 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg== 2024-09-15T22:51:25.482 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-15T22:51:25.482 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-15T22:51:25.482 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:51:25.482 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 msgr2=0x7f54d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 0x7f54d4069d80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f54e8007fd0 tx=0x7f54e8007e40 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 msgr2=0x7f54f4150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f54ec00cef0 tx=0x7f54ec00a710 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 shutdown_connections 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f54d40678c0 0x7f54d4069d80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54f415ed40 0x7f54f4150500 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54f41522d0 0x7f54f41f72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 --2- 172.21.15.31:0/1506324420 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54f40d05b0 0x7f54f4099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 >> 172.21.15.31:0/1506324420 conn(0x7f54f406be90 msgr2=0x7f54f4072760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 shutdown_connections 2024-09-15T22:51:25.485 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.480+0000 7f54fc600640 1 -- 172.21.15.31:0/1506324420 wait complete. 2024-09-15T22:51:25.504 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:25.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 Processor -- start 2024-09-15T22:51:25.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 -- start start 2024-09-15T22:51:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80715a0 0x7f0ae80ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ae80cd8f0 0x7f0ae8070230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae809aa40 con 0x7f0ae8070770 2024-09-15T22:51:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0ae8071980 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aefa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae80cddd0 con 0x7f0ae80715a0 2024-09-15T22:51:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ae80cd8f0 0x7f0ae8070230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aed000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80715a0 0x7f0ae80ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0ae80cd8f0 0x7f0ae8070230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:58206/0 (socket says 172.21.15.31:58206) 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 -- 172.21.15.31:0/172144580 learned_addr learned my addr 172.21.15.31:0/172144580 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0aeda00640 1 --1- 172.21.15.31:0/172144580 >> v1:172.21.15.102:6789/0 conn(0x7f0ae8070770 0x7f0ae80d0890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:40968/0 (socket says 172.21.15.31:40968) 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 -- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80715a0 msgr2=0x7f0ae80ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 --2- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80715a0 0x7f0ae80ce850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 -- 172.21.15.31:0/172144580 >> v1:172.21.15.102:6789/0 conn(0x7f0ae8070770 legacy=0x7f0ae80d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0adfe00640 1 -- 172.21.15.31:0/172144580 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80ce0b0 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.644+0000 7f0ae7e00640 1 -- 172.21.15.31:0/172144580 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147476260 0 0) 0x7f0ae809aa40 con 0x7f0ae8070770 2024-09-15T22:51:25.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0adfe00640 1 --2- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80cd8f0 0x7f0ae8070230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad001c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fdb6d70fe726f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0ae7e00640 1 -- 172.21.15.31:0/172144580 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00a95f0 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0ae7e00640 1 -- 172.21.15.31:0/172144580 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad00a9790 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0ae7e00640 1 -- 172.21.15.31:0/172144580 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad00a9b60 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 -- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80cd8f0 msgr2=0x7f0ae8070230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 --2- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80cd8f0 0x7f0ae8070230 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0ad0009870 tx=0x7f0ad001c530 comp rx=0 tx=0).stop 2024-09-15T22:51:25.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 -- 172.21.15.31:0/172144580 shutdown_connections 2024-09-15T22:51:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 --2- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80cd8f0 0x7f0ae8070230 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 --2- 172.21.15.31:0/172144580 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80715a0 0x7f0ae80ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 -- 172.21.15.31:0/172144580 >> 172.21.15.31:0/172144580 conn(0x7f0ae80d23b0 msgr2=0x7f0ae80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 -- 172.21.15.31:0/172144580 shutdown_connections 2024-09-15T22:51:25.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.648+0000 7f0aefa00640 1 -- 172.21.15.31:0/172144580 wait complete. 2024-09-15T22:51:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 Processor -- start 2024-09-15T22:51:25.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- start start 2024-09-15T22:51:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80715a0 0x7f0ae81594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80cd8f0 0x7f0ae81574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae809be90 con 0x7f0ae8070770 2024-09-15T22:51:25.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ae809bd10 con 0x7f0ae80715a0 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ae80d0fa0 con 0x7f0ae80cd8f0 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42522/0 (socket says 172.21.15.31:42522) 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 -- 172.21.15.31:0/2318043996 learned_addr learned my addr 172.21.15.31:0/2318043996 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aeda00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80cd8f0 0x7f0ae81574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0adfe00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80715a0 0x7f0ae81594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 -- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80cd8f0 msgr2=0x7f0ae81574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80cd8f0 0x7f0ae81574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 -- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80715a0 msgr2=0x7f0ae81594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80715a0 0x7f0ae81594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 -- 172.21.15.31:0/2318043996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae80b6b10 con 0x7f0ae8070770 2024-09-15T22:51:25.656 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aed000640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e960 tx=0x7f0ad800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad8017070 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ad800ca00 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ad800cdb0 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae8159b30 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ae815a0f0 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.652+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ae8070230 con 0x7f0ae8070770 2024-09-15T22:51:25.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.656+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0ad801a070 con 0x7f0ae8070770 2024-09-15T22:51:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.656+0000 7f0ae5600640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 0x7f0ac4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.656+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f0ad8085e00 con 0x7f0ae8070770 2024-09-15T22:51:25.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.656+0000 7f0adfe00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 0x7f0ac4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:25.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.656+0000 7f0adfe00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 0x7f0ac4069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ae000 tx=0x7f0ad00a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:25.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.660+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0ad80560c0 con 0x7f0ae8070770 2024-09-15T22:51:25.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.856+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0ae80b3bc0 con 0x7f0ae8070770 2024-09-15T22:51:25.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.856+0000 7f0ae5600640 1 -- 172.21.15.31:0/2318043996 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7f0ad805a3c0 con 0x7f0ae8070770 2024-09-15T22:51:25.860 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:25.861 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"2024-09-15T22:51:18:986929+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3621432872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3621432872},{"type":"v1","addr":"172.21.15.31:6834","nonce":3621432872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2733624123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2733624123},{"type":"v1","addr":"172.21.15.102:6837","nonce":2733624123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3976047272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3976047272},{"type":"v1","addr":"172.21.15.102:6836","nonce":3976047272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:18.378937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4872":{"gid":4872,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3813108153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3813108153},{"type":"v1","addr":"172.21.15.31:6835","nonce":3813108153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4872,"qdb_cluster":[4872]},"id":2}]} 2024-09-15T22:51:25.861 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 msgr2=0x7f0ac4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 0x7f0ac4069db0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0ad00ae000 tx=0x7f0ad00a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 msgr2=0x7f0ae815abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0ad800e960 tx=0x7f0ad800ee20 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 shutdown_connections 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ac40678f0 0x7f0ac4069db0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ae80cd8f0 0x7f0ae81574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ae80715a0 0x7f0ae81594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 --2- 172.21.15.31:0/2318043996 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ae8070770 0x7f0ae815abd0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 >> 172.21.15.31:0/2318043996 conn(0x7f0ae80d23b0 msgr2=0x7f0ae80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 shutdown_connections 2024-09-15T22:51:25.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:25.860+0000 7f0aefa00640 1 -- 172.21.15.31:0/2318043996 wait complete. 2024-09-15T22:51:26.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:51:15.411968+0000', 'modified': '2024-09-15T22:51:18.378937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4872': {'gid': 4872, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3813108153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 3813108153}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3813108153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4872, 'qdb_cluster': [4872]} 2024-09-15T22:51:26.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:51:26.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:51:26.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 Processor -- start 2024-09-15T22:51:26.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 -- start start 2024-09-15T22:51:26.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ff409ae20 0x7f6ff409b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.431 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff4070510 con 0x7f6ff409aa40 2024-09-15T22:51:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff40d1cb0 con 0x7f6ff4164060 2024-09-15T22:51:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ffb400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6ff40cf590 con 0x7f6ff409ae20 2024-09-15T22:51:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ff409ae20 0x7f6ff409b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6ff409ae20 0x7f6ff409b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42528/0 (socket says 172.21.15.31:42528) 2024-09-15T22:51:26.432 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 -- 172.21.15.31:0/3656988740 learned_addr learned my addr 172.21.15.31:0/3656988740 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 -- 172.21.15.31:0/3656988740 >> v1:172.21.15.102:6789/0 conn(0x7f6ff4164060 legacy=0x7f6ff4166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 -- 172.21.15.31:0/3656988740 >> v1:172.21.15.31:6789/0 conn(0x7f6ff409aa40 legacy=0x7f6ff4071d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3e00640 1 -- 172.21.15.31:0/3656988740 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff40d1f90 con 0x7f6ff409ae20 2024-09-15T22:51:26.433 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.428+0000 7f6ff3400640 1 -- 172.21.15.31:0/3656988740 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4180310985 0 0) 0x7f6ff4070510 con 0x7f6ff409aa40 2024-09-15T22:51:26.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/3656988740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff409ae20 0x7f6ff409b270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009870 tx=0x7f6fe001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6dfb43545e176cfc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ff3400640 1 -- 172.21.15.31:0/3656988740 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00b5070 con 0x7f6ff409ae20 2024-09-15T22:51:26.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ff3400640 1 -- 172.21.15.31:0/3656988740 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fe00a8a50 con 0x7f6ff409ae20 2024-09-15T22:51:26.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ff3400640 1 -- 172.21.15.31:0/3656988740 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe00a8e20 con 0x7f6ff409ae20 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 -- 172.21.15.31:0/3656988740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff409ae20 msgr2=0x7f6ff409b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 --2- 172.21.15.31:0/3656988740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff409ae20 0x7f6ff409b270 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6fe0009870 tx=0x7f6fe001ed50 comp rx=0 tx=0).stop 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 -- 172.21.15.31:0/3656988740 shutdown_connections 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 --2- 172.21.15.31:0/3656988740 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff409ae20 0x7f6ff409b270 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 -- 172.21.15.31:0/3656988740 >> 172.21.15.31:0/3656988740 conn(0x7f6ff40b3ed0 msgr2=0x7f6ff40b42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 -- 172.21.15.31:0/3656988740 shutdown_connections 2024-09-15T22:51:26.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.432+0000 7f6ffb400640 1 -- 172.21.15.31:0/3656988740 wait complete. 2024-09-15T22:51:26.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 Processor -- start 2024-09-15T22:51:26.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- start start 2024-09-15T22:51:26.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff409aa40 0x7f6ff4157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff409ae20 0x7f6ff415db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40701c0 con 0x7f6ff4164060 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40d1270 con 0x7f6ff409aa40 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff40ce780 con 0x7f6ff409ae20 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42542/0 (socket says 172.21.15.31:42542) 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 -- 172.21.15.31:0/228634034 learned_addr learned my addr 172.21.15.31:0/228634034 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff409aa40 0x7f6ff4157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff409ae20 0x7f6ff415db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 -- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff409ae20 msgr2=0x7f6ff415db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff409ae20 0x7f6ff415db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 -- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff409aa40 msgr2=0x7f6ff4157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff409aa40 0x7f6ff4157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 -- 172.21.15.31:0/228634034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff415f4d0 con 0x7f6ff4164060 2024-09-15T22:51:26.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff9400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c730 tx=0x7f6fec00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff0c00640 1 -- 172.21.15.31:0/228634034 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec003b80 con 0x7f6ff4164060 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff0c00640 1 -- 172.21.15.31:0/228634034 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec003d20 con 0x7f6ff4164060 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ff0c00640 1 -- 172.21.15.31:0/228634034 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec00aa30 con 0x7f6ff4164060 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff415e430 con 0x7f6ff4164060 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.436+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ff415e9f0 con 0x7f6ff4164060 2024-09-15T22:51:26.442 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ff0c00640 1 -- 172.21.15.31:0/228634034 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6fec00abd0 con 0x7f6ff4164060 2024-09-15T22:51:26.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ff0c00640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 0x7f6fd4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ff0c00640 1 -- 172.21.15.31:0/228634034 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6fec085b90 con 0x7f6ff4164060 2024-09-15T22:51:26.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 0x7f6fd4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ffe741000 1 Processor -- start 2024-09-15T22:51:26.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ffe741000 1 -- start start 2024-09-15T22:51:26.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.440+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 0x7f6fd4069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f70 tx=0x7f6fe4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7e440 0x55cb4bd33d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bc1bb60 con 0x55cb4bd34290 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bb82c70 con 0x55cb4bd7db20 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55cb4bb28ed0 con 0x55cb4bd7e440 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42550/0 (socket says 172.21.15.31:42550) 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 -- 172.21.15.31:0/1922100837 learned_addr learned my addr 172.21.15.31:0/1922100837 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 -- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7e440 msgr2=0x55cb4bd33d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7e440 0x55cb4bd33d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 -- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 msgr2=0x55cb4bd7df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 -- 172.21.15.31:0/1922100837 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4bb3ae50 con 0x55cb4bd34290 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fec052340 tx=0x7f6fec055940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9376de767470d30 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6fe9600640 1 -- 172.21.15.31:0/1922100837 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec05ea10 con 0x55cb4bd34290 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6fe9600640 1 -- 172.21.15.31:0/1922100837 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0541e0 con 0x55cb4bd34290 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6fe9600640 1 -- 172.21.15.31:0/1922100837 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec055330 con 0x55cb4bd34290 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- 172.21.15.31:0/1922100837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 msgr2=0x55cb4bd34670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6fec052340 tx=0x7f6fec055940 comp rx=0 tx=0).stop 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- 172.21.15.31:0/1922100837 shutdown_connections 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd34290 0x55cb4bd34670 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7e440 0x55cb4bd33d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.448 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- 172.21.15.31:0/1922100837 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- 172.21.15.31:0/1922100837 >> 172.21.15.31:0/1922100837 conn(0x55cb4bd3a600 msgr2=0x55cb4bd32630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- 172.21.15.31:0/1922100837 shutdown_connections 2024-09-15T22:51:26.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- 172.21.15.31:0/1922100837 wait complete. 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- start start 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 Processor -- start 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bd38e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bd3ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bbe4b00 con 0x55cb4bd39390 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bb5d360 con 0x55cb4bd7e440 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55cb4bb5a2d0 con 0x55cb4bd7db20 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ffe741000 10 client.0 _ll_register_callbacks cb 0x55cb4bd1f820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.444+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42556/0 (socket says 172.21.15.31:42556) 2024-09-15T22:51:26.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 -- 172.21.15.31:0/2074280404 learned_addr learned my addr 172.21.15.31:0/2074280404 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bd3ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bd38e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 -- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 msgr2=0x55cb4bd38e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bd38e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 -- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 msgr2=0x55cb4bd3ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bd3ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 -- 172.21.15.31:0/2074280404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4bb29120 con 0x55cb4bd39390 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bd3ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff9400640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fec052340 tx=0x7f6fec001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd092bbe160c93c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:26.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec079060 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec0541e0 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6fec055330 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6fec05ea10 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 10 client.5070 fetch_fsmap learned FSMap version 17 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cb4bb22450 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec0541e0 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f6fec085050 con 0x55cb4bd39390 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 10 client.5070 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 10 client.5070 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 20 client.5070 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bd8c280 0x55cb4bd8e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 4 client.5070 mds_command: new command op to 4872 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:26.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 --> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb4bb1cc00 con 0x55cb4bd8c280 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bd8c280 0x55cb4bd8e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bd8c280 0x55cb4bd8e670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1171745e9958525c server_cookie=c3257b7197041bf8 in_seq=0 out_seq=0 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 10 client.5070 ms_handle_connect on v2:172.21.15.31:6833/3813108153 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 1 -- 172.21.15.31:0/2074280404 <== mds.0 v2:172.21.15.31:6833/3813108153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb4bb1cc00 con 0x55cb4bd8c280 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 10 client.5070 handle_command_reply: tid=0 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 client.5070 shutdown 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 msgr2=0x55cb4bd3f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6fec052340 tx=0x7f6fec001260 comp rx=0 tx=0).stop 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 shutdown_connections 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bd8c280 0x55cb4bd8e670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd3f230 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bd3ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2074280404 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bd38e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 >> 172.21.15.31:0/2074280404 conn(0x55cb4bd34290 msgr2=0x55cb4bd32d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6fde000640 0 client.5070 ms_handle_reset on v2:172.21.15.31:6833/3813108153 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 shutdown_connections 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 1 -- 172.21.15.31:0/2074280404 wait complete. 2024-09-15T22:51:26.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.448+0000 7f6ffe741000 20 client.5070 trim_cache size 0 max 16384 2024-09-15T22:51:26.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 Processor -- start 2024-09-15T22:51:26.471 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 -- start start 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd39390 0x55cb4bd7ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff4200060 con 0x55cb4bd7e440 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6ff40b2e90 con 0x55cb4bd7db20 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6ff40b34e0 con 0x55cb4bd39390 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ff9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42570/0 (socket says 172.21.15.31:42570) 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ff9400640 1 -- 172.21.15.31:0/3550185313 learned_addr learned my addr 172.21.15.31:0/3550185313 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd39390 0x55cb4bd7ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.468+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 -- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd39390 msgr2=0x55cb4bd7ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd39390 0x55cb4bd7ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 -- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 msgr2=0x55cb4bd7d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 -- 172.21.15.31:0/3550185313 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb4bb09fd0 con 0x55cb4bd7e440 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fec055910 tx=0x7f6fec083000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5769838742cfbbee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6fe8c00640 1 -- 172.21.15.31:0/3550185313 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec0742c0 con 0x55cb4bd7e440 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6fe8c00640 1 -- 172.21.15.31:0/3550185313 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec055330 con 0x55cb4bd7e440 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6fe8c00640 1 -- 172.21.15.31:0/3550185313 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fec05c3e0 con 0x55cb4bd7e440 2024-09-15T22:51:26.475 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- 172.21.15.31:0/3550185313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 msgr2=0x55cb4bd8e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6fec055910 tx=0x7f6fec083000 comp rx=0 tx=0).stop 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- 172.21.15.31:0/3550185313 shutdown_connections 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd7e440 0x55cb4bd8e670 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7db20 0x55cb4bd7d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- 172.21.15.31:0/3550185313 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd39390 0x55cb4bd7ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- 172.21.15.31:0/3550185313 >> 172.21.15.31:0/3550185313 conn(0x55cb4bd34290 msgr2=0x55cb4bd38650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- 172.21.15.31:0/3550185313 shutdown_connections 2024-09-15T22:51:26.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- 172.21.15.31:0/3550185313 wait complete. 2024-09-15T22:51:26.480 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- start start 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 Processor -- start 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bdac960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bdacea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bb81f80 con 0x55cb4bd39390 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55cb4bb3aca0 con 0x55cb4bd7e440 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55cb4bb872a0 con 0x55cb4bd7db20 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ffe741000 10 client.0 _ll_register_callbacks cb 0x7f6fec055840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42582/0 (socket says 172.21.15.31:42582) 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 -- 172.21.15.31:0/2559273801 learned_addr learned my addr 172.21.15.31:0/2559273801 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bdac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.481 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bdacea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 -- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 msgr2=0x55cb4bdac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bdac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 -- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 msgr2=0x55cb4bdacea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bdacea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 -- 172.21.15.31:0/2559273801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb4bc05750 con 0x55cb4bd39390 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff9400640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bdacea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6ff8a00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55cb4bb415c0 tx=0x7f6fe4007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911543dbd1e191f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.472+0000 7f6fde000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4030060 con 0x55cb4bd39390 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f6fe401e040 con 0x55cb4bd39390 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fec055330 con 0x55cb4bd39390 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6fe4036050 con 0x55cb4bd39390 2024-09-15T22:51:26.482 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 10 client.5076 fetch_fsmap learned FSMap version 17 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) -- 0x55cb4bb10a30 con 0x55cb4bd39390 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6fec055330 con 0x55cb4bd39390 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 17) ==== 3502+0+0 (secure 0 0 0) 0x7f6fe4039020 con 0x55cb4bd39390 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 10 client.5076 fetch_fsmap finished waiting for FSMap version 17 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 10 client.5076 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 20 client.5076 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bdad3e0 0x55cb4bdf0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 4 client.5076 mds_command: new command op to 4872 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 --> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] -- command(tid 0: {"prefix": "status"}) -- 0x55cb4bb903a0 con 0x55cb4bdad3e0 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bdad3e0 0x55cb4bdf0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ff3e00640 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bdad3e0 0x55cb4bdf0c00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e823fdd0054c8e61 server_cookie=dee2e9210ae6fd4d in_seq=0 out_seq=0 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 10 client.5076 ms_handle_connect on v2:172.21.15.31:6833/3813108153 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 1 -- 172.21.15.31:0/2559273801 <== mds.0 v2:172.21.15.31:6833/3813108153 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55cb4bb903a0 con 0x55cb4bdad3e0 2024-09-15T22:51:26.483 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 10 client.5076 handle_command_reply: tid=0 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 client.5076 shutdown 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 msgr2=0x55cb4bd91590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x55cb4bb415c0 tx=0x7f6fe4007d10 comp rx=0 tx=0).stop 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 shutdown_connections 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:6833/3813108153,v1:172.21.15.31:6835/3813108153] conn(0x55cb4bdad3e0 0x55cb4bdf0c00 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55cb4bd7e440 0x55cb4bdacea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55cb4bd7db20 0x55cb4bdac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 --2- 172.21.15.31:0/2559273801 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55cb4bd39390 0x55cb4bd91590 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 >> 172.21.15.31:0/2559273801 conn(0x55cb4bd34290 msgr2=0x55cb4bd7bcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6fde000640 0 client.5076 ms_handle_reset on v2:172.21.15.31:6833/3813108153 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 shutdown_connections 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 1 -- 172.21.15.31:0/2559273801 wait complete. 2024-09-15T22:51:26.484 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffe741000 20 client.5076 trim_cache size 0 max 16384 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 4872, 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 10.505675596, 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 17, 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 39, 2024-09-15T22:51:26.485 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 39, 2024-09-15T22:51:26.486 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 17.376696073000002 2024-09-15T22:51:26.486 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:51:26.486 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 msgr2=0x7f6fd4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 0x7f6fd4069d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000f70 tx=0x7f6fe4009040 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 msgr2=0x7f6ff406daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6fec00c730 tx=0x7f6fec00cbf0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 shutdown_connections 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6fd40678c0 0x7f6fd4069d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6ff4164060 0x7f6ff406daa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6ff409ae20 0x7f6ff415db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 --2- 172.21.15.31:0/228634034 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6ff409aa40 0x7f6ff4157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 >> 172.21.15.31:0/228634034 conn(0x7f6ff40b3ed0 msgr2=0x7f6ff40b57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 shutdown_connections 2024-09-15T22:51:26.487 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.476+0000 7f6ffb400640 1 -- 172.21.15.31:0/228634034 wait complete. 2024-09-15T22:51:26.500 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:51:26.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 Processor -- start 2024-09-15T22:51:26.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 -- start start 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f8928159240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8928073630 con 0x7f89280cee60 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f892815cf10 con 0x7f89280b2610 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f892cc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8928072190 con 0x7f89280af390 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8927400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f89280cee60 0x7f892815c600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38038/0 (socket says 172.21.15.31:38038) 2024-09-15T22:51:26.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8927400640 1 -- 172.21.15.31:0/3148937780 learned_addr learned my addr 172.21.15.31:0/3148937780 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8927e00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f8928159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 391473405 0 0) 0x7f8928073630 con 0x7f89280cee60 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f890c003530 con 0x7f89280cee60 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920367763 0 0) 0x7f892815cf10 con 0x7f89280b2610 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8928073630 con 0x7f89280b2610 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3508974356 0 0) 0x7f890c003530 con 0x7f89280cee60 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 msgr2=0x7f8928159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f8928159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 >> v1:172.21.15.102:6789/0 conn(0x7f89280b2610 legacy=0x7f89280aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892815d1f0 con 0x7f89280cee60 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f89180016a0 con 0x7f89280cee60 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 >> v1:172.21.15.31:6789/0 conn(0x7f89280cee60 legacy=0x7f892815c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c003b80 0x7f890c003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f890c004810 0x7f890c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f890c005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8928072190 con 0x7f890c004810 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f890c00bb60 con 0x7f890c003b80 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f890c00bd30 con 0x7f89280af390 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f890c004810 0x7f890c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8927400640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c003b80 0x7f890c003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f8927e00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f890c005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 -- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 msgr2=0x7f890c005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f89280af390 0x7f890c005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 -- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c003b80 msgr2=0x7f890c003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c003b80 0x7f890c003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.640+0000 7f891ea00640 1 -- 172.21.15.31:0/3148937780 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c003530 con 0x7f890c004810 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f891ea00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f890c004810 0x7f890c004c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8910001900 tx=0x7f891001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddda918cf9b6efc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910001520 con 0x7f890c004810 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89100052f0 con 0x7f890c004810 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f8926a00640 1 -- 172.21.15.31:0/3148937780 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910003840 con 0x7f890c004810 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 -- 172.21.15.31:0/3148937780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f890c004810 msgr2=0x7f890c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 --2- 172.21.15.31:0/3148937780 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f890c004810 0x7f890c004c90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8910001900 tx=0x7f891001c580 comp rx=0 tx=0).stop 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f8927e00640 1 -- 172.21.15.31:0/3148937780 reap_dead start 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 -- 172.21.15.31:0/3148937780 shutdown_connections 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 -- 172.21.15.31:0/3148937780 >> 172.21.15.31:0/3148937780 conn(0x7f892806c2c0 msgr2=0x7f89280b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 -- 172.21.15.31:0/3148937780 shutdown_connections 2024-09-15T22:51:26.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.644+0000 7f892cc00640 1 -- 172.21.15.31:0/3148937780 wait complete. 2024-09-15T22:51:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 Processor -- start 2024-09-15T22:51:26.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- start start 2024-09-15T22:51:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c004810 0x7f892815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8928155f00 0x7f89280cda00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8928159a50 con 0x7f8928156dd0 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f89280b3520 con 0x7f890c004810 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8928159bd0 con 0x7f8928155f00 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42602/0 (socket says 172.21.15.31:42602) 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 -- 172.21.15.31:0/333327002 learned_addr learned my addr 172.21.15.31:0/333327002 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f8927400640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c004810 0x7f892815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f8927e00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8928155f00 0x7f89280cda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 -- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8928155f00 msgr2=0x7f89280cda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8928155f00 0x7f89280cda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 -- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c004810 msgr2=0x7f892815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c004810 0x7f892815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 -- 172.21.15.31:0/333327002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f892806f370 con 0x7f8928156dd0 2024-09-15T22:51:26.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891ea00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f89100ad040 tx=0x7f890c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89100054a0 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8910001500 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8910003e40 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f892806f650 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.648+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8928157250 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8928159fa0 con 0x7f8928156dd0 2024-09-15T22:51:26.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f89100067e0 con 0x7f8928156dd0 2024-09-15T22:51:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f891fe00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 0x7f8904069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f89101203d0 con 0x7f8928156dd0 2024-09-15T22:51:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f8927400640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 0x7f8904069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:26.655 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.652+0000 7f8927400640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 0x7f8904069db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8918001230 tx=0x7f8918001d80 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:26.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.656+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f89100bb020 con 0x7f8928156dd0 2024-09-15T22:51:26.860 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.856+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f89280cf450 con 0x7f8928156dd0 2024-09-15T22:51:26.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f891fe00640 1 -- 172.21.15.31:0/333327002 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+73 (secure 0 0 0) 0x7f8910016290 con 0x7f8928156dd0 2024-09-15T22:51:26.861 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 msgr2=0x7f8904069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 0x7f8904069db0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8918001230 tx=0x7f8918001d80 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 msgr2=0x7f89281fa760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f89100ad040 tx=0x7f890c005840 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 shutdown_connections 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f89040678f0 0x7f8904069db0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8928155f00 0x7f89280cda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8928156dd0 0x7f89281fa760 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 --2- 172.21.15.31:0/333327002 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f890c004810 0x7f892815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:26.863 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 >> 172.21.15.31:0/333327002 conn(0x7f892806c2c0 msgr2=0x7f8928165020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 shutdown_connections 2024-09-15T22:51:26.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:26.860+0000 7f892cc00640 1 -- 172.21.15.31:0/333327002 wait complete. 2024-09-15T22:51:26.881 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:51:26.881 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:51:26.881 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:51:26.882 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:51:26.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:26.882 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-15T22:51:26.892 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:51:26.892 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:51:26.892 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:51:26.892 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-15T22:51:26.893 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42385sec preferred_lft 42385sec 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:d8:cd:ab:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:51:26.894 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:51:26.895 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:51:26.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:26.896 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:51:26.954 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-15T22:51:26.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:26.956 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:51:27.010 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:51:27.011 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:51:27.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:51:27.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:51:27.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:27.152 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:51:27.162 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:51:27.162 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:51:27.162 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:51:27.162 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:27.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-15T22:51:27.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:51:27.229 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:51:27.285 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:51:27.285 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:51:27.285 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:51:27.340 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:51:27.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:27.340 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:51:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:51:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:51:27.430 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:51:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:51:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:51:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:51:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:51:27.445 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:51:27.454 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:51:27.455 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:51:27.458 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:51:27.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:27.459 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:51:27.479 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:51:27.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:51:27.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:51:27.584 INFO:teuthology.orchestra.run.smithi031.stdout:client4984 2024-09-15T22:51:27.584 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:27.584 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:27.594 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:51:27.643 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.683 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:51:27.684 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:51:27.685 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-15T22:51:27.686 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.687 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-15T22:51:27.688 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:51:27.689 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:51:27.690 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-15T22:51:27.691 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.692 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-15T22:51:27.693 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:51:27.694 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:51:27.695 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-15T22:51:27.695 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-15T22:51:27.695 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-09-15T22:51:27.696 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:51:27.697 INFO:teuthology.orchestra.run.smithi031.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.698 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.699 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.700 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.701 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.702 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-15T22:51:27.703 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:51:27.704 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:51:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:51:27.706 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:51:27.707 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-15T22:51:27.708 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-15T22:51:27.709 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:51:27.710 INFO:teuthology.orchestra.run.smithi102.stdout: osd_deep_scrub_large_omap_object_key_threshold = 5 2024-09-15T22:51:27.712 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:51:27.712 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:51:27.712 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:51:27.712 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:27.712 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:51:27.712 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:51:27.712 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:51:27.713 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:27.713 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:51:27.713 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:51:27.713 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:51:27.713 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:27.713 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:51:27.713 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:51:27.714 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:51:27.714 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:51:27.770 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:51:27.771 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:51:27.772 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:51:27.772 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:51:27.773 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:51:27.773 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:51:27.774 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:51:27.774 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:51:27.818 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:51:27.819 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:27.819 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:51:27.819 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:27.821 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:51:27.821 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:27.822 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:51:27.822 DEBUG:teuthology.parallel:result is None 2024-09-15T22:51:27.822 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:27.905 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:51:27.906 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-15T22:51:27.906 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-15T22:51:27.907 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:51:27.907 INFO:tasks.ceph.mds.b.smithi102.stderr:2024-09-15T22:51:27.903+0000 7f71c8200640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2024-09-15T22:51:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 Processor -- start 2024-09-15T22:51:27.970 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 -- start start 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f81f8159ef0 0x7f81f80aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f815d420 0x7f81f80d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f80af830 con 0x7f81f80cf7f0 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f81f80afb10 con 0x7f81f8159ef0 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81fde00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f81f815c940 con 0x7f81f815d420 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f81f8159ef0 0x7f81f80aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f81f8159ef0 0x7f81f80aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42646/0 (socket says 172.21.15.31:42646) 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 -- 172.21.15.31:0/1243065137 learned_addr learned my addr 172.21.15.31:0/1243065137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f7400640 1 --1- 172.21.15.31:0/1243065137 >> v1:172.21.15.31:6789/0 conn(0x7f81f80cf7f0 0x7f81f815fd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38064/0 (socket says 172.21.15.31:38064) 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6000640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f815d420 0x7f81f80d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 -- 172.21.15.31:0/1243065137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f815d420 msgr2=0x7f81f80d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f815d420 0x7f81f80d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 -- 172.21.15.31:0/1243065137 >> v1:172.21.15.31:6789/0 conn(0x7f81f80cf7f0 legacy=0x7f81f815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f6a00640 1 -- 172.21.15.31:0/1243065137 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f815cc20 con 0x7f81f8159ef0 2024-09-15T22:51:27.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.968+0000 7f81f5600640 1 -- 172.21.15.31:0/1243065137 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568345155 0 0) 0x7f81f80af830 con 0x7f81f80cf7f0 2024-09-15T22:51:27.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81f6a00640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f8159ef0 0x7f81f80aef00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009870 tx=0x7f81e801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e2c4912625c05d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81f5600640 1 -- 172.21.15.31:0/1243065137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80ab640 con 0x7f81f8159ef0 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81f5600640 1 -- 172.21.15.31:0/1243065137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e80b0070 con 0x7f81f8159ef0 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81f5600640 1 -- 172.21.15.31:0/1243065137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e80aba00 con 0x7f81f8159ef0 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 -- 172.21.15.31:0/1243065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f8159ef0 msgr2=0x7f81f80aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f8159ef0 0x7f81f80aef00 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f81e8009870 tx=0x7f81e801c530 comp rx=0 tx=0).stop 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 -- 172.21.15.31:0/1243065137 shutdown_connections 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f815d420 0x7f81f80d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 --2- 172.21.15.31:0/1243065137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f8159ef0 0x7f81f80aef00 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 -- 172.21.15.31:0/1243065137 >> 172.21.15.31:0/1243065137 conn(0x7f81f80b20a0 msgr2=0x7f81f80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 -- 172.21.15.31:0/1243065137 shutdown_connections 2024-09-15T22:51:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.972+0000 7f81fde00640 1 -- 172.21.15.31:0/1243065137 wait complete. 2024-09-15T22:51:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 Processor -- start 2024-09-15T22:51:27.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- start start 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f80cf7f0 0x7f81f80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f8159ef0 0x7f81f81f67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8169290 con 0x7f81f815d420 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f81f8169110 con 0x7f81f80cf7f0 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f81f8169410 con 0x7f81f8159ef0 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42656/0 (socket says 172.21.15.31:42656) 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 -- 172.21.15.31:0/3857406554 learned_addr learned my addr 172.21.15.31:0/3857406554 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f6a00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f80cf7f0 0x7f81f80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f6000640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f8159ef0 0x7f81f81f67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 -- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f8159ef0 msgr2=0x7f81f81f67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f8159ef0 0x7f81f81f67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 -- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f80cf7f0 msgr2=0x7f81f80b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f80cf7f0 0x7f81f80b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 -- 172.21.15.31:0/3857406554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f80b0710 con 0x7f81f815d420 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81f7400640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c7a0 tx=0x7f81f000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f0018070 con 0x7f81f815d420 2024-09-15T22:51:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81f000a640 con 0x7f81f815d420 2024-09-15T22:51:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f81f6d00 con 0x7f81f815d420 2024-09-15T22:51:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81f000aa70 con 0x7f81f815d420 2024-09-15T22:51:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.976+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f8149860 con 0x7f81f815d420 2024-09-15T22:51:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f814bd40 con 0x7f81f815d420 2024-09-15T22:51:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f81f001b070 con 0x7f81f815d420 2024-09-15T22:51:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81ef400640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 0x7f81d8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 6101+0+0 (secure 0 0 0) 0x7f81f00854e0 con 0x7f81f815d420 2024-09-15T22:51:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81f6a00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 0x7f81d8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:27.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.980+0000 7f81f6a00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 0x7f81d8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81e80af000 tx=0x7f81e80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:27.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:27.984+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f81f0055710 con 0x7f81f815d420 2024-09-15T22:51:28.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.184+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81f80b4330 con 0x7f81f815d420 2024-09-15T22:51:28.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81ef400640 1 -- 172.21.15.31:0/3857406554 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+5229 (secure 0 0 0) 0x7f81f0059a10 con 0x7f81f815d420 2024-09-15T22:51:28.189 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:28.189 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":17,"btime":"2024-09-15T22:51:18:986929+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3621432872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3621432872},{"type":"v1","addr":"172.21.15.31:6834","nonce":3621432872}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4661,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2733624123","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2733624123},{"type":"v1","addr":"172.21.15.102:6837","nonce":2733624123}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":4825,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3976047272","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3976047272},{"type":"v1","addr":"172.21.15.102:6836","nonce":3976047272}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:18.378937+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4872},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4872":{"gid":4872,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/3813108153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3813108153},{"type":"v1","addr":"172.21.15.31:6835","nonce":3813108153}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4872,"qdb_cluster":[4872]},"id":2}]} 2024-09-15T22:51:28.189 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 17 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 msgr2=0x7f81d8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 0x7f81d8069d80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f81e80af000 tx=0x7f81e80a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 msgr2=0x7f81f814fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f81f000c7a0 tx=0x7f81f000cc60 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 shutdown_connections 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f81d80678c0 0x7f81d8069d80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f81f815d420 0x7f81f814fe10 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f81f8159ef0 0x7f81f81f67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 --2- 172.21.15.31:0/3857406554 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f81f80cf7f0 0x7f81f80b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 >> 172.21.15.31:0/3857406554 conn(0x7f81f80b20a0 msgr2=0x7f81f815e440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 shutdown_connections 2024-09-15T22:51:28.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.188+0000 7f81fde00640 1 -- 172.21.15.31:0/3857406554 wait complete. 2024-09-15T22:51:28.498 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-15T22:51:28.496+0000 7f89b1400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:51:28.613 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:51:15.411968+0000', 'modified': '2024-09-15T22:51:18.378937+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4872}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4872': {'gid': 4872, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/3813108153', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 3813108153}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 3813108153}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4872, 'qdb_cluster': [4872]} 2024-09-15T22:51:28.614 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:51:28.614 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:51:28.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.752+0000 7f40ef600640 1 Processor -- start 2024-09-15T22:51:28.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.752+0000 7f40ef600640 1 -- start start 2024-09-15T22:51:28.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f40e80b03c0 0x7f40e806c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40e8147860 0x7f40e806e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e806eca0 0x7f40e8162110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f40e806d530 con 0x7f40e8147860 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f40e806cc90 con 0x7f40e80b03c0 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ef600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40e806cf70 con 0x7f40e806eca0 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40e8147860 0x7f40e806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f40e8147860 0x7f40e806e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42658/0 (socket says 172.21.15.31:42658) 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 -- 172.21.15.31:0/1676998545 learned_addr learned my addr 172.21.15.31:0/1676998545 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ed600640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e806eca0 0x7f40e8162110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40ecc00640 1 --2- 172.21.15.31:0/1676998545 >> v2:172.21.15.102:3300/0 conn(0x7f40e80b03c0 0x7f40e806c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 -- 172.21.15.31:0/1676998545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e806eca0 msgr2=0x7f40e8162110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.759 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e806eca0 0x7f40e8162110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 -- 172.21.15.31:0/1676998545 >> v2:172.21.15.102:3300/0 conn(0x7f40e80b03c0 msgr2=0x7f40e806c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1676998545 >> v2:172.21.15.102:3300/0 conn(0x7f40e80b03c0 0x7f40e806c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.760 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.756+0000 7f40dfe00640 1 -- 172.21.15.31:0/1676998545 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e806d250 con 0x7f40e8147860 2024-09-15T22:51:28.761 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e8147860 0x7f40e806e760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40e8072240 tx=0x7f40d001c1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1952904b91b4b3f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40e7e00640 1 -- 172.21.15.31:0/1676998545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00b0070 con 0x7f40e8147860 2024-09-15T22:51:28.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40e7e00640 1 -- 172.21.15.31:0/1676998545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d00ab600 con 0x7f40e8147860 2024-09-15T22:51:28.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40e7e00640 1 -- 172.21.15.31:0/1676998545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00ab9d0 con 0x7f40e8147860 2024-09-15T22:51:28.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- 172.21.15.31:0/1676998545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e8147860 msgr2=0x7f40e806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e8147860 0x7f40e806e760 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f40e8072240 tx=0x7f40d001c1d0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- 172.21.15.31:0/1676998545 shutdown_connections 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e806eca0 0x7f40e8162110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 --2- 172.21.15.31:0/1676998545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e8147860 0x7f40e806e760 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 --2- 172.21.15.31:0/1676998545 >> v2:172.21.15.102:3300/0 conn(0x7f40e80b03c0 0x7f40e806c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- 172.21.15.31:0/1676998545 >> 172.21.15.31:0/1676998545 conn(0x7f40e80cd680 msgr2=0x7f40e80cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- 172.21.15.31:0/1676998545 shutdown_connections 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- 172.21.15.31:0/1676998545 wait complete. 2024-09-15T22:51:28.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 Processor -- start 2024-09-15T22:51:28.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 -- start start 2024-09-15T22:51:28.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.760+0000 7f40ef600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e80b03c0 0x7f40e8166150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40e8147860 0x7f40e8166690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f40e80cf4a0 con 0x7f40e806eca0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40e80cf320 con 0x7f40e8147860 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40e80cf620 con 0x7f40e80b03c0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42674/0 (socket says 172.21.15.31:42674) 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 -- 172.21.15.31:0/2967167410 learned_addr learned my addr 172.21.15.31:0/2967167410 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40dfe00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e80b03c0 0x7f40e8166150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ed600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40e8147860 0x7f40e8166690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 -- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e80b03c0 msgr2=0x7f40e8166150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e80b03c0 0x7f40e8166150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 -- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40e8147860 msgr2=0x7f40e8166690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40e8147860 0x7f40e8166690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 -- 172.21.15.31:0/2967167410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e80b40f0 con 0x7f40e806eca0 2024-09-15T22:51:28.766 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ecc00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40d800d800 tx=0x7f40d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40e5600640 1 -- 172.21.15.31:0/2967167410 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d800b6c0 con 0x7f40e806eca0 2024-09-15T22:51:28.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40e5600640 1 -- 172.21.15.31:0/2967167410 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8019070 con 0x7f40e806eca0 2024-09-15T22:51:28.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40e5600640 1 -- 172.21.15.31:0/2967167410 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d800ba60 con 0x7f40e806eca0 2024-09-15T22:51:28.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e80b43d0 con 0x7f40e806eca0 2024-09-15T22:51:28.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.764+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e80b4990 con 0x7f40e806eca0 2024-09-15T22:51:28.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40e5600640 1 -- 172.21.15.31:0/2967167410 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f40d800bc00 con 0x7f40e806eca0 2024-09-15T22:51:28.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40e5600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40e5600640 1 -- 172.21.15.31:0/2967167410 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f40d8086320 con 0x7f40e806eca0 2024-09-15T22:51:28.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dfe00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 Processor -- start 2024-09-15T22:51:28.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 -- start start 2024-09-15T22:51:28.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dfe00640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 0x7f40c4069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40d00ad000 tx=0x7f40d00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 0x55c20dbf4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dbf5290 0x55c20dbf5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c20dadcb60 con 0x55c20dc3f440 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c20da43c70 con 0x55c20dc3eb20 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c20d9e9ed0 con 0x55c20dbf5290 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 0x55c20dbf4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:58352/0 (socket says 172.21.15.31:58352) 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 -- 172.21.15.31:0/4000555833 learned_addr learned my addr 172.21.15.31:0/4000555833 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ed600640 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dbf5290 0x55c20dbf5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 -- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dbf5290 msgr2=0x55c20dbf5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dbf5290 0x55c20dbf5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 -- 172.21.15.31:0/4000555833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 msgr2=0x55c20dbf4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 0x55c20dbf4d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 -- 172.21.15.31:0/4000555833 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c20d9fbe50 con 0x55c20dc3eb20 2024-09-15T22:51:28.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dfe00640 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 0x55c20dbf4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:28.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40ecc00640 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40d805eb90 tx=0x7f40d8056170 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e91676a6df398280 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dd600640 1 -- 172.21.15.31:0/4000555833 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d806e020 con 0x55c20dc3eb20 2024-09-15T22:51:28.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dd600640 1 -- 172.21.15.31:0/4000555833 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80860d0 con 0x55c20dc3eb20 2024-09-15T22:51:28.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.768+0000 7f40dd600640 1 -- 172.21.15.31:0/4000555833 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8052b70 con 0x55c20dc3eb20 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 msgr2=0x55c20dc3ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f40d805eb90 tx=0x7f40d8056170 comp rx=0 tx=0).stop 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/4000555833 shutdown_connections 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dbf5290 0x55c20dbf5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3f440 0x55c20dbf4d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- 172.21.15.31:0/4000555833 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3eb20 0x55c20dc3ef00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/4000555833 >> 172.21.15.31:0/4000555833 conn(0x55c20dbfb600 msgr2=0x55c20dbf3630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/4000555833 shutdown_connections 2024-09-15T22:51:28.776 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/4000555833 wait complete. 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- start start 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 Processor -- start 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dbffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc00230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c20daa5b00 con 0x55c20dc3eb20 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c20da1e360 con 0x55c20dbfa390 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c20da1b2d0 con 0x55c20dc3f440 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 10 client.0 _ll_register_callbacks cb 0x55c20dbe0820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42696/0 (socket says 172.21.15.31:42696) 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 -- 172.21.15.31:0/184513257 learned_addr learned my addr 172.21.15.31:0/184513257 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.777 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40dfe00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dbffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ed600640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc00230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 -- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 msgr2=0x55c20dbffcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dbffcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 -- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 msgr2=0x55c20dc00230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc00230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 -- 172.21.15.31:0/184513257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c20d9ea120 con 0x55c20dc3eb20 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40ecc00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f40d8056200 tx=0x7f40d8059070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b00127417af58c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40d6000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8054800 con 0x55c20dc3eb20 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f40d8052b70 con 0x55c20dc3eb20 2024-09-15T22:51:28.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d80860d0 con 0x55c20dc3eb20 2024-09-15T22:51:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40d807b050 con 0x55c20dc3eb20 2024-09-15T22:51:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 10 client.5127 fetch_fsmap learned FSMap version 20 2024-09-15T22:51:28.780 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.772+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c20d9e3450 con 0x55c20dc3eb20 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d80860d0 con 0x55c20dc3eb20 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f40d8013070 con 0x55c20dc3eb20 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 10 client.5127 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 10 client.5127 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 20 client.5127 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc4d280 0x55c20dc4f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 4 client.5127 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 --> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c20d9ddc00 con 0x55c20dc4d280 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40dfe00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc4d280 0x55c20dc4f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 10 client.5127 ms_handle_connect on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40dfe00640 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc4d280 0x55c20dc4f670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8d4484bf65beba4e server_cookie=b6b2f14de1377324 in_seq=0 out_seq=0 2024-09-15T22:51:28.781 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 1 -- 172.21.15.31:0/184513257 <== mds.0 v2:172.21.15.31:6832/263357593 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c20d9ddc00 con 0x55c20dc4d280 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 10 client.5127 handle_command_reply: tid=0 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 client.5127 shutdown 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 msgr2=0x55c20dbf9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f40d8056200 tx=0x7f40d8059070 comp rx=0 tx=0).stop 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 shutdown_connections 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc4d280 0x55c20dc4f670 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc00230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dbffcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 --2- 172.21.15.31:0/184513257 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dbf9e50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40d6000640 0 client.5127 ms_handle_reset on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 >> 172.21.15.31:0/184513257 conn(0x55c20dbf5290 msgr2=0x55c20dbf3d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 shutdown_connections 2024-09-15T22:51:28.782 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 1 -- 172.21.15.31:0/184513257 wait complete. 2024-09-15T22:51:28.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.776+0000 7f40f28f9000 20 client.5127 trim_cache size 0 max 16384 2024-09-15T22:51:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 Processor -- start 2024-09-15T22:51:28.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- start start 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3eb20 0x55c20dc3e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3f440 0x55c20dc4f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f40e8203280 con 0x55c20dbfa390 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f40e81401d0 con 0x55c20dc3f440 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f40e8202c30 con 0x55c20dc3eb20 2024-09-15T22:51:28.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42708/0 (socket says 172.21.15.31:42708) 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 -- 172.21.15.31:0/915398117 learned_addr learned my addr 172.21.15.31:0/915398117 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ed600640 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3f440 0x55c20dc4f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40dfe00640 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3eb20 0x55c20dc3e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 -- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3eb20 msgr2=0x55c20dc3e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3eb20 0x55c20dc3e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 -- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3f440 msgr2=0x55c20dc4f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3f440 0x55c20dc4f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.801 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 -- 172.21.15.31:0/915398117 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c20dc3f270 con 0x55c20dbfa390 2024-09-15T22:51:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40ecc00640 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f40d8056340 tx=0x7f40d806c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15e5a617d860a30d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40dcc00640 1 -- 172.21.15.31:0/915398117 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d806e040 con 0x55c20dbfa390 2024-09-15T22:51:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40dcc00640 1 -- 172.21.15.31:0/915398117 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8073070 con 0x55c20dbfa390 2024-09-15T22:51:28.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40dcc00640 1 -- 172.21.15.31:0/915398117 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8055c20 con 0x55c20dbfa390 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- 172.21.15.31:0/915398117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 msgr2=0x55c20dc3dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f40d8056340 tx=0x7f40d806c000 comp rx=0 tx=0).stop 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- 172.21.15.31:0/915398117 shutdown_connections 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dc3f440 0x55c20dc4f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3eb20 0x55c20dc3e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 --2- 172.21.15.31:0/915398117 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dbfa390 0x55c20dc3dcf0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.796+0000 7f40f28f9000 1 -- 172.21.15.31:0/915398117 >> 172.21.15.31:0/915398117 conn(0x55c20dbf5290 msgr2=0x55c20dbf9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- 172.21.15.31:0/915398117 shutdown_connections 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- 172.21.15.31:0/915398117 wait complete. 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- start start 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 Processor -- start 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc52b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dc6dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55c20da42f80 con 0x55c20dc3eb20 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55c20d9fbca0 con 0x55c20dbfa390 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55c20da482a0 con 0x55c20dc3f440 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 10 client.0 _ll_register_callbacks cb 0x7f40d00096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:28.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42718/0 (socket says 172.21.15.31:42718) 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 -- 172.21.15.31:0/1189785864 learned_addr learned my addr 172.21.15.31:0/1189785864 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40ecc00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc52b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40ed600640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dc6dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 -- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 msgr2=0x55c20dc6dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dc6dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 -- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 msgr2=0x55c20dc52b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc52b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 -- 172.21.15.31:0/1189785864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c20d9cafd0 con 0x55c20dc3eb20 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40ecc00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc52b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40dfe00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40d001a880 tx=0x7f40d001aa10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fc65450cca5dd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d00b0040 con 0x55c20dc3eb20 2024-09-15T22:51:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f40d00b6890 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d8073070 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (secure 0 0 0) 0x7f40d00d8050 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 10 client.5133 fetch_fsmap learned FSMap version 20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=20,monmap=2+}) -- 0x55c20dac6750 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d8073070 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 20) ==== 3494+0+0 (secure 0 0 0) 0x7f40d00db020 con 0x55c20dc3eb20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 10 client.5133 fetch_fsmap finished waiting for FSMap version 20 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 10 client.5133 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 20 client.5133 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.800+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc6e3e0 0x55c20dcb1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 4 client.5133 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 --> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] -- command(tid 0: {"prefix": "status"}) -- 0x55c20da513a0 con 0x55c20dc6e3e0 2024-09-15T22:51:28.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ecc00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc6e3e0 0x55c20dcb1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:28.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40d6000640 10 client.5133 ms_handle_connect on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:28.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ecc00640 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc6e3e0 0x55c20dcb1c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=823908a653ebc31a server_cookie=8b6830419cd1d1f9 in_seq=0 out_seq=0 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40d6000640 1 -- 172.21.15.31:0/1189785864 <== mds.0 v2:172.21.15.31:6832/263357593 1 ==== command_reply(tid 0: 0 ) ==== 8+0+530 (crc 0 0 0) 0x55c20da513a0 con 0x55c20dc6e3e0 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40d6000640 10 client.5133 handle_command_reply: tid=0 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 client.5133 shutdown 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 msgr2=0x55c20dc6d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f40d001a880 tx=0x7f40d001aa10 comp rx=0 tx=0).stop 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 shutdown_connections 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x55c20dc6e3e0 0x55c20dcb1c00 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55c20dc3f440 0x55c20dc6dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55c20dc3eb20 0x55c20dc6d960 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40d6000640 0 client.5133 ms_handle_reset on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:28.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 --2- 172.21.15.31:0/1189785864 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55c20dbfa390 0x55c20dc52b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 >> 172.21.15.31:0/1189785864 conn(0x55c20dbf5290 msgr2=0x55c20dc3cce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 shutdown_connections 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 1 -- 172.21.15.31:0/1189785864 wait complete. 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40f28f9000 20 client.5133 trim_cache size 0 max 16384 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:51:28.811 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5103, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:reconnect", 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:replay", 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "replay_status": { 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_read_pos": 4195503, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_write_pos": 4195503, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_expire_pos": 4194304, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "num_events": 3, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "num_segments": 2 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 0.29808870199999998, 2024-09-15T22:51:28.812 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 20, 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 43, 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 0, 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 0.89679684599999998 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 msgr2=0x7f40c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 0x7f40c4069d80 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f40d00ad000 tx=0x7f40d00a6000 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 msgr2=0x7f40e80b5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f40d800d800 tx=0x7f40d800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 shutdown_connections 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f40c40678c0 0x7f40c4069d80 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f40e8147860 0x7f40e8166690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f40e80b03c0 0x7f40e8166150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 --2- 172.21.15.31:0/2967167410 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f40e806eca0 0x7f40e80b5190 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 >> 172.21.15.31:0/2967167410 conn(0x7f40e80cd680 msgr2=0x7f40e80add80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 shutdown_connections 2024-09-15T22:51:28.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:28.804+0000 7f40ef600640 1 -- 172.21.15.31:0/2967167410 wait complete. 2024-09-15T22:51:29.832 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:29.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 Processor -- start 2024-09-15T22:51:29.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 -- start start 2024-09-15T22:51:29.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f709c158c20 0x7f709c15ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f709c0b6110 0x7f709c06da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0d2ad0 con 0x7f709c0d2680 2024-09-15T22:51:29.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f709c15fb90 con 0x7f709c158c20 2024-09-15T22:51:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a3000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f709c15f2f0 con 0x7f709c0b6110 2024-09-15T22:51:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f709c158c20 0x7f709c15ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f709c158c20 0x7f709c15ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42728/0 (socket says 172.21.15.31:42728) 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 -- 172.21.15.31:0/811014980 learned_addr learned my addr 172.21.15.31:0/811014980 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a2600640 1 --2- 172.21.15.31:0/811014980 >> v2:172.21.15.102:3300/0 conn(0x7f709c0b6110 0x7f709c06da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 -- 172.21.15.31:0/811014980 >> v2:172.21.15.102:3300/0 conn(0x7f709c0b6110 msgr2=0x7f709c06da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 --2- 172.21.15.31:0/811014980 >> v2:172.21.15.102:3300/0 conn(0x7f709c0b6110 0x7f709c06da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 -- 172.21.15.31:0/811014980 >> v1:172.21.15.102:6789/0 conn(0x7f709c0d2680 legacy=0x7f709c0b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.984+0000 7f70a1c00640 1 -- 172.21.15.31:0/811014980 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c15f5d0 con 0x7f709c158c20 2024-09-15T22:51:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a1c00640 1 --2- 172.21.15.31:0/811014980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c158c20 0x7f709c15ec10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f709c15fd10 tx=0x7f709001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fec5c73a5a225de1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f709be00640 1 -- 172.21.15.31:0/811014980 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900b0070 con 0x7f709c158c20 2024-09-15T22:51:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f709be00640 1 -- 172.21.15.31:0/811014980 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70900ab600 con 0x7f709c158c20 2024-09-15T22:51:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f709be00640 1 -- 172.21.15.31:0/811014980 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900ab9d0 con 0x7f709c158c20 2024-09-15T22:51:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 -- 172.21.15.31:0/811014980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c158c20 msgr2=0x7f709c15ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 --2- 172.21.15.31:0/811014980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c158c20 0x7f709c15ec10 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f709c15fd10 tx=0x7f709001c470 comp rx=0 tx=0).stop 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 -- 172.21.15.31:0/811014980 shutdown_connections 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 --2- 172.21.15.31:0/811014980 >> v2:172.21.15.102:3300/0 conn(0x7f709c0b6110 0x7f709c06da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 --2- 172.21.15.31:0/811014980 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c158c20 0x7f709c15ec10 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 -- 172.21.15.31:0/811014980 >> 172.21.15.31:0/811014980 conn(0x7f709c06c1f0 msgr2=0x7f709c06ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:29.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 -- 172.21.15.31:0/811014980 shutdown_connections 2024-09-15T22:51:29.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.988+0000 7f70a3000640 1 -- 172.21.15.31:0/811014980 wait complete. 2024-09-15T22:51:29.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 Processor -- start 2024-09-15T22:51:29.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- start start 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 0x7f709c1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 0x7f709c150e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f709c06eb70 con 0x7f709c0b6110 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f709c06e9f0 con 0x7f709c0d2680 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f709c06ecf0 con 0x7f709c158c20 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42732/0 (socket says 172.21.15.31:42732) 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 -- 172.21.15.31:0/3676159604 learned_addr learned my addr 172.21.15.31:0/3676159604 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a2600640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 0x7f709c150e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 -- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 msgr2=0x7f709c150e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1200640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 0x7f709c1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 0x7f709c150e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 -- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 msgr2=0x7f709c1508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 0x7f709c1508e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 -- 172.21.15.31:0/3676159604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c1549b0 con 0x7f709c0b6110 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a2600640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 0x7f709c150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1200640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 0x7f709c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:29.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a1c00640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f70900ae040 tx=0x7f7090019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900b0040 con 0x7f709c0b6110 2024-09-15T22:51:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70900b9070 con 0x7f709c0b6110 2024-09-15T22:51:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70900b4680 con 0x7f709c0b6110 2024-09-15T22:51:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f709c154c90 con 0x7f709c0b6110 2024-09-15T22:51:29.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f709c155250 con 0x7f709c0b6110 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.992+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f709c06da90 con 0x7f709c0b6110 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.996+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f70900b4820 con 0x7f709c0b6110 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.996+0000 7f7099600640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 0x7f707c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.996+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f709011fc20 con 0x7f709c0b6110 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.996+0000 7f70a1200640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 0x7f707c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:29.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:29.996+0000 7f70a1200640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 0x7f707c069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f709c0719c0 tx=0x7f7088009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:30.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.000+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f70900160f0 con 0x7f709c0b6110 2024-09-15T22:51:30.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f709c06d010 con 0x7f709c0b6110 2024-09-15T22:51:30.205 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f7099600640 1 -- 172.21.15.31:0/3676159604 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) ==== 94+0+5223 (secure 0 0 0) 0x7f70900f04e0 con 0x7f709c0b6110 2024-09-15T22:51:30.205 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:30.206 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":21,"btime":"2024-09-15T22:51:29:506170+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:28.522778+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-15T22:51:30.206 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 21 2024-09-15T22:51:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 msgr2=0x7f707c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 0x7f707c069d80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f709c0719c0 tx=0x7f7088009040 comp rx=0 tx=0).stop 2024-09-15T22:51:30.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 msgr2=0x7f709c1522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f70900ae040 tx=0x7f7090019210 comp rx=0 tx=0).stop 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 shutdown_connections 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f707c0678c0 0x7f707c069d80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f709c158c20 0x7f709c150e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f709c0d2680 0x7f709c1508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 --2- 172.21.15.31:0/3676159604 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f709c0b6110 0x7f709c1522a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 >> 172.21.15.31:0/3676159604 conn(0x7f709c06c1f0 msgr2=0x7f709c0b3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 shutdown_connections 2024-09-15T22:51:30.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:30.204+0000 7f70a3000640 1 -- 172.21.15.31:0/3676159604 wait complete. 2024-09-15T22:51:30.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 21, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:51:15.411968+0000', 'modified': '2024-09-15T22:51:28.522778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.31:6834/263357593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 263357593}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 263357593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T22:51:30.630 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5103:up:reconnect 2024-09-15T22:51:31.631 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 Processor -- start 2024-09-15T22:51:31.783 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 -- start start 2024-09-15T22:51:31.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a14145e10 0x7f9a140d2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:31.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a140d1ca0 con 0x7f9a140d18c0 2024-09-15T22:51:31.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a1415d960 con 0x7f9a140d2670 2024-09-15T22:51:31.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a13200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9a1415c980 con 0x7f9a14145e10 2024-09-15T22:51:31.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a11e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a14145e10 0x7f9a140d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a11e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9a14145e10 0x7f9a140d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42746/0 (socket says 172.21.15.31:42746) 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a11e00640 1 -- 172.21.15.31:0/2064650449 learned_addr learned my addr 172.21.15.31:0/2064650449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.780+0000 7f9a12800640 1 --1- 172.21.15.31:0/2064650449 >> v1:172.21.15.31:6789/0 conn(0x7f9a140d18c0 0x7f9a140b5710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38066/0 (socket says 172.21.15.31:38066) 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11e00640 1 -- 172.21.15.31:0/2064650449 >> v1:172.21.15.102:6789/0 conn(0x7f9a140d2670 legacy=0x7f9a140d11b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11e00640 1 -- 172.21.15.31:0/2064650449 >> v1:172.21.15.31:6789/0 conn(0x7f9a140d18c0 legacy=0x7f9a140b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:31.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11e00640 1 -- 172.21.15.31:0/2064650449 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a1415cba0 con 0x7f9a14145e10 2024-09-15T22:51:31.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11e00640 1 --2- 172.21.15.31:0/2064650449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a140d2130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a0401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc4de9f8cd5b37f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11400640 1 -- 172.21.15.31:0/2064650449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040b0070 con 0x7f9a14145e10 2024-09-15T22:51:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11400640 1 -- 172.21.15.31:0/2064650449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a040ab600 con 0x7f9a14145e10 2024-09-15T22:51:31.788 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a11400640 1 -- 172.21.15.31:0/2064650449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a040ab9d0 con 0x7f9a14145e10 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a13200640 1 -- 172.21.15.31:0/2064650449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 msgr2=0x7f9a140d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.784+0000 7f9a13200640 1 --2- 172.21.15.31:0/2064650449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a140d2130 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f9a04009870 tx=0x7f9a0401c4d0 comp rx=0 tx=0).stop 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- 172.21.15.31:0/2064650449 shutdown_connections 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 --2- 172.21.15.31:0/2064650449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a140d2130 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- 172.21.15.31:0/2064650449 >> 172.21.15.31:0/2064650449 conn(0x7f9a1406c1f0 msgr2=0x7f9a1406ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- 172.21.15.31:0/2064650449 shutdown_connections 2024-09-15T22:51:31.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- 172.21.15.31:0/2064650449 wait complete. 2024-09-15T22:51:31.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 Processor -- start 2024-09-15T22:51:31.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- start start 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a140d18c0 0x7f9a14166530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a140d2670 0x7f9a14163dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140d1f20 con 0x7f9a14145e10 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9a140d2ae0 con 0x7f9a140d18c0 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a13200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9a1416a380 con 0x7f9a140d2670 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:31.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42748/0 (socket says 172.21.15.31:42748) 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 -- 172.21.15.31:0/3012243500 learned_addr learned my addr 172.21.15.31:0/3012243500 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a11e00640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a140d18c0 0x7f9a14166530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a09400640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a140d2670 0x7f9a14163dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 -- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a140d2670 msgr2=0x7f9a14163dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a140d2670 0x7f9a14163dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 -- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a140d18c0 msgr2=0x7f9a14166530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a140d18c0 0x7f9a14166530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 -- 172.21.15.31:0/3012243500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a14164660 con 0x7f9a14145e10 2024-09-15T22:51:31.793 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.788+0000 7f9a12800640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c7a0 tx=0x7f9a0c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c017070 con 0x7f9a14145e10 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00a640 con 0x7f9a14145e10 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00a9f0 con 0x7f9a14145e10 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a14164940 con 0x7f9a14145e10 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a14164f00 con 0x7f9a14145e10 2024-09-15T22:51:31.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a141f7820 con 0x7f9a14145e10 2024-09-15T22:51:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9a0c01a070 con 0x7f9a14145e10 2024-09-15T22:51:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 0x7f99f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:31.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f9a0c0855b0 con 0x7f9a14145e10 2024-09-15T22:51:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.792+0000 7f9a11e00640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 0x7f99f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:31.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.796+0000 7f9a11e00640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 0x7f99f0069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ad000 tx=0x7f9a04008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:31.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:31.796+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9a140d1ca0 con 0x7f9a14145e10 2024-09-15T22:51:32.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.000+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a140d2130 con 0x7f9a14145e10 2024-09-15T22:51:32.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a0aa00640 1 -- 172.21.15.31:0/3012243500 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5226 (secure 0 0 0) 0x7f9a0c055790 con 0x7f9a14145e10 2024-09-15T22:51:32.005 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:32.006 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":23,"btime":"2024-09-15T22:51:31:516983+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:30.520146+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":2}]} 2024-09-15T22:51:32.006 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 23 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 msgr2=0x7f99f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 0x7f99f0069d80 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9a040ad000 tx=0x7f9a04008040 comp rx=0 tx=0).stop 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 msgr2=0x7f9a1415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00c7a0 tx=0x7f9a0c00cc60 comp rx=0 tx=0).stop 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 shutdown_connections 2024-09-15T22:51:32.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f99f00678c0 0x7f99f0069d80 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9a14145e10 0x7f9a1415b730 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9a140d2670 0x7f9a14163dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 --2- 172.21.15.31:0/3012243500 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9a140d18c0 0x7f9a14166530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 >> 172.21.15.31:0/3012243500 conn(0x7f9a1406c1f0 msgr2=0x7f9a141446e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 shutdown_connections 2024-09-15T22:51:32.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:32.004+0000 7f9a13200640 1 -- 172.21.15.31:0/3012243500 wait complete. 2024-09-15T22:51:32.429 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:51:15.411968+0000', 'modified': '2024-09-15T22:51:30.520146+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.31:6834/263357593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 263357593}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 263357593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T22:51:32.429 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5103:up:clientreplay 2024-09-15T22:51:33.431 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:51:33.509 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-15T22:51:33.508+0000 7f4805800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:51:33.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.580+0000 7f63daa00640 1 Processor -- start 2024-09-15T22:51:33.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.580+0000 7f63daa00640 1 -- start start 2024-09-15T22:51:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63daa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63daa00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f63d415d420 0x7f63d40d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63daa00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63d40af830 con 0x7f63d40cf7f0 2024-09-15T22:51:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63daa00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f63d40afb10 con 0x7f63d415d420 2024-09-15T22:51:33.585 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63daa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f63d415c940 con 0x7f63d4159ef0 2024-09-15T22:51:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63d3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f63d415d420 0x7f63d40d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63d3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:38216/0 (socket says 172.21.15.31:38216) 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f63d415d420 0x7f63d40d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:58422/0 (socket says 172.21.15.31:58422) 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63d3e00640 1 -- 172.21.15.31:0/1595984875 learned_addr learned my addr 172.21.15.31:0/1595984875 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 -- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 msgr2=0x7f63d40aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 -- 172.21.15.31:0/1595984875 >> v1:172.21.15.102:6789/0 conn(0x7f63d40cf7f0 legacy=0x7f63d415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63cb400640 1 -- 172.21.15.31:0/1595984875 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d415cc20 con 0x7f63d415d420 2024-09-15T22:51:33.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.584+0000 7f63d3e00640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:51:33.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63cb400640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d415d420 0x7f63d40d00f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e29f692314fa509 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:33.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63d3400640 1 -- 172.21.15.31:0/1595984875 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0b2070 con 0x7f63d415d420 2024-09-15T22:51:33.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63d3400640 1 -- 172.21.15.31:0/1595984875 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63bc0ad680 con 0x7f63d415d420 2024-09-15T22:51:33.589 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63d3400640 1 -- 172.21.15.31:0/1595984875 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63bc0ada50 con 0x7f63d415d420 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d415d420 msgr2=0x7f63d40d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d415d420 0x7f63d40d00f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0097c0 tx=0x7f63bc01c470 comp rx=0 tx=0).stop 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- 172.21.15.31:0/1595984875 shutdown_connections 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d415d420 0x7f63d40d00f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 --2- 172.21.15.31:0/1595984875 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d4159ef0 0x7f63d40aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- 172.21.15.31:0/1595984875 >> 172.21.15.31:0/1595984875 conn(0x7f63d40b20a0 msgr2=0x7f63d40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:33.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- 172.21.15.31:0/1595984875 shutdown_connections 2024-09-15T22:51:33.591 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- 172.21.15.31:0/1595984875 wait complete. 2024-09-15T22:51:33.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 Processor -- start 2024-09-15T22:51:33.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.588+0000 7f63daa00640 1 -- start start 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 0x7f63d415baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 0x7f63d4072b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f63d4169290 con 0x7f63d40cf7f0 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f63d4169110 con 0x7f63d4159ef0 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f63d4169410 con 0x7f63d415d420 2024-09-15T22:51:33.593 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42764/0 (socket says 172.21.15.31:42764) 2024-09-15T22:51:33.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 -- 172.21.15.31:0/1307286681 learned_addr learned my addr 172.21.15.31:0/1307286681 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63cb400640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 0x7f63d415baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 -- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 msgr2=0x7f63d4072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d8a00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 0x7f63d4072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 0x7f63d4072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.595 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 -- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 msgr2=0x7f63d415baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 0x7f63d415baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 -- 172.21.15.31:0/1307286681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63d40b0160 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63cb400640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 0x7f63d415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d8a00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 0x7f63d4072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d3e00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e9d0 tx=0x7f63c400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c4017070 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63c400ca60 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63c400ce10 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63d40b0400 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63d40b09c0 con 0x7f63d40cf7f0 2024-09-15T22:51:33.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d40b4330 con 0x7f63d40cf7f0 2024-09-15T22:51:33.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.592+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f63c401a070 con 0x7f63d40cf7f0 2024-09-15T22:51:33.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.596+0000 7f63d0c00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:33.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.596+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7f63c4085e80 con 0x7f63d40cf7f0 2024-09-15T22:51:33.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.596+0000 7f63cb400640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:33.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.596+0000 7f63cb400640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 0x7f63b0069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc0a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:33.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.600+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f63c4056740 con 0x7f63d40cf7f0 2024-09-15T22:51:33.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.800+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f63d40ad450 con 0x7f63d40cf7f0 2024-09-15T22:51:33.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.800+0000 7f63d0c00640 1 -- 172.21.15.31:0/1307286681 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5227 (secure 0 0 0) 0x7f63c4056040 con 0x7f63d40cf7f0 2024-09-15T22:51:33.804 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:51:33.804 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-15T22:51:32:523802+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:32.523798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-15T22:51:33.804 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-15T22:51:33.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 msgr2=0x7f63b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 0x7f63b0069d80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f63bc0af000 tx=0x7f63bc0a7000 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 msgr2=0x7f63d4150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f63c400e9d0 tx=0x7f63c400ee90 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 shutdown_connections 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f63b00678c0 0x7f63b0069d80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f63d415d420 0x7f63d4072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f63d4159ef0 0x7f63d415baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 --2- 172.21.15.31:0/1307286681 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f63d40cf7f0 0x7f63d4150540 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 >> 172.21.15.31:0/1307286681 conn(0x7f63d40b20a0 msgr2=0x7f63d415e270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 shutdown_connections 2024-09-15T22:51:33.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:33.804+0000 7f63daa00640 1 -- 172.21.15.31:0/1307286681 wait complete. 2024-09-15T22:51:34.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 24, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:51:15.411968+0000', 'modified': '2024-09-15T22:51:32.523798+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 42, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5103}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5103': {'gid': 5103, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.31:6834/263357593', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6832', 'nonce': 263357593}, {'type': 'v1', 'addr': '172.21.15.31:6834', 'nonce': 263357593}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5103, 'qdb_cluster': [5103]} 2024-09-15T22:51:34.228 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:51:34.229 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:51:34.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 Processor -- start 2024-09-15T22:51:34.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 -- start start 2024-09-15T22:51:34.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc8015e4a0 0x7efc8006eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc80162ee0 con 0x7efc800d0210 2024-09-15T22:51:34.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc80162920 con 0x7efc800b4f80 2024-09-15T22:51:34.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc84a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7efc8006e810 con 0x7efc8015e4a0 2024-09-15T22:51:34.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7de00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7efc8015e4a0 0x7efc8006eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7e800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7efc800d0210 0x7efc800d0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:38076/0 (socket says 172.21.15.31:38076) 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7e800640 1 -- 172.21.15.31:0/1808916455 learned_addr learned my addr 172.21.15.31:0/1808916455 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7de00640 1 -- 172.21.15.31:0/1808916455 >> v1:172.21.15.102:6789/0 conn(0x7efc800b4f80 legacy=0x7efc80162020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7de00640 1 -- 172.21.15.31:0/1808916455 >> v1:172.21.15.31:6789/0 conn(0x7efc800d0210 legacy=0x7efc800d0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7d400640 1 -- 172.21.15.31:0/1808916455 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446524047 0 0) 0x7efc80162ee0 con 0x7efc800d0210 2024-09-15T22:51:34.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.372+0000 7efc7de00640 1 -- 172.21.15.31:0/1808916455 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80162c00 con 0x7efc8015e4a0 2024-09-15T22:51:34.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc7de00640 1 --2- 172.21.15.31:0/1808916455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8006eca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f96d51ff0a9302b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc7d400640 1 -- 172.21.15.31:0/1808916455 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700b0070 con 0x7efc8015e4a0 2024-09-15T22:51:34.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc7d400640 1 -- 172.21.15.31:0/1808916455 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc700ab600 con 0x7efc8015e4a0 2024-09-15T22:51:34.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc7d400640 1 -- 172.21.15.31:0/1808916455 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700ab9d0 con 0x7efc8015e4a0 2024-09-15T22:51:34.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 -- 172.21.15.31:0/1808916455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 msgr2=0x7efc8006eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 --2- 172.21.15.31:0/1808916455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8006eca0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7efc700097c0 tx=0x7efc7001c3d0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 -- 172.21.15.31:0/1808916455 shutdown_connections 2024-09-15T22:51:34.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 --2- 172.21.15.31:0/1808916455 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8006eca0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 -- 172.21.15.31:0/1808916455 >> 172.21.15.31:0/1808916455 conn(0x7efc800b20a0 msgr2=0x7efc800b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 -- 172.21.15.31:0/1808916455 shutdown_connections 2024-09-15T22:51:34.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 -- 172.21.15.31:0/1808916455 wait complete. 2024-09-15T22:51:34.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.376+0000 7efc84a00640 1 Processor -- start 2024-09-15T22:51:34.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- start start 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc800b4f80 0x7efc80154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc800d0210 0x7efc80155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efc800b3b60 con 0x7efc8015e4a0 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc800b39e0 con 0x7efc800b4f80 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efc800b3ce0 con 0x7efc800d0210 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42790/0 (socket says 172.21.15.31:42790) 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 -- 172.21.15.31:0/7998142 learned_addr learned my addr 172.21.15.31:0/7998142 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7de00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc800b4f80 0x7efc80154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc75400640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc800d0210 0x7efc80155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 -- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc800d0210 msgr2=0x7efc80155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc800d0210 0x7efc80155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 -- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc800b4f80 msgr2=0x7efc80154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc800b4f80 0x7efc80154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 -- 172.21.15.31:0/7998142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc80156430 con 0x7efc8015e4a0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc7e800640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc78002240 tx=0x7efc7800cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc76a00640 1 -- 172.21.15.31:0/7998142 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78017070 con 0x7efc8015e4a0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc76a00640 1 -- 172.21.15.31:0/7998142 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc7800ac30 con 0x7efc8015e4a0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc76a00640 1 -- 172.21.15.31:0/7998142 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78012400 con 0x7efc8015e4a0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc80156710 con 0x7efc8015e4a0 2024-09-15T22:51:34.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.380+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc80156cd0 con 0x7efc8015e4a0 2024-09-15T22:51:34.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc76a00640 1 -- 172.21.15.31:0/7998142 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7efc7801a070 con 0x7efc8015e4a0 2024-09-15T22:51:34.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc76a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 0x7efc5c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc76a00640 1 -- 172.21.15.31:0/7998142 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7efc78085b00 con 0x7efc8015e4a0 2024-09-15T22:51:34.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 Processor -- start 2024-09-15T22:51:34.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc7de00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 0x7efc5c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.386 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 -- start start 2024-09-15T22:51:34.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc7de00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 0x7efc5c069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc700ad000 tx=0x7efc700a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b45f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640afc290 0x558640afc670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586409e3b60 con 0x558640b46440 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55864094ac70 con 0x558640afc290 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5586408f0ed0 con 0x558640b45b20 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42796/0 (socket says 172.21.15.31:42796) 2024-09-15T22:51:34.388 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 -- 172.21.15.31:0/1614888078 learned_addr learned my addr 172.21.15.31:0/1614888078 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 -- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 msgr2=0x558640b45f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc7de00640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b45f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc7e800640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640afc290 0x558640afc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b45f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 -- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640afc290 msgr2=0x558640afc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.389 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640afc290 0x558640afc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 -- 172.21.15.31:0/1614888078 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558640902e50 con 0x558640b46440 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc7de00640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc75400640 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efc680098f0 tx=0x7efc68009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d25a85b3227dd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc6ea00640 1 -- 172.21.15.31:0/1614888078 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68017070 con 0x558640b46440 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.384+0000 7efc6ea00640 1 -- 172.21.15.31:0/1614888078 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68004020 con 0x558640b46440 2024-09-15T22:51:34.390 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc6ea00640 1 -- 172.21.15.31:0/1614888078 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc68004410 con 0x558640b46440 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/1614888078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 msgr2=0x558640afbd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7efc680098f0 tx=0x7efc68009db0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/1614888078 shutdown_connections 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640afc290 0x558640afc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640afbd50 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- 172.21.15.31:0/1614888078 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b45f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.391 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/1614888078 >> 172.21.15.31:0/1614888078 conn(0x558640b02600 msgr2=0x558640afa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/1614888078 shutdown_connections 2024-09-15T22:51:34.392 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/1614888078 wait complete. 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- start start 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 Processor -- start 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b00e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b46440 0x558640b06cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5586409acb00 con 0x558640b01390 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558640925360 con 0x558640b46440 2024-09-15T22:51:34.397 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5586409222d0 con 0x558640b45b20 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 10 client.0 _ll_register_callbacks cb 0x558640ae7820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc75400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b46440 0x558640b06cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42812/0 (socket says 172.21.15.31:42812) 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7de00640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b00e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 -- 172.21.15.31:0/3132576869 learned_addr learned my addr 172.21.15.31:0/3132576869 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 -- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 msgr2=0x558640b00e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b00e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 -- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b46440 msgr2=0x558640b06cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b46440 0x558640b06cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 -- 172.21.15.31:0/3132576869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586408f1120 con 0x558640b01390 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc7e800640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc7805e400 tx=0x7efc7805a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40e3d7d5594fabba server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc63400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc78082060 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7efc78083a90 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc68004020 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.388+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc78072050 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 10 client.5166 fetch_fsmap learned FSMap version 24 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5586408ea450 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc68004020 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7efc7805e4a0 con 0x558640b01390 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 10 client.5166 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 10 client.5166 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 20 client.5166 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4bf50 0x558640b4c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 4 client.5166 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 --> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586408e4c00 con 0x558640b4bf50 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc7de00640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4bf50 0x558640b4c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc7de00640 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4bf50 0x558640b4c330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a26403601ea7dac server_cookie=d451a977a9568d51 in_seq=0 out_seq=0 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 10 client.5166 ms_handle_connect on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 1 -- 172.21.15.31:0/3132576869 <== mds.0 v2:172.21.15.31:6832/263357593 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5586408e4c00 con 0x558640b4bf50 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 10 client.5166 handle_command_reply: tid=0 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 client.5166 shutdown 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 msgr2=0x558640b07230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7efc7805e400 tx=0x7efc7805a100 comp rx=0 tx=0).stop 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 shutdown_connections 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4bf50 0x558640b4c330 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b07230 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b46440 0x558640b06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc63400640 0 client.5166 ms_handle_reset on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 --2- 172.21.15.31:0/3132576869 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640b00e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 >> 172.21.15.31:0/3132576869 conn(0x558640afc290 msgr2=0x558640afad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 shutdown_connections 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 1 -- 172.21.15.31:0/3132576869 wait complete. 2024-09-15T22:51:34.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.392+0000 7efc87d2a000 20 client.5166 trim_cache size 0 max 16384 2024-09-15T22:51:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 Processor -- start 2024-09-15T22:51:34.414 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- start start 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 0x558640b5c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 0x558640b5c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7efc80202ed0 con 0x558640b01390 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7efc8015a5d0 con 0x558640b45b20 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7efc802028b0 con 0x558640b46440 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42826/0 (socket says 172.21.15.31:42826) 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 -- 172.21.15.31:0/4037464696 learned_addr learned my addr 172.21.15.31:0/4037464696 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc75400640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 0x558640b5c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7e800640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 0x558640b5c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.416 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 -- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 msgr2=0x558640b5c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 0x558640b5c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 -- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 msgr2=0x558640b5c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 0x558640b5c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 -- 172.21.15.31:0/4037464696 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586408d1fd0 con 0x558640b01390 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc75400640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 0x558640b5c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7e800640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 0x558640b5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc7de00640 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc70006f90 tx=0x7efc70004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a107cc2389c5695 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.418 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc6e000640 1 -- 172.21.15.31:0/4037464696 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700d0070 con 0x558640b01390 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc6e000640 1 -- 172.21.15.31:0/4037464696 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70003e00 con 0x558640b01390 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc6e000640 1 -- 172.21.15.31:0/4037464696 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc700bb040 con 0x558640b01390 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- 172.21.15.31:0/4037464696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 msgr2=0x558640b45500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7efc70006f90 tx=0x7efc70004740 comp rx=0 tx=0).stop 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- 172.21.15.31:0/4037464696 shutdown_connections 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b46440 0x558640b5c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b45b20 0x558640b5c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.419 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 --2- 172.21.15.31:0/4037464696 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b01390 0x558640b45500 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.412+0000 7efc87d2a000 1 -- 172.21.15.31:0/4037464696 >> 172.21.15.31:0/4037464696 conn(0x558640afc290 msgr2=0x558640b008a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- 172.21.15.31:0/4037464696 shutdown_connections 2024-09-15T22:51:34.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- 172.21.15.31:0/4037464696 wait complete. 2024-09-15T22:51:34.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- start start 2024-09-15T22:51:34.420 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 Processor -- start 2024-09-15T22:51:34.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b01390 0x558640bb8e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640bb9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.423 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x558640949f80 con 0x558640b46440 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x558640902ca0 con 0x558640b01390 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55864094f2a0 con 0x558640b45b20 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 10 client.0 _ll_register_callbacks cb 0x7efc68006e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42840/0 (socket says 172.21.15.31:42840) 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 -- 172.21.15.31:0/440955528 learned_addr learned my addr 172.21.15.31:0/440955528 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7de00640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b01390 0x558640bb8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc75400640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640bb9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 -- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 msgr2=0x558640bb9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640bb9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 -- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b01390 msgr2=0x558640bb8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:34.424 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b01390 0x558640bb8e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 -- 172.21.15.31:0/440955528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586409cd750 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7e800640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc78055d90 tx=0x7efc7801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=990d06c1e83ba29d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc7805ed80 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7efc78055250 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc70003e00 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7efc78055470 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 10 client.5172 fetch_fsmap learned FSMap version 24 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=2+}) -- 0x5586408d8a30 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc70003e00 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 24) ==== 3502+0+0 (secure 0 0 0) 0x7efc7805c300 con 0x558640b46440 2024-09-15T22:51:34.425 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 10 client.5172 fetch_fsmap finished waiting for FSMap version 24 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 10 client.5172 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 20 client.5172 populate_metadata read hostname 'smithi031' 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4fd30 0x558640b50110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 4 client.5172 mds_command: new command op to 5103 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 --> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] -- command(tid 0: {"prefix": "status"}) -- 0x5586409583a0 con 0x558640b4fd30 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.416+0000 7efc7de00640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4fd30 0x558640b50110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc7de00640 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4fd30 0x558640b50110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e00b234d764c5334 server_cookie=65926a6848c7aa7e in_seq=0 out_seq=0 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc63400640 10 client.5172 ms_handle_connect on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc63400640 1 -- 172.21.15.31:0/440955528 <== mds.0 v2:172.21.15.31:6832/263357593 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5586409583a0 con 0x558640b4fd30 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc63400640 10 client.5172 handle_command_reply: tid=0 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 client.5172 shutdown 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 msgr2=0x558640b4f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.426 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7efc78055d90 tx=0x7efc7801e040 comp rx=0 tx=0).stop 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 shutdown_connections 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:6832/263357593,v1:172.21.15.31:6834/263357593] conn(0x558640b4fd30 0x558640b50110 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x558640b46440 0x558640b4f7f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x558640b45b20 0x558640bb9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc63400640 0 client.5172 ms_handle_reset on v2:172.21.15.31:6832/263357593 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 --2- 172.21.15.31:0/440955528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x558640b01390 0x558640bb8e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 >> 172.21.15.31:0/440955528 conn(0x558640afc290 msgr2=0x558640b5b000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 shutdown_connections 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 1 -- 172.21.15.31:0/440955528 wait complete. 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc87d2a000 20 client.5172 trim_cache size 0 max 16384 2024-09-15T22:51:34.427 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5103, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9137276109999997, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 24, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 43, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 43, 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 6.5124357020000003 2024-09-15T22:51:34.428 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:51:34.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 msgr2=0x7efc5c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.429 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 0x7efc5c069db0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7efc700ad000 tx=0x7efc700a6000 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 msgr2=0x7efc8015fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7efc78002240 tx=0x7efc7800cf50 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 shutdown_connections 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7efc5c0678f0 0x7efc5c069db0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7efc8015e4a0 0x7efc8015fb60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7efc800d0210 0x7efc80155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 --2- 172.21.15.31:0/7998142 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7efc800b4f80 0x7efc80154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 >> 172.21.15.31:0/7998142 conn(0x7efc800b20a0 msgr2=0x7efc8006c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 shutdown_connections 2024-09-15T22:51:34.430 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:34.420+0000 7efc84a00640 1 -- 172.21.15.31:0/7998142 wait complete. 2024-09-15T22:51:34.442 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:34.442 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file0", '"'"'w'"'"') as f: 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:34.452 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:34.453 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:34.501 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-09-15T22:51:34.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:34.510 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file0': No such file or directory 2024-09-15T22:51:34.573 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:35.511 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file0 2024-09-15T22:51:35.521 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:35.521 INFO:tasks.cephfs.mount:File open_file0 became visible with size 7 from 0 after 1s 2024-09-15T22:51:35.521 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:35.521 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:35.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:35.576 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:35.664 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:35.664 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:35.664 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0325579 s, 32.2 MB/s 2024-09-15T22:51:35.665 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:35.665 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:35.675 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:35.675 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:35.675 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:35.675 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file1", '"'"'w'"'"') as f: 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:35.676 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:35.677 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:35.677 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:35.677 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:35.719 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-09-15T22:51:35.729 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:35.730 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file1': No such file or directory 2024-09-15T22:51:35.793 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:36.573 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:36.731 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file1 2024-09-15T22:51:36.741 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:36.742 INFO:tasks.cephfs.mount:File open_file1 became visible with size 7 from 0 after 1s 2024-09-15T22:51:36.742 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:36.742 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:36.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:36.793 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:36.876 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:36.877 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0241118 s, 43.5 MB/s 2024-09-15T22:51:36.878 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:36.878 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:36.930 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file2", '"'"'w'"'"') as f: 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:36.931 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:36.975 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-09-15T22:51:36.985 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:36.985 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file2': No such file or directory 2024-09-15T22:51:37.048 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:37.793 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:37.986 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file2 2024-09-15T22:51:37.996 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:37.996 INFO:tasks.cephfs.mount:File open_file2 became visible with size 7 from 0 after 1s 2024-09-15T22:51:37.997 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:37.997 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:38.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:38.050 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:38.138 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:38.138 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:38.138 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0319187 s, 32.9 MB/s 2024-09-15T22:51:38.139 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:38.139 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:38.148 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:38.148 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file3", '"'"'w'"'"') as f: 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:38.149 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:38.150 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:38.150 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:38.150 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:38.150 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:38.195 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-09-15T22:51:38.204 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:38.205 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file3': No such file or directory 2024-09-15T22:51:38.265 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:38.575 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:39.050 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:39.205 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file3 2024-09-15T22:51:39.215 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:39.216 INFO:tasks.cephfs.mount:File open_file3 became visible with size 7 from 0 after 1s 2024-09-15T22:51:39.216 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:39.216 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:39.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:39.266 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:39.347 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:39.347 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:39.347 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0216861 s, 48.4 MB/s 2024-09-15T22:51:39.348 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:39.348 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:39.406 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:39.406 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:39.406 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:39.406 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file4", '"'"'w'"'"') as f: 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:39.407 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:39.408 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:39.408 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:39.408 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:39.451 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-09-15T22:51:39.462 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:39.462 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file4': No such file or directory 2024-09-15T22:51:39.524 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:39.795 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:40.267 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:40.464 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file4 2024-09-15T22:51:40.474 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:40.475 INFO:tasks.cephfs.mount:File open_file4 became visible with size 7 from 0 after 1s 2024-09-15T22:51:40.475 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:40.475 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:40.526 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:40.526 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:40.576 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:40.606 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:40.606 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:40.607 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0218789 s, 47.9 MB/s 2024-09-15T22:51:40.607 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:40.608 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:40.657 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:40.657 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:40.657 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file5", '"'"'w'"'"') as f: 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:40.658 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:40.659 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:40.659 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:40.659 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:40.703 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-09-15T22:51:40.712 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:40.712 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file5': No such file or directory 2024-09-15T22:51:40.772 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:41.052 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:41.525 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:41.713 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file5 2024-09-15T22:51:41.723 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:41.723 INFO:tasks.cephfs.mount:File open_file5 became visible with size 7 from 0 after 1s 2024-09-15T22:51:41.723 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:41.724 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:41.777 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:41.778 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:41.797 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0172004 s, 61.0 MB/s 2024-09-15T22:51:41.831 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:41.831 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file6", '"'"'w'"'"') as f: 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:41.882 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:41.883 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:41.935 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-09-15T22:51:41.945 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:41.945 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file6': No such file or directory 2024-09-15T22:51:42.006 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:42.269 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:42.579 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:42.774 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:42.946 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file6 2024-09-15T22:51:42.956 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:42.956 INFO:tasks.cephfs.mount:File open_file6 became visible with size 7 from 0 after 1s 2024-09-15T22:51:42.957 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:42.957 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:43.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:43.010 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:43.054 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:43.090 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:43.090 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:43.091 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0235072 s, 44.6 MB/s 2024-09-15T22:51:43.091 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:43.092 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/open_file7", '"'"'w'"'"') as f: 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:51:43.142 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:51:43.143 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:51:43.191 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-09-15T22:51:43.201 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:51:43.201 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/open_file7': No such file or directory 2024-09-15T22:51:43.263 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:43.527 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:43.799 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:44.008 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:44.202 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/open_file7 2024-09-15T22:51:44.213 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:51:44.213 INFO:tasks.cephfs.mount:File open_file7 became visible with size 7 from 0 after 1s 2024-09-15T22:51:44.213 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:51:44.213 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:51:44.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:51:44.266 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=open_file7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-15T22:51:44.271 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2024-09-15T22:51:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2024-09-15T22:51:44.306 INFO:teuthology.orchestra.run.smithi031.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0183524 s, 57.1 MB/s 2024-09-15T22:51:44.392 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:51:44.395 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:51:44.581 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:44.776 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:45.056 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:45.265 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:45.529 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:45.801 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:46.010 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:46.273 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:46.583 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:46.778 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:47.057 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:47.267 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:47.531 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:47.804 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:48.012 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:48.275 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:48.585 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:48.781 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:49.059 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:49.269 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:49.533 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:49.806 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:50.013 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:50.277 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:50.587 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:50.783 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:51.061 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:51.271 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:51.536 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:51.808 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:52.015 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:52.280 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:52.589 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:52.785 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:53.063 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:53.273 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:53.537 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:53.810 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:54.017 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:54.282 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:54.308 DEBUG:teuthology.orchestra.run.smithi031:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata stat mds0_openfiles.1 2024-09-15T22:51:54.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.355+0000 7fdf41449080 1 Processor -- start 2024-09-15T22:51:54.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- start start 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3baaec0 0x55d6c3c37a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3c1ac60 0x55d6c3c19b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3b5d7f0 con 0x55d6c3c1b040 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3aae1b0 con 0x55d6c3baaec0 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d6c3b5da90 con 0x55d6c3c1ac60 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34388/0 (socket says 172.21.15.31:34388) 2024-09-15T22:51:54.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 -- 172.21.15.31:0/2208319415 learned_addr learned my addr 172.21.15.31:0/2208319415 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:54.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3d000640 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3c1ac60 0x55d6c3c19b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3da00640 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3baaec0 0x55d6c3c37a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 -- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3c1ac60 msgr2=0x55d6c3c19b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3c1ac60 0x55d6c3c19b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 -- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3baaec0 msgr2=0x55d6c3c37a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3baaec0 0x55d6c3c37a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 -- 172.21.15.31:0/2208319415 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c3c1a2f0 con 0x55d6c3c1b040 2024-09-15T22:51:54.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf3e400640 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf380016b0 tx=0x7fdf38006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cf5f9301da2014 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf37400640 1 -- 172.21.15.31:0/2208319415 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf38016070 con 0x55d6c3c1b040 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf37400640 1 -- 172.21.15.31:0/2208319415 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf3800f710 con 0x55d6c3c1b040 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf37400640 1 -- 172.21.15.31:0/2208319415 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800fb00 con 0x55d6c3c1b040 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- 172.21.15.31:0/2208319415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 msgr2=0x55d6c3b5bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fdf380016b0 tx=0x7fdf38006f90 comp rx=0 tx=0).stop 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- 172.21.15.31:0/2208319415 shutdown_connections 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1b040 0x55d6c3b5bd60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3c1ac60 0x55d6c3c19b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 --2- 172.21.15.31:0/2208319415 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3baaec0 0x55d6c3c37a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- 172.21.15.31:0/2208319415 >> 172.21.15.31:0/2208319415 conn(0x55d6c3b8c010 msgr2=0x55d6c3b8c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- 172.21.15.31:0/2208319415 shutdown_connections 2024-09-15T22:51:54.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.359+0000 7fdf41449080 1 -- 172.21.15.31:0/2208319415 wait complete. 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 Processor -- start 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- start start 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3baaec0 0x55d6c3c3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 0x55d6c3c371b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3c1b040 0x55d6c3cd0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3c3a400 con 0x55d6c3c1ac60 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55d6c3c3a6a0 con 0x55d6c3c1b040 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55d6c3b8aca0 con 0x55d6c3baaec0 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 0x55d6c3c371b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 0x55d6c3c371b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:34398/0 (socket says 172.21.15.31:34398) 2024-09-15T22:51:54.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 -- 172.21.15.31:0/1651337080 learned_addr learned my addr 172.21.15.31:0/1651337080 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3da00640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3baaec0 0x55d6c3c3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3e400640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3c1b040 0x55d6c3cd0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 -- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3baaec0 msgr2=0x55d6c3c3c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x55d6c3baaec0 0x55d6c3c3c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 -- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3c1b040 msgr2=0x55d6c3cd0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3c1b040 0x55d6c3cd0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 -- 172.21.15.31:0/1651337080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d6c3c3d0e0 con 0x55d6c3c1ac60 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3e400640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x55d6c3c1b040 0x55d6c3cd0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf3d000640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 0x55d6c3c371b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ad040 tx=0x7fdf2c018180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf36000640 1 -- 172.21.15.31:0/1651337080 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0af040 con 0x55d6c3c1ac60 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf36000640 1 -- 172.21.15.31:0/1651337080 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf2c0b5600 con 0x55d6c3c1ac60 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf36000640 1 -- 172.21.15.31:0/1651337080 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c0b59d0 con 0x55d6c3c1ac60 2024-09-15T22:51:54.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d6c3c3d380 con 0x55d6c3c1ac60 2024-09-15T22:51:54.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.363+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d6c3c3d8c0 con 0x55d6c3c1ac60 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf36000640 1 -- 172.21.15.31:0/1651337080 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdf2c0b5b70 con 0x55d6c3c1ac60 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf36000640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdf200662d0 0x7fdf20068790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf36000640 1 -- 172.21.15.31:0/1651337080 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 6187+0+0 (secure 0 0 0) 0x7fdf2c11fa50 con 0x55d6c3c1ac60 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x55d6c3c3e6f0 0x55d6c3b832c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 --> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] -- osd_op(unknown.0.0:1 5.13 5:c9647462:::mds0_openfiles.1:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e43) -- 0x55d6c3c376f0 con 0x55d6c3c3e6f0 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3da00640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdf200662d0 0x7fdf20068790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3e400640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x55d6c3c3e6f0 0x55d6c3b832c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:51:54.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3e400640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x55d6c3c3e6f0 0x55d6c3b832c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3da00640 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdf200662d0 0x7fdf20068790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005d00 tx=0x7fdf3000c040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:51:54.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3e400640 1 -- 172.21.15.31:0/1651337080 <== osd.3 v2:172.21.15.31:6816/2974285706 1 ==== osd_op_reply(1 mds0_openfiles.1 [stat out=16b] v0'0 uv8 ondisk = 0) ==== 160+0+16 (crc 0 0 0) 0x7fdf3800f070 con 0x55d6c3c3e6f0 2024-09-15T22:51:54.372 INFO:teuthology.orchestra.run.smithi031.stdout:cephfs_metadata/mds0_openfiles.1 mtime 2024-09-15T22:51:44.000000+0000, size 0 2024-09-15T22:51:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x55d6c3c3e6f0 msgr2=0x55d6c3b832c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x55d6c3c3e6f0 0x55d6c3b832c0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdf200662d0 msgr2=0x7fdf20068790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdf200662d0 0x7fdf20068790 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf30005d00 tx=0x7fdf3000c040 comp rx=0 tx=0).stop 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 msgr2=0x55d6c3c371b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 --2- 172.21.15.31:0/1651337080 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x55d6c3c1ac60 0x55d6c3c371b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0ad040 tx=0x7fdf2c018180 comp rx=0 tx=0).stop 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf3e400640 1 -- 172.21.15.31:0/1651337080 reap_dead start 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 shutdown_connections 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 >> 172.21.15.31:0/1651337080 conn(0x55d6c3b8c010 msgr2=0x55d6c3c1dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 shutdown_connections 2024-09-15T22:51:54.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54.367+0000 7fdf41449080 1 -- 172.21.15.31:0/1651337080 wait complete. 2024-09-15T22:51:54.377 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:51:54.378 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:51:54.487 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:51:54.591 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:54.598 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:51:54.599 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:51:54.599 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file0", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:51:54.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:54 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:51:54.787 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:55.065 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:55.276 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:55.539 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:55.812 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:56.019 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:56.284 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:56.593 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:56.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:51:56.607 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file1", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:51:56.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:56 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:51:56.789 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:57.067 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:57.278 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:57.541 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:57.814 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:57.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:57 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:51:57.827 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file2", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:51:57.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:57 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:51:58.021 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:58.286 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:58.791 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:59.069 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:59.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:51:59.082 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file3", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:51:59.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:51:59 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:51:59.280 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:51:59.543 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:00.023 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:00.288 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:00.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:00.302 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file4", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:52:00.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:00 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:52:00.793 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:01.281 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:01.545 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:01.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:01.558 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file5", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:52:01.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:01 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:52:02.025 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:02.795 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:02.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:02.809 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file6", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:52:02.853 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:02 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:52:03.283 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:04.027 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:04.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:04.041 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/open_file7", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:52:04.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:04 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:52:05.285 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:05.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:05.299 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:05.299 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:05.351 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:05.351 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:05.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:52:05.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.595+0000 7f79ad000640 1 Processor -- start 2024-09-15T22:52:05.600 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.595+0000 7f79ad000640 1 -- start start 2024-09-15T22:52:05.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79ad000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79a8073750 0x7f79a80b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79ad000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a815bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79ad000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79a80cfe60 con 0x7f79a815c000 2024-09-15T22:52:05.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79ad000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f79a80b4e30 con 0x7f79a8073750 2024-09-15T22:52:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79ad000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79a80d0100 con 0x7f79a80b49d0 2024-09-15T22:52:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f799d400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a815bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79a8073750 0x7f79a80b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f799d400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a815bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:49890/0 (socket says 172.21.15.31:49890) 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f799d400640 1 -- 172.21.15.31:0/672183731 learned_addr learned my addr 172.21.15.31:0/672183731 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f79a8073750 0x7f79a80b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57844/0 (socket says 172.21.15.31:57844) 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 -- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 msgr2=0x7f79a815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 --2- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a815bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 -- 172.21.15.31:0/672183731 >> v1:172.21.15.102:6789/0 conn(0x7f79a815c000 legacy=0x7f79a815ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.599+0000 7f79a5e00640 1 -- 172.21.15.31:0/672183731 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a80d03e0 con 0x7f79a8073750 2024-09-15T22:52:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79a5e00640 1 --2- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a80b4490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f799800ba60 tx=0x7f799801eb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e22cd110524cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79a5400640 1 -- 172.21.15.31:0/672183731 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980b4070 con 0x7f79a8073750 2024-09-15T22:52:05.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79a5400640 1 -- 172.21.15.31:0/672183731 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79980a7b30 con 0x7f79a8073750 2024-09-15T22:52:05.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79a5400640 1 -- 172.21.15.31:0/672183731 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79980af440 con 0x7f79a8073750 2024-09-15T22:52:05.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 msgr2=0x7f79a80b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 --2- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a80b4490 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f799800ba60 tx=0x7f799801eb40 comp rx=0 tx=0).stop 2024-09-15T22:52:05.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- 172.21.15.31:0/672183731 shutdown_connections 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 --2- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a815bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 --2- 172.21.15.31:0/672183731 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a80b4490 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- 172.21.15.31:0/672183731 >> 172.21.15.31:0/672183731 conn(0x7f79a80b20a0 msgr2=0x7f79a80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- 172.21.15.31:0/672183731 shutdown_connections 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- 172.21.15.31:0/672183731 wait complete. 2024-09-15T22:52:05.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 Processor -- start 2024-09-15T22:52:05.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.603+0000 7f79ad000640 1 -- start start 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a8152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a80b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80aef70 con 0x7f79a815c000 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f79a80aedf0 con 0x7f79a8073750 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79a8073b30 con 0x7f79a80b49d0 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35484/0 (socket says 172.21.15.31:35484) 2024-09-15T22:52:05.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 -- 172.21.15.31:0/269088089 learned_addr learned my addr 172.21.15.31:0/269088089 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:05.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a5e00640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a8152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f799d400640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a80b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 -- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 msgr2=0x7f79a80b0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a80b0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 -- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 msgr2=0x7f79a8152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a8152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 -- 172.21.15.31:0/269088089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79a8151590 con 0x7f79a815c000 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79a6800640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c730 tx=0x7f79a000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0003ba0 con 0x7f79a815c000 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79a0003d40 con 0x7f79a815c000 2024-09-15T22:52:05.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79a0005310 con 0x7f79a815c000 2024-09-15T22:52:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79a8156f80 con 0x7f79a815c000 2024-09-15T22:52:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79a8151b10 con 0x7f79a815c000 2024-09-15T22:52:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79a815c470 con 0x7f79a815c000 2024-09-15T22:52:05.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.607+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79a00056c0 con 0x7f79a815c000 2024-09-15T22:52:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.611+0000 7f799ea00640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 0x7f7984069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.611+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f79a0085e60 con 0x7f79a815c000 2024-09-15T22:52:05.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.611+0000 7f79a5e00640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 0x7f7984069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:05.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.611+0000 7f79a5e00640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 0x7f7984069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79980b1000 tx=0x7f79980a9070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:05.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.615+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f79a8156f80 con 0x7f79a815c000 2024-09-15T22:52:05.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.791+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f79a8151ce0 con 0x7f79a815c000 2024-09-15T22:52:05.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.791+0000 7f799ea00640 1 -- 172.21.15.31:0/269088089 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v45) ==== 80+0+122 (secure 0 0 0) 0x7f79a00560b0 con 0x7f79a815c000 2024-09-15T22:52:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6835/3813108153 2024-09-16T22:51:28.497858+0000 2024-09-15T22:52:05.796 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6833/3813108153 2024-09-16T22:51:28.497858+0000 2024-09-15T22:52:05.796 INFO:teuthology.orchestra.run.smithi031.stderr:listed 2 entries 2024-09-15T22:52:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 msgr2=0x7f7984069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 0x7f7984069d80 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f79980b1000 tx=0x7f79980a9070 comp rx=0 tx=0).stop 2024-09-15T22:52:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 msgr2=0x7f79a81564a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f79a000c730 tx=0x7f79a000cbf0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 shutdown_connections 2024-09-15T22:52:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79840678c0 0x7f7984069d80 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79a815c000 0x7f79a81564a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79a80b49d0 0x7f79a80b0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 --2- 172.21.15.31:0/269088089 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79a8073750 0x7f79a8152030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:05.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 >> 172.21.15.31:0/269088089 conn(0x7f79a80b20a0 msgr2=0x7f79a8154240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:05.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 shutdown_connections 2024-09-15T22:52:05.800 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:05.795+0000 7f79ad000640 1 -- 172.21.15.31:0/269088089 wait complete. 2024-09-15T22:52:05.818 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:52:05.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:05.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:05.894 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:52:05.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:05.894 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:52:05.913 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:05.913 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:05.913 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:05.922 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:05.922 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:05.922 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:05.922 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:05.965 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:52:05.965 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:05.965 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:05.965 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:05.975 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:05.975 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:06.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.143+0000 7fbdcf800640 1 Processor -- start 2024-09-15T22:52:06.148 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.143+0000 7fbdcf800640 1 -- start start 2024-09-15T22:52:06.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcf800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbdc8160110 0x7fbdc815f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.149 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcf800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 0x7fbdc815dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcf800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdc809aed0 con 0x7fbdc806d1b0 2024-09-15T22:52:06.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcf800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fbdc8160580 con 0x7fbdc8160110 2024-09-15T22:52:06.150 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcf800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc809b170 con 0x7fbdc809aa40 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbdc8160110 0x7fbdc815f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcd800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 0x7fbdc815dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fbdc8160110 0x7fbdc815f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:57862/0 (socket says 172.21.15.31:57862) 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 -- 172.21.15.31:0/3501741812 learned_addr learned my addr 172.21.15.31:0/3501741812 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 -- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 msgr2=0x7fbdc815dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 0x7fbdc815dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 -- 172.21.15.31:0/3501741812 >> v1:172.21.15.102:6789/0 conn(0x7fbdc806d1b0 legacy=0x7fbdc806d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7e00640 1 -- 172.21.15.31:0/3501741812 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc809b450 con 0x7fbdc8160110 2024-09-15T22:52:06.151 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdcd800640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 0x7fbdc815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:06.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.147+0000 7fbdc7400640 1 -- 172.21.15.31:0/3501741812 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2507531864 0 0) 0x7fbdc809aed0 con 0x7fbdc806d1b0 2024-09-15T22:52:06.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdc7e00640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc8160110 0x7fbdc815f7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009870 tx=0x7fbdb401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fbe44d86a3c087a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdc7400640 1 -- 172.21.15.31:0/3501741812 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40ab650 con 0x7fbdc8160110 2024-09-15T22:52:06.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdc7400640 1 -- 172.21.15.31:0/3501741812 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb40b0070 con 0x7fbdc8160110 2024-09-15T22:52:06.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdc7400640 1 -- 172.21.15.31:0/3501741812 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40aba10 con 0x7fbdc8160110 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc8160110 msgr2=0x7fbdc815f7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc8160110 0x7fbdc815f7b0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fbdb4009870 tx=0x7fbdb401c560 comp rx=0 tx=0).stop 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- 172.21.15.31:0/3501741812 shutdown_connections 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc809aa40 0x7fbdc815dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 --2- 172.21.15.31:0/3501741812 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc8160110 0x7fbdc815f7b0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- 172.21.15.31:0/3501741812 >> 172.21.15.31:0/3501741812 conn(0x7fbdc80d2380 msgr2=0x7fbdc80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- 172.21.15.31:0/3501741812 shutdown_connections 2024-09-15T22:52:06.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- 172.21.15.31:0/3501741812 wait complete. 2024-09-15T22:52:06.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 Processor -- start 2024-09-15T22:52:06.156 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.151+0000 7fbdcf800640 1 -- start start 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 0x7fbdc80c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc8160110 0x7fbdc8155e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc80b1ca0 con 0x7fbdc809aa40 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc80b1b20 con 0x7fbdc806d1b0 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fbdc815e940 con 0x7fbdc8160110 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35496/0 (socket says 172.21.15.31:35496) 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 -- 172.21.15.31:0/1968634327 learned_addr learned my addr 172.21.15.31:0/1968634327 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcd800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc8160110 0x7fbdc8155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcce00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 0x7fbdc80c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 -- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc8160110 msgr2=0x7fbdc8155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc8160110 0x7fbdc8155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 -- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 msgr2=0x7fbdc80c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 0x7fbdc80c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 -- 172.21.15.31:0/1968634327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc80c8af0 con 0x7fbdc809aa40 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcce00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 0x7fbdc80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:06.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc7e00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ad040 tx=0x7fbdb4019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40bf610 con 0x7fbdc809aa40 2024-09-15T22:52:06.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdb40bf7f0 con 0x7fbdc809aa40 2024-09-15T22:52:06.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc8157b10 con 0x7fbdc809aa40 2024-09-15T22:52:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb40bfbe0 con 0x7fbdc809aa40 2024-09-15T22:52:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc80b51d0 con 0x7fbdc809aa40 2024-09-15T22:52:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdc809ae50 con 0x7fbdc809aa40 2024-09-15T22:52:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.155+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fbdb40bd020 con 0x7fbdc809aa40 2024-09-15T22:52:06.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.159+0000 7fbdc4c00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.159+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7fbdb41205f0 con 0x7fbdc809aa40 2024-09-15T22:52:06.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.159+0000 7fbdcce00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.159+0000 7fbdcce00640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 0x7fbda8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8000f70 tx=0x7fbdb8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.163+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fbdc80c8af0 con 0x7fbdc809aa40 2024-09-15T22:52:06.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.359+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbdc80d3140 con 0x7fbdc809aa40 2024-09-15T22:52:06.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdc4c00640 1 -- 172.21.15.31:0/1968634327 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5227 (secure 0 0 0) 0x7fbdb4016150 con 0x7fbdc809aa40 2024-09-15T22:52:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:06.365 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-15T22:51:32:523802+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:32.523798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-15T22:52:06.365 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 msgr2=0x7fbda8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 0x7fbda8069d80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8000f70 tx=0x7fbdb8009040 comp rx=0 tx=0).stop 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 msgr2=0x7fbdc8155900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fbdb40ad040 tx=0x7fbdb4019300 comp rx=0 tx=0).stop 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 shutdown_connections 2024-09-15T22:52:06.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fbda80678c0 0x7fbda8069d80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fbdc8160110 0x7fbdc8155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fbdc809aa40 0x7fbdc8155900 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 --2- 172.21.15.31:0/1968634327 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fbdc806d1b0 0x7fbdc80c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 >> 172.21.15.31:0/1968634327 conn(0x7fbdc80d2380 msgr2=0x7fbdc8160700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 shutdown_connections 2024-09-15T22:52:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.363+0000 7fbdcf800640 1 -- 172.21.15.31:0/1968634327 wait complete. 2024-09-15T22:52:06.387 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.523+0000 7f7ede400640 1 Processor -- start 2024-09-15T22:52:06.528 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.523+0000 7f7ede400640 1 -- start start 2024-09-15T22:52:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ede400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 0x7f7ed806f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ede400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7ed806c300 0x7f7ed80cff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ede400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ed806ff80 con 0x7f7ed80d1bf0 2024-09-15T22:52:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ede400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed8070260 con 0x7f7ed806c300 2024-09-15T22:52:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ede400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7ed80cf720 con 0x7f7ed815e720 2024-09-15T22:52:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7ed806c300 0x7f7ed80cff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7ed806c300 0x7f7ed80cff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35502/0 (socket says 172.21.15.31:35502) 2024-09-15T22:52:06.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 -- 172.21.15.31:0/1683627488 learned_addr learned my addr 172.21.15.31:0/1683627488 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7400640 1 --2- 172.21.15.31:0/1683627488 >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 0x7f7ed806f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 -- 172.21.15.31:0/1683627488 >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 msgr2=0x7f7ed806f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 --2- 172.21.15.31:0/1683627488 >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 0x7f7ed806f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 -- 172.21.15.31:0/1683627488 >> v1:172.21.15.31:6789/0 conn(0x7f7ed80d1bf0 legacy=0x7f7ed806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7e00640 1 -- 172.21.15.31:0/1683627488 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed80cfa00 con 0x7f7ed806c300 2024-09-15T22:52:06.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.527+0000 7f7ed7400640 1 --2- 172.21.15.31:0/1683627488 >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 0x7f7ed806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:06.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ed7e00640 1 --2- 172.21.15.31:0/1683627488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed80cff20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80b4080 tx=0x7f7ed001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a99519ea51aefa server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ed6a00640 1 -- 172.21.15.31:0/1683627488 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00a58e0 con 0x7f7ed806c300 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ed6a00640 1 -- 172.21.15.31:0/1683627488 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ed00a5a80 con 0x7f7ed806c300 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ed6a00640 1 -- 172.21.15.31:0/1683627488 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ed00a5e50 con 0x7f7ed806c300 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- 172.21.15.31:0/1683627488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 msgr2=0x7f7ed80cff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 --2- 172.21.15.31:0/1683627488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed80cff20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7ed80b4080 tx=0x7f7ed001c9f0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- 172.21.15.31:0/1683627488 shutdown_connections 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 --2- 172.21.15.31:0/1683627488 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed80cff20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 --2- 172.21.15.31:0/1683627488 >> v2:172.21.15.102:3300/0 conn(0x7f7ed815e720 0x7f7ed806f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- 172.21.15.31:0/1683627488 >> 172.21.15.31:0/1683627488 conn(0x7f7ed80b67e0 msgr2=0x7f7ed80b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- 172.21.15.31:0/1683627488 shutdown_connections 2024-09-15T22:52:06.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- 172.21.15.31:0/1683627488 wait complete. 2024-09-15T22:52:06.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 Processor -- start 2024-09-15T22:52:06.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 -- start start 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.531+0000 7f7ede400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 0x7f7ed814a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ed815e720 0x7f7ed815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed816b200 con 0x7f7ed806c300 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed816b380 con 0x7f7ed80d1bf0 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed816b500 con 0x7f7ed815e720 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35518/0 (socket says 172.21.15.31:35518) 2024-09-15T22:52:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 -- 172.21.15.31:0/2561034470 learned_addr learned my addr 172.21.15.31:0/2561034470 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecfe00640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 0x7f7ed814a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7e00640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ed815e720 0x7f7ed815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 -- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ed815e720 msgr2=0x7f7ed815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ed815e720 0x7f7ed815d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 -- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 msgr2=0x7f7ed814a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 0x7f7ed814a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 -- 172.21.15.31:0/2561034470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed814feb0 con 0x7f7ed806c300 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecfe00640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 0x7f7ed814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ed7400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c820 tx=0x7f7ec800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8015070 con 0x7f7ed806c300 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ec8007a30 con 0x7f7ed806c300 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec8007e40 con 0x7f7ed806c300 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed8150190 con 0x7f7ed806c300 2024-09-15T22:52:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed8150750 con 0x7f7ed806c300 2024-09-15T22:52:06.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed80cff20 con 0x7f7ed806c300 2024-09-15T22:52:06.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.535+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ec8018070 con 0x7f7ed806c300 2024-09-15T22:52:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.539+0000 7f7ecf400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 0x7f7eb4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.539+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f7ec8085f00 con 0x7f7ed806c300 2024-09-15T22:52:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.539+0000 7f7ecfe00640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 0x7f7eb4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.539+0000 7f7ecfe00640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 0x7f7eb4069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8152010 tx=0x7f7ec0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.543+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ec8056710 con 0x7f7ed806c300 2024-09-15T22:52:06.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.743+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ed80aea90 con 0x7f7ed806c300 2024-09-15T22:52:06.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ecf400640 1 -- 172.21.15.31:0/2561034470 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5227 (secure 0 0 0) 0x7f7ec8056010 con 0x7f7ed806c300 2024-09-15T22:52:06.749 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:06.749 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-15T22:51:32:523802+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:32.523798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-15T22:52:06.749 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 msgr2=0x7f7eb4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 0x7f7eb4069d80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8152010 tx=0x7f7ec0009040 comp rx=0 tx=0).stop 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 msgr2=0x7f7ed8159110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f7ec800c820 tx=0x7f7ec800cce0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 shutdown_connections 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7eb40678c0 0x7f7eb4069d80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ed815e720 0x7f7ed815d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ed80d1bf0 0x7f7ed814a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 --2- 172.21.15.31:0/2561034470 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ed806c300 0x7f7ed8159110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 >> 172.21.15.31:0/2561034470 conn(0x7f7ed80b67e0 msgr2=0x7f7ed81529c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 shutdown_connections 2024-09-15T22:52:06.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.747+0000 7f7ede400640 1 -- 172.21.15.31:0/2561034470 wait complete. 2024-09-15T22:52:06.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 Processor -- start 2024-09-15T22:52:06.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 -- start start 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 0x7f67140b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67140cfe60 con 0x7f67140b49d0 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67140d0100 con 0x7f671415c1d0 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.907+0000 7f6718a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f671415c650 con 0x7f6714073750 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6709400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f67140b49d0 0x7f671415bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45586/0 (socket says 172.21.15.31:45586) 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6709400640 1 -- 172.21.15.31:0/3280208846 learned_addr learned my addr 172.21.15.31:0/3280208846 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711e00640 1 --2- 172.21.15.31:0/3280208846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 0x7f67140b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496588230 0 0) 0x7f67140cfe60 con 0x7f67140b49d0 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66f8005740 con 0x7f67140b49d0 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608361571 0 0) 0x7f67140d0100 con 0x7f671415c1d0 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67140cfe60 con 0x7f671415c1d0 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711e00640 1 -- 172.21.15.31:0/3280208846 >> v1:172.21.15.102:6789/0 conn(0x7f671415c1d0 legacy=0x7f67140adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711e00640 1 -- 172.21.15.31:0/3280208846 >> v1:172.21.15.31:6789/0 conn(0x7f67140b49d0 legacy=0x7f671415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.911+0000 7f6711e00640 1 -- 172.21.15.31:0/3280208846 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67140d03e0 con 0x7f6714073750 2024-09-15T22:52:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6711e00640 1 --2- 172.21.15.31:0/3280208846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 0x7f67140b4490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67040097f0 tx=0x7f670401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d33978857760d28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040b1070 con 0x7f6714073750 2024-09-15T22:52:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67040ac630 con 0x7f6714073750 2024-09-15T22:52:06.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6711400640 1 -- 172.21.15.31:0/3280208846 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67040a8050 con 0x7f6714073750 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- 172.21.15.31:0/3280208846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 msgr2=0x7f67140b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 --2- 172.21.15.31:0/3280208846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 0x7f67140b4490 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f67040097f0 tx=0x7f670401c4e0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- 172.21.15.31:0/3280208846 shutdown_connections 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 --2- 172.21.15.31:0/3280208846 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6714073750 0x7f67140b4490 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- 172.21.15.31:0/3280208846 >> 172.21.15.31:0/3280208846 conn(0x7f67140b20a0 msgr2=0x7f67140b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- 172.21.15.31:0/3280208846 shutdown_connections 2024-09-15T22:52:06.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- 172.21.15.31:0/3280208846 wait complete. 2024-09-15T22:52:06.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 Processor -- start 2024-09-15T22:52:06.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- start start 2024-09-15T22:52:06.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6714073750 0x7f6714153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671415c1d0 0x7f671406fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6714073cb0 con 0x7f67140b49d0 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6714073b30 con 0x7f6714073750 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6718a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f67140b32d0 con 0x7f671415c1d0 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6709400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6709400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35532/0 (socket says 172.21.15.31:35532) 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.915+0000 7f6709400640 1 -- 172.21.15.31:0/3087260051 learned_addr learned my addr 172.21.15.31:0/3087260051 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6712800640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671415c1d0 0x7f671406fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6711e00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6714073750 0x7f6714153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 -- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671415c1d0 msgr2=0x7f671406fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671415c1d0 0x7f671406fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 -- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6714073750 msgr2=0x7f6714153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6714073750 0x7f6714153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 -- 172.21.15.31:0/3087260051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6714154040 con 0x7f67140b49d0 2024-09-15T22:52:06.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6709400640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c4d0 tx=0x7f66fc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc017070 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66fc005cf0 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc007270 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6714154b80 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67141545c0 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67140b0fe0 con 0x7f67140b49d0 2024-09-15T22:52:06.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.919+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f66fc01a070 con 0x7f67140b49d0 2024-09-15T22:52:06.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.923+0000 7f670aa00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 0x7f66f0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:06.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.923+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f66fc0850f0 con 0x7f67140b49d0 2024-09-15T22:52:06.925 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.923+0000 7f6711e00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 0x7f66f0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:06.926 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.923+0000 7f6711e00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 0x7f66f0069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67040ae000 tx=0x7f67040a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:06.929 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:06.927+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f66fc055450 con 0x7f67140b49d0 2024-09-15T22:52:07.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.091+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f67140b0a20 con 0x7f67140b49d0 2024-09-15T22:52:07.096 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.091+0000 7f670aa00640 1 -- 172.21.15.31:0/3087260051 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+17144 (secure 0 0 0) 0x7f66fc059750 con 0x7f67140b49d0 2024-09-15T22:52:07.096 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:07.097 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":45,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:51:59.639967+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:51:13.528767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T22:51:14.356901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/3813108153":"2024-09-16T22:51:28.497858+0000","172.21.15.31:6833/3813108153":"2024-09-16T22:51:28.497858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 msgr2=0x7f66f0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 0x7f66f0069d80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f67040ae000 tx=0x7f67040a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 msgr2=0x7f671406f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00c4d0 tx=0x7f66fc00c990 comp rx=0 tx=0).stop 2024-09-15T22:52:07.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 shutdown_connections 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f66f00678c0 0x7f66f0069d80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f671415c1d0 0x7f671406fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f67140b49d0 0x7f671406f7a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 --2- 172.21.15.31:0/3087260051 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6714073750 0x7f6714153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 >> 172.21.15.31:0/3087260051 conn(0x7f67140b20a0 msgr2=0x7f671415b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 shutdown_connections 2024-09-15T22:52:07.099 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.095+0000 7f6718a00640 1 -- 172.21.15.31:0/3087260051 wait complete. 2024-09-15T22:52:07.118 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:52:07.118 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:07.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 Processor -- start 2024-09-15T22:52:07.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 -- start start 2024-09-15T22:52:07.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9ec073750 0x7fb9ec0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 0x7fb9ec15bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9ec0cfe60 con 0x7fb9ec15c000 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0d0100 con 0x7fb9ec073750 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f4800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb9ec0d03e0 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f1e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9ec073750 0x7fb9ec0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f1e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb9ec073750 0x7fb9ec0b4490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35536/0 (socket says 172.21.15.31:35536) 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.255+0000 7fb9f1e00640 1 -- 172.21.15.31:0/748902648 learned_addr learned my addr 172.21.15.31:0/748902648 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1400640 1 --2- 172.21.15.31:0/748902648 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 0x7fb9ec15bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1e00640 1 -- 172.21.15.31:0/748902648 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 msgr2=0x7fb9ec15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1e00640 1 --2- 172.21.15.31:0/748902648 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 0x7fb9ec15bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1e00640 1 -- 172.21.15.31:0/748902648 >> v1:172.21.15.102:6789/0 conn(0x7fb9ec15c000 legacy=0x7fb9ec15ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1e00640 1 -- 172.21.15.31:0/748902648 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec0d06c0 con 0x7fb9ec073750 2024-09-15T22:52:07.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1400640 1 --2- 172.21.15.31:0/748902648 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 0x7fb9ec15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:07.263 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f1e00640 1 --2- 172.21.15.31:0/748902648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec073750 0x7fb9ec0b4490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0704a0 tx=0x7fb9e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3201727d3202cc6 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f0a00640 1 -- 172.21.15.31:0/748902648 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e00b0070 con 0x7fb9ec073750 2024-09-15T22:52:07.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f0a00640 1 -- 172.21.15.31:0/748902648 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9e0004230 con 0x7fb9ec073750 2024-09-15T22:52:07.264 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.259+0000 7fb9f0a00640 1 -- 172.21.15.31:0/748902648 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9e0003620 con 0x7fb9ec073750 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- 172.21.15.31:0/748902648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec073750 msgr2=0x7fb9ec0b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- 172.21.15.31:0/748902648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec073750 0x7fb9ec0b4490 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0704a0 tx=0x7fb9e001c520 comp rx=0 tx=0).stop 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- 172.21.15.31:0/748902648 shutdown_connections 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- 172.21.15.31:0/748902648 >> v2:172.21.15.102:3300/0 conn(0x7fb9ec0b49d0 0x7fb9ec15bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- 172.21.15.31:0/748902648 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec073750 0x7fb9ec0b4490 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- 172.21.15.31:0/748902648 >> 172.21.15.31:0/748902648 conn(0x7fb9ec0b20a0 msgr2=0x7fb9ec0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- 172.21.15.31:0/748902648 shutdown_connections 2024-09-15T22:52:07.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- 172.21.15.31:0/748902648 wait complete. 2024-09-15T22:52:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 Processor -- start 2024-09-15T22:52:07.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- start start 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec073750 0x7fb9ec099980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 0x7fb9ec142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec073cb0 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb9ec073b30 con 0x7fb9ec15c000 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f4800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb9ec15c410 con 0x7fb9ec073750 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.268 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35540/0 (socket says 172.21.15.31:35540) 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 -- 172.21.15.31:0/2841324918 learned_addr learned my addr 172.21.15.31:0/2841324918 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1e00640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec073750 0x7fb9ec099980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f2800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 0x7fb9ec142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 -- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec073750 msgr2=0x7fb9ec099980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec073750 0x7fb9ec099980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 -- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 msgr2=0x7fb9ec142510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 0x7fb9ec142510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 -- 172.21.15.31:0/2841324918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9ec099ec0 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f2800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 0x7fb9ec142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.263+0000 7fb9f1400640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00e810 tx=0x7fb9dc00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc017070 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9dc00c8d0 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9dc00f040 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9ec140d50 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9ec141310 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9ec0b2860 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb9dc01a070 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7fb9dc085a20 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.267+0000 7fb9f1e00640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.271+0000 7fb9f1e00640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 0x7fb9d0069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00ad000 tx=0x7fb9e00a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.271+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb9dc055c70 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb9ec0b3a30 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9e6000640 1 -- 172.21.15.31:0/2841324918 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5227 (secure 0 0 0) 0x7fb9dc059f70 con 0x7fb9ec0b49d0 2024-09-15T22:52:07.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:07.474 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-15T22:51:32:523802+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:32.523798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-15T22:52:07.474 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 msgr2=0x7fb9d0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 0x7fb9d0069d80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fb9e00ad000 tx=0x7fb9e00a6000 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 msgr2=0x7fb9ec141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc00e810 tx=0x7fb9dc00ecd0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 shutdown_connections 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb9d00678c0 0x7fb9d0069d80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb9ec15c000 0x7fb9ec142510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb9ec0b49d0 0x7fb9ec141fd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 --2- 172.21.15.31:0/2841324918 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb9ec073750 0x7fb9ec099980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 >> 172.21.15.31:0/2841324918 conn(0x7fb9ec0b20a0 msgr2=0x7fb9ec15a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:07.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 shutdown_connections 2024-09-15T22:52:07.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.471+0000 7fb9f4800640 1 -- 172.21.15.31:0/2841324918 wait complete. 2024-09-15T22:52:07.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 Processor -- start 2024-09-15T22:52:07.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 -- start start 2024-09-15T22:52:07.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b015fb60 0x7f33b0071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33b009b730 0x7f33b00d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b0071030 con 0x7f33b00d0920 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f33b009ac50 con 0x7f33b009b730 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33b5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f33b009af30 con 0x7f33b015fb60 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33b009b730 0x7f33b00d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f33b009b730 0x7f33b00d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35556/0 (socket says 172.21.15.31:35556) 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33af400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f33b00d0920 0x7f33b00ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45598/0 (socket says 172.21.15.31:45598) 2024-09-15T22:52:07.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 -- 172.21.15.31:0/2223124758 learned_addr learned my addr 172.21.15.31:0/2223124758 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:07.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33aea00640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b015fb60 0x7f33b0071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 -- 172.21.15.31:0/2223124758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b015fb60 msgr2=0x7f33b0071e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:07.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b015fb60 0x7f33b0071e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 -- 172.21.15.31:0/2223124758 >> v1:172.21.15.31:6789/0 conn(0x7f33b00d0920 legacy=0x7f33b00ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.635+0000 7f33a7e00640 1 -- 172.21.15.31:0/2223124758 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b009b210 con 0x7f33b009b730 2024-09-15T22:52:07.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33a7e00640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00d03e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f339801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75b10e8a9fa0d480 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33ae000640 1 -- 172.21.15.31:0/2223124758 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33980b2070 con 0x7f33b009b730 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33ae000640 1 -- 172.21.15.31:0/2223124758 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33980a9070 con 0x7f33b009b730 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33ae000640 1 -- 172.21.15.31:0/2223124758 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33980ad880 con 0x7f33b009b730 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- 172.21.15.31:0/2223124758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 msgr2=0x7f33b00d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00d03e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3398009870 tx=0x7f339801c560 comp rx=0 tx=0).stop 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- 172.21.15.31:0/2223124758 shutdown_connections 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00d03e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 --2- 172.21.15.31:0/2223124758 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b015fb60 0x7f33b0071e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- 172.21.15.31:0/2223124758 >> 172.21.15.31:0/2223124758 conn(0x7f33b00d2370 msgr2=0x7f33b00d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- 172.21.15.31:0/2223124758 shutdown_connections 2024-09-15T22:52:07.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- 172.21.15.31:0/2223124758 wait complete. 2024-09-15T22:52:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 Processor -- start 2024-09-15T22:52:07.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.639+0000 7f33b5800640 1 -- start start 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b00d0920 0x7f33b014d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33b015fb60 0x7f33b0156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f33b0071720 con 0x7f33b009b730 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f33b00715a0 con 0x7f33b015fb60 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f33b009bb70 con 0x7f33b00d0920 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35570/0 (socket says 172.21.15.31:35570) 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 -- 172.21.15.31:0/1582022715 learned_addr learned my addr 172.21.15.31:0/1582022715 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33a7e00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b00d0920 0x7f33b014d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33af400640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33b015fb60 0x7f33b0156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 -- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b00d0920 msgr2=0x7f33b014d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b00d0920 0x7f33b014d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 -- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33b015fb60 msgr2=0x7f33b0156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33b015fb60 0x7f33b0156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 -- 172.21.15.31:0/1582022715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b0156b40 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33aea00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33a000d5f0 tx=0x7f33a000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00125f0 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a0019070 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a00129b0 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b00b12c0 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b00b1dd0 con 0x7f33b009b730 2024-09-15T22:52:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.643+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b00cfd70 con 0x7f33b009b730 2024-09-15T22:52:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.647+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f33a0012b50 con 0x7f33b009b730 2024-09-15T22:52:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.647+0000 7f33a6a00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 0x7f338c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.647+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f33a00862e0 con 0x7f33b009b730 2024-09-15T22:52:07.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.647+0000 7f33a7e00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 0x7f338c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:07.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.647+0000 7f33a7e00640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 0x7f338c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f33980af000 tx=0x7f3398008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:07.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.651+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f33b0156b40 con 0x7f33b009b730 2024-09-15T22:52:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.855+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33b00d2fd0 con 0x7f33b009b730 2024-09-15T22:52:07.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.855+0000 7f33a6a00640 1 -- 172.21.15.31:0/1582022715 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+5227 (secure 0 0 0) 0x7f33a0056c10 con 0x7f33b009b730 2024-09-15T22:52:07.859 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:07.859 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":24,"btime":"2024-09-15T22:51:32:523802+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:51:15.411968+0000","modified":"2024-09-15T22:51:32.523798+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":42,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5103},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5103":{"gid":5103,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6834/263357593","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":263357593},{"type":"v1","addr":"172.21.15.31:6834","nonce":263357593}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5103,"qdb_cluster":[5103]},"id":2}]} 2024-09-15T22:52:07.859 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 24 2024-09-15T22:52:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 msgr2=0x7f338c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 0x7f338c069d80 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f33980af000 tx=0x7f3398008040 comp rx=0 tx=0).stop 2024-09-15T22:52:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 msgr2=0x7f33b00b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:07.861 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f33a000d5f0 tx=0x7f33a000dab0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 shutdown_connections 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f338c0678c0 0x7f338c069d80 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f33b015fb60 0x7f33b0156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f33b00d0920 0x7f33b014d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 --2- 172.21.15.31:0/1582022715 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f33b009b730 0x7f33b00b0c70 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 >> 172.21.15.31:0/1582022715 conn(0x7f33b00d2370 msgr2=0x7f33b00d2750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 shutdown_connections 2024-09-15T22:52:07.862 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:07.859+0000 7f33b5800640 1 -- 172.21.15.31:0/1582022715 wait complete. 2024-09-15T22:52:07.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:08.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 Processor -- start 2024-09-15T22:52:08.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 -- start start 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 0x7fe5a415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 0x7fe5a40adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5a40cfe60 con 0x7fe5a4073750 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe5a40d0100 con 0x7fe5a415c000 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a40d03e0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a3400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 0x7fe5a40adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a2a00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7fe5a4073750 0x7fe5a40b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:40394/0 (socket says 172.21.15.31:40394) 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a2a00640 1 -- 172.21.15.31:0/2419556102 learned_addr learned my addr 172.21.15.31:0/2419556102 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe59a000640 1 --2- 172.21.15.31:0/2419556102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 0x7fe5a415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe59a000640 1 -- 172.21.15.31:0/2419556102 >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 msgr2=0x7fe5a40adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe59a000640 1 --2- 172.21.15.31:0/2419556102 >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 0x7fe5a40adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe59a000640 1 -- 172.21.15.31:0/2419556102 >> v1:172.21.15.102:6789/0 conn(0x7fe5a4073750 legacy=0x7fe5a40b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe59a000640 1 -- 172.21.15.31:0/2419556102 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a40d06c0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.019+0000 7fe5a3400640 1 --2- 172.21.15.31:0/2419556102 >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 0x7fe5a40adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:08.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe59a000640 1 --2- 172.21.15.31:0/2419556102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 0x7fe5a415bac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097c0 tx=0x7fe58c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=81a796fbbcb6a7bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a2000640 1 -- 172.21.15.31:0/2419556102 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0aa5f0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a2000640 1 -- 172.21.15.31:0/2419556102 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c0af070 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a2000640 1 -- 172.21.15.31:0/2419556102 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0aa9b0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 -- 172.21.15.31:0/2419556102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 msgr2=0x7fe5a415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/2419556102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 0x7fe5a415bac0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe58c0097c0 tx=0x7fe58c01c470 comp rx=0 tx=0).stop 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 -- 172.21.15.31:0/2419556102 shutdown_connections 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/2419556102 >> v2:172.21.15.102:3300/0 conn(0x7fe5a415c000 0x7fe5a40adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/2419556102 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a40b4ba0 0x7fe5a415bac0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 -- 172.21.15.31:0/2419556102 >> 172.21.15.31:0/2419556102 conn(0x7fe5a40b20a0 msgr2=0x7fe5a40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 -- 172.21.15.31:0/2419556102 shutdown_connections 2024-09-15T22:52:08.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.023+0000 7fe5a9c00640 1 -- 172.21.15.31:0/2419556102 wait complete. 2024-09-15T22:52:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 Processor -- start 2024-09-15T22:52:08.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- start start 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5a4073750 0x7fe5a414fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a415c000 0x7fe5a414c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a415c590 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe5a415c410 con 0x7fe5a4073750 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe5a40aeb30 con 0x7fe5a415c000 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35586/0 (socket says 172.21.15.31:35586) 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a2a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5a4073750 0x7fe5a414fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 -- 172.21.15.31:0/3621921973 learned_addr learned my addr 172.21.15.31:0/3621921973 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:08.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a3400640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a415c000 0x7fe5a414c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 -- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a415c000 msgr2=0x7fe5a414c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a415c000 0x7fe5a414c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 -- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5a4073750 msgr2=0x7fe5a414fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5a4073750 0x7fe5a414fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 -- 172.21.15.31:0/3621921973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5a4150bf0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59a000640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01a0a0 tx=0x7fe58c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0be610 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c0be7d0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c0bebc0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5a4150ed0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.027+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5a4151490 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5a415bac0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe58c0bc020 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe59b400640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 0x7fe580069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7fe58c120070 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe5a2a00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 0x7fe580069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.031+0000 7fe5a2a00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 0x7fe580069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.035+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe58c0c5030 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.199+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5a4152ec0 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe59b400640 1 -- 172.21.15.31:0/3621921973 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+17144 (secure 0 0 0) 0x7fe58c016090 con 0x7fe5a40b4ba0 2024-09-15T22:52:08.206 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:08.206 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":45,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:51:59.639967+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:51:13.528767+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2024-09-15T22:51:14.356901+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.26","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/3813108153":"2024-09-16T22:51:28.497858+0000","172.21.15.31:6833/3813108153":"2024-09-16T22:51:28.497858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 msgr2=0x7fe580069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 0x7fe580069d80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe594000f70 tx=0x7fe594009040 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 msgr2=0x7fe5a4151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01a0a0 tx=0x7fe58c01acb0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 shutdown_connections 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe5800678c0 0x7fe580069d80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe5a415c000 0x7fe5a414c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe5a40b4ba0 0x7fe5a4151c90 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 --2- 172.21.15.31:0/3621921973 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe5a4073750 0x7fe5a414fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.208 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 >> 172.21.15.31:0/3621921973 conn(0x7fe5a40b20a0 msgr2=0x7fe5a406e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 shutdown_connections 2024-09-15T22:52:08.209 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.203+0000 7fe5a9c00640 1 -- 172.21.15.31:0/3621921973 wait complete. 2024-09-15T22:52:08.227 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:52:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 Processor -- start 2024-09-15T22:52:08.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 -- start start 2024-09-15T22:52:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 0x7f4b5015d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b500cd920 con 0x7f4b500722e0 2024-09-15T22:52:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b500cdc00 con 0x7f4b500cd120 2024-09-15T22:52:08.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b57a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b500cf0d0 con 0x7f4b50159ff0 2024-09-15T22:52:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b55a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4b500722e0 0x7f4b5015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45610/0 (socket says 172.21.15.31:45610) 2024-09-15T22:52:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b55a00640 1 -- 172.21.15.31:0/3948080561 learned_addr learned my addr 172.21.15.31:0/3948080561 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b55000640 1 --2- 172.21.15.31:0/3948080561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 0x7f4b5015d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 949229414 0 0) 0x7f4b500cd920 con 0x7f4b500722e0 2024-09-15T22:52:08.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b34003530 con 0x7f4b500722e0 2024-09-15T22:52:08.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b55000640 1 -- 172.21.15.31:0/3948080561 >> v1:172.21.15.102:6789/0 conn(0x7f4b500cd120 legacy=0x7f4b500ce9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4159495510 0 0) 0x7f4b500cdc00 con 0x7f4b500cd120 2024-09-15T22:52:08.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.367+0000 7f4b55000640 1 -- 172.21.15.31:0/3948080561 >> v1:172.21.15.31:6789/0 conn(0x7f4b500722e0 legacy=0x7f4b5015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b55000640 1 -- 172.21.15.31:0/3948080561 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500cdee0 con 0x7f4b50159ff0 2024-09-15T22:52:08.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b55000640 1 --2- 172.21.15.31:0/3948080561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 0x7f4b5015d550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097f0 tx=0x7f4b4001c320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e668b9223116538 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400b0070 con 0x7f4b50159ff0 2024-09-15T22:52:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b400ab400 con 0x7f4b50159ff0 2024-09-15T22:52:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b4fe00640 1 -- 172.21.15.31:0/3948080561 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b48001a00 con 0x7f4b50159ff0 2024-09-15T22:52:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 -- 172.21.15.31:0/3948080561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 msgr2=0x7f4b5015d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 --2- 172.21.15.31:0/3948080561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 0x7f4b5015d550 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b400097f0 tx=0x7f4b4001c320 comp rx=0 tx=0).stop 2024-09-15T22:52:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 -- 172.21.15.31:0/3948080561 shutdown_connections 2024-09-15T22:52:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 --2- 172.21.15.31:0/3948080561 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b50159ff0 0x7f4b5015d550 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 -- 172.21.15.31:0/3948080561 >> 172.21.15.31:0/3948080561 conn(0x7f4b5006bbf0 msgr2=0x7f4b5006c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 -- 172.21.15.31:0/3948080561 shutdown_connections 2024-09-15T22:52:08.377 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.371+0000 7f4b57a00640 1 -- 172.21.15.31:0/3948080561 wait complete. 2024-09-15T22:52:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 Processor -- start 2024-09-15T22:52:08.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- start start 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b500cd120 0x7f4b500b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b50159ff0 0x7f4b500cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500cd6a0 con 0x7f4b500722e0 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4b500cd520 con 0x7f4b50159ff0 2024-09-15T22:52:08.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4b5016a770 con 0x7f4b500cd120 2024-09-15T22:52:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35600/0 (socket says 172.21.15.31:35600) 2024-09-15T22:52:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 -- 172.21.15.31:0/1071857993 learned_addr learned my addr 172.21.15.31:0/1071857993 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b50159ff0 0x7f4b500cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b47e00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b500cd120 0x7f4b500b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 -- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b500cd120 msgr2=0x7f4b500b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b500cd120 0x7f4b500b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 -- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b50159ff0 msgr2=0x7f4b500cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b50159ff0 0x7f4b500cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 -- 172.21.15.31:0/1071857993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b500ca6b0 con 0x7f4b500722e0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b55000640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009740 tx=0x7f4b400190c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400bd020 con 0x7f4b500722e0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b40004020 con 0x7f4b500722e0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b400b0040 con 0x7f4b500722e0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5014ff20 con 0x7f4b500722e0 2024-09-15T22:52:08.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.375+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b501504e0 con 0x7f4b500722e0 2024-09-15T22:52:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b5015d550 con 0x7f4b500722e0 2024-09-15T22:52:08.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4b400c0070 con 0x7f4b500722e0 2024-09-15T22:52:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b4d600640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 0x7f4b2c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 6216+0+0 (secure 0 0 0) 0x7f4b4011f780 con 0x7f4b500722e0 2024-09-15T22:52:08.383 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b47e00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 0x7f4b2c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.379+0000 7f4b47e00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 0x7f4b2c069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b500ccab0 tx=0x7f4b38009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.387 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.383+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4b40015fd0 con 0x7f4b500722e0 2024-09-15T22:52:08.590 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.587+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f4b50050020 con 0x7f4b500722e0 2024-09-15T22:52:08.590 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-15T22:52:08.587+0000 7f89b4600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:52:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.587+0000 7f4b4d600640 1 -- 172.21.15.31:0/1071857993 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v25) ==== 161+0+0 (secure 0 0 0) 0x7f4b400ef9d0 con 0x7f4b500722e0 2024-09-15T22:52:08.592 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 msgr2=0x7f4b2c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 0x7f4b2c069d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b500ccab0 tx=0x7f4b38009040 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 msgr2=0x7f4b500c9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4b40009740 tx=0x7f4b400190c0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 shutdown_connections 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4b2c0678c0 0x7f4b2c069d80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4b50159ff0 0x7f4b500cbe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4b500cd120 0x7f4b500b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 --2- 172.21.15.31:0/1071857993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4b500722e0 0x7f4b500c9e60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 >> 172.21.15.31:0/1071857993 conn(0x7f4b5006bbf0 msgr2=0x7f4b500b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:08.596 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 shutdown_connections 2024-09-15T22:52:08.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.591+0000 7f4b57a00640 1 -- 172.21.15.31:0/1071857993 wait complete. 2024-09-15T22:52:08.606 INFO:tasks.ceph.mds.a.smithi031.stderr: -9545> 2024-09-15T22:51:33.508+0000 7f4805800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:52:08.617 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:52:08.659 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:52:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 Processor -- start 2024-09-15T22:52:08.762 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 -- start start 2024-09-15T22:52:08.763 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7ae00b47c0 0x7f7ae006e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae006eff0 con 0x7f7ae015c3a0 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ae006f2d0 con 0x7f7ae00ad850 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae7600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7ae015d790 con 0x7f7ae00b47c0 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae4c00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7ae015c3a0 0x7f7ae00ad140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45616/0 (socket says 172.21.15.31:45616) 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae4c00640 1 -- 172.21.15.31:0/2454166921 learned_addr learned my addr 172.21.15.31:0/2454166921 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae5600640 1 --2- 172.21.15.31:0/2454166921 >> v2:172.21.15.31:3300/0 conn(0x7f7ae00b47c0 0x7f7ae006e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae5600640 1 -- 172.21.15.31:0/2454166921 >> v1:172.21.15.102:6789/0 conn(0x7f7ae00ad850 legacy=0x7f7ae006e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.764 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7adf400640 1 -- 172.21.15.31:0/2454166921 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245916224 0 0) 0x7f7ae006eff0 con 0x7f7ae015c3a0 2024-09-15T22:52:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae5600640 1 -- 172.21.15.31:0/2454166921 >> v1:172.21.15.31:6789/0 conn(0x7f7ae015c3a0 legacy=0x7f7ae00ad140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.765 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.759+0000 7f7ae5600640 1 -- 172.21.15.31:0/2454166921 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae006f5b0 con 0x7f7ae00b47c0 2024-09-15T22:52:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae5600640 1 --2- 172.21.15.31:0/2454166921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00b47c0 0x7f7ae006e990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80097c0 tx=0x7f7ad801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373b7748e53b920e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7adf400640 1 -- 172.21.15.31:0/2454166921 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80b0070 con 0x7f7ae00b47c0 2024-09-15T22:52:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7adf400640 1 -- 172.21.15.31:0/2454166921 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad80ab600 con 0x7f7ae00b47c0 2024-09-15T22:52:08.767 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7adf400640 1 -- 172.21.15.31:0/2454166921 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad80ab9d0 con 0x7f7ae00b47c0 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 -- 172.21.15.31:0/2454166921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00b47c0 msgr2=0x7f7ae006e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 --2- 172.21.15.31:0/2454166921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00b47c0 0x7f7ae006e990 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7ad80097c0 tx=0x7f7ad801c380 comp rx=0 tx=0).stop 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 -- 172.21.15.31:0/2454166921 shutdown_connections 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 --2- 172.21.15.31:0/2454166921 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00b47c0 0x7f7ae006e990 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 -- 172.21.15.31:0/2454166921 >> 172.21.15.31:0/2454166921 conn(0x7f7ae006bbf0 msgr2=0x7f7ae006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 -- 172.21.15.31:0/2454166921 shutdown_connections 2024-09-15T22:52:08.768 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.763+0000 7f7ae7600640 1 -- 172.21.15.31:0/2454166921 wait complete. 2024-09-15T22:52:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 Processor -- start 2024-09-15T22:52:08.769 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- start start 2024-09-15T22:52:08.770 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ae00b47c0 0x7f7ae01450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 0x7f7ae01455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0169d50 con 0x7f7ae00ad850 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae0169bd0 con 0x7f7ae015c3a0 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7ae0169ed0 con 0x7f7ae00b47c0 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35640/0 (socket says 172.21.15.31:35640) 2024-09-15T22:52:08.771 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 -- 172.21.15.31:0/3808262477 learned_addr learned my addr 172.21.15.31:0/3808262477 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:08.772 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 -- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ae00b47c0 msgr2=0x7f7ae01450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ae00b47c0 0x7f7ae01450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 -- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 msgr2=0x7f7ae01455e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae5600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 0x7f7ae01455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 0x7f7ae01455e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 -- 172.21.15.31:0/3808262477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae0153d10 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae5600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 0x7f7ae01455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae4c00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c780 tx=0x7f7ad400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4018070 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad400a640 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad400aab0 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae0153470 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.767+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae0153a30 con 0x7f7ae00ad850 2024-09-15T22:52:08.773 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ae00ad140 con 0x7f7ae00ad850 2024-09-15T22:52:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7ad401b070 con 0x7f7ae00ad850 2024-09-15T22:52:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7adcc00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 0x7f7ac0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:08.774 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6302+0+0 (secure 0 0 0) 0x7f7ad4085540 con 0x7f7ae00ad850 2024-09-15T22:52:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7adfe00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 0x7f7ac0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:08.775 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.771+0000 7f7adfe00640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 0x7f7ac0069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000f70 tx=0x7f7acc0079c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:08.778 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.775+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7ad4055d90 con 0x7f7ae00ad850 2024-09-15T22:52:08.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:08.975+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7ae015bbb0 con 0x7f7ae00ad850 2024-09-15T22:52:09.594 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.591+0000 7f7adcc00640 1 -- 172.21.15.31:0/3808262477 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v26) ==== 104+0+0 (secure 0 0 0) 0x7f7ad4055690 con 0x7f7ae00ad850 2024-09-15T22:52:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 msgr2=0x7f7ac0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.597 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 0x7f7ac0069d80 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7acc000f70 tx=0x7f7acc0079c0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 msgr2=0x7f7ae0099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400c780 tx=0x7f7ad400cc40 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 shutdown_connections 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ac00678c0 0x7f7ac0069d80 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7ae015c3a0 0x7f7ae01455e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7ae00b47c0 0x7f7ae01450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 --2- 172.21.15.31:0/3808262477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7ae00ad850 0x7f7ae0099830 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 >> 172.21.15.31:0/3808262477 conn(0x7f7ae006bbf0 msgr2=0x7f7ae015b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 shutdown_connections 2024-09-15T22:52:09.598 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.595+0000 7f7ae7600640 1 -- 172.21.15.31:0/3808262477 wait complete. 2024-09-15T22:52:09.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:52:09.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.819+0000 7f7cf4a00640 1 Processor -- start 2024-09-15T22:52:09.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.819+0000 7f7cf4a00640 1 -- start start 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cf4a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7cf015c490 0x7f7cf00d0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cf4a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cf00727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cf4a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cf00b3890 con 0x7f7cf015c0b0 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cf4a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7cf0072d00 con 0x7f7cf015c490 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cf4a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00b3b70 con 0x7f7cf0072370 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7cf015c0b0 0x7f7cf00705a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45632/0 (socket says 172.21.15.31:45632) 2024-09-15T22:52:09.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 -- 172.21.15.31:0/2168563865 learned_addr learned my addr 172.21.15.31:0/2168563865 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cee800640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cf00727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ce5400640 1 --2- 172.21.15.31:0/2168563865 >> v2:172.21.15.102:3300/0 conn(0x7f7cf015c490 0x7f7cf00d0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276220587 0 0) 0x7f7cf00b3890 con 0x7f7cf015c0b0 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd4003530 con 0x7f7cf015c0b0 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3464611340 0 0) 0x7f7cd4003530 con 0x7f7cf015c0b0 2024-09-15T22:52:09.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 msgr2=0x7f7cf00727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cf00727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 >> v2:172.21.15.102:3300/0 conn(0x7f7cf015c490 msgr2=0x7f7cf00d0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 --2- 172.21.15.31:0/2168563865 >> v2:172.21.15.102:3300/0 conn(0x7f7cf015c490 0x7f7cf00d0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf00b3e50 con 0x7f7cf015c0b0 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f7ce0001a00 con 0x7f7cf015c0b0 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 >> v1:172.21.15.31:6789/0 conn(0x7f7cf015c0b0 legacy=0x7f7cf00705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cd40039c0 0x7f7cd4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cd4004d50 0x7f7cd40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0072d00 con 0x7f7cd40039c0 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00b3b70 con 0x7f7cd4004d50 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd400b9d0 con 0x7f7cf0072370 2024-09-15T22:52:09.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cd40039c0 0x7f7cd4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7ce5400640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cee800640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cd4004d50 0x7f7cd40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 -- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 msgr2=0x7f7cd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cf0072370 0x7f7cd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 -- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cd4004d50 msgr2=0x7f7cd40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cd4004d50 0x7f7cd40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.823+0000 7f7cede00640 1 -- 172.21.15.31:0/2168563865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4003530 con 0x7f7cd40039c0 2024-09-15T22:52:09.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cede00640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cd40039c0 0x7f7cd4003de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000a920 tx=0x7f7ce001d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff2751a4e055c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:09.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000a4c0 con 0x7f7cd40039c0 2024-09-15T22:52:09.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ce00ad650 con 0x7f7cd40039c0 2024-09-15T22:52:09.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7ced400640 1 -- 172.21.15.31:0/2168563865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00ada40 con 0x7f7cd40039c0 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- 172.21.15.31:0/2168563865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cd40039c0 msgr2=0x7f7cd4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/2168563865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cd40039c0 0x7f7cd4003de0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000a920 tx=0x7f7ce001d440 comp rx=0 tx=0).stop 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cee800640 1 -- 172.21.15.31:0/2168563865 reap_dead start 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- 172.21.15.31:0/2168563865 shutdown_connections 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- 172.21.15.31:0/2168563865 >> 172.21.15.31:0/2168563865 conn(0x7f7cf00b23f0 msgr2=0x7f7cf00b2800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- 172.21.15.31:0/2168563865 shutdown_connections 2024-09-15T22:52:09.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- 172.21.15.31:0/2168563865 wait complete. 2024-09-15T22:52:09.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 Processor -- start 2024-09-15T22:52:09.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.827+0000 7f7cf4a00640 1 -- start start 2024-09-15T22:52:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cd40039c0 0x7f7cf006f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.834 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015d0e0 0x7f7cf015d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00b51f0 con 0x7f7cf015c900 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00b5070 con 0x7f7cf015d0e0 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00b5370 con 0x7f7cd40039c0 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35664/0 (socket says 172.21.15.31:35664) 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 -- 172.21.15.31:0/864621788 learned_addr learned my addr 172.21.15.31:0/864621788 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cede00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cd40039c0 0x7f7cf006f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cee800640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015d0e0 0x7f7cf015d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 -- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cd40039c0 msgr2=0x7f7cf006f8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cd40039c0 0x7f7cf006f8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 -- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015d0e0 msgr2=0x7f7cf015d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015d0e0 0x7f7cf015d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:09.835 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 -- 172.21.15.31:0/864621788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf01f81c0 con 0x7f7cf015c900 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce5400640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8011aa0 tx=0x7f7cd8011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd800fb20 con 0x7f7cf015c900 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cd800fcc0 con 0x7f7cf015c900 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd8014680 con 0x7f7cf015c900 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf015e620 con 0x7f7cf015c900 2024-09-15T22:52:09.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf015ebe0 con 0x7f7cf015c900 2024-09-15T22:52:09.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.831+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf00b56a0 con 0x7f7cf015c900 2024-09-15T22:52:09.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.835+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7cd8012040 con 0x7f7cf015c900 2024-09-15T22:52:09.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.835+0000 7f7ce6a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 0x7f7ccc069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:09.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.835+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 6302+0+0 (secure 0 0 0) 0x7f7cd8086440 con 0x7f7cf015c900 2024-09-15T22:52:09.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.835+0000 7f7cede00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 0x7f7ccc069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:09.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.835+0000 7f7cede00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 0x7f7ccc069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce0001dd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:09.842 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:09.839+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7cd8019030 con 0x7f7cf015c900 2024-09-15T22:52:10.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.011+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7cf00ccdd0 con 0x7f7cf015c900 2024-09-15T22:52:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.687+0000 7f7ce6a00640 1 -- 172.21.15.31:0/864621788 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v47) ==== 181+0+0 (secure 0 0 0) 0x7f7cd8056dc0 con 0x7f7cf015c900 2024-09-15T22:52:10.689 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:52:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.687+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 msgr2=0x7f7ccc069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.687+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 0x7f7ccc069db0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00ad000 tx=0x7f7ce0001dd0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.687+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 msgr2=0x7f7cf015f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.687+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8011aa0 tx=0x7f7cd8011f60 comp rx=0 tx=0).stop 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 shutdown_connections 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7ccc0678f0 0x7f7ccc069db0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7cf015d0e0 0x7f7cf015d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7cf015c900 0x7f7cf015f100 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 --2- 172.21.15.31:0/864621788 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7cd40039c0 0x7f7cf006f8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 >> 172.21.15.31:0/864621788 conn(0x7f7cf00b23f0 msgr2=0x7f7cf0164090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 shutdown_connections 2024-09-15T22:52:10.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.691+0000 7f7cf4a00640 1 -- 172.21.15.31:0/864621788 wait complete. 2024-09-15T22:52:10.721 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:52:10.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.867+0000 7fd2cf000640 1 Processor -- start 2024-09-15T22:52:10.872 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.867+0000 7fd2cf000640 1 -- start start 2024-09-15T22:52:10.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cf000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2c80b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cf000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2c80ada40 0x7fd2c80aded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cf000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2c80b4b60 con 0x7fd2c815e600 2024-09-15T22:52:10.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cf000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd2c80b4e40 con 0x7fd2c80ada40 2024-09-15T22:52:10.873 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cf000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c806f710 con 0x7fd2c80b40c0 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fd2c815e600 0x7fd2c806fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45644/0 (socket says 172.21.15.31:45644) 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 -- 172.21.15.31:0/2930714197 learned_addr learned my addr 172.21.15.31:0/2930714197 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cd000640 1 --2- 172.21.15.31:0/2930714197 >> v2:172.21.15.102:3300/0 conn(0x7fd2c80ada40 0x7fd2c80aded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2bf400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2c80b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 141303028 0 0) 0x7fd2c80b4b60 con 0x7fd2c815e600 2024-09-15T22:52:10.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2ac003530 con 0x7fd2c815e600 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4289703261 0 0) 0x7fd2ac003530 con 0x7fd2c815e600 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 msgr2=0x7fd2c80b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2c80b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 >> v2:172.21.15.102:3300/0 conn(0x7fd2c80ada40 msgr2=0x7fd2c80aded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 --2- 172.21.15.31:0/2930714197 >> v2:172.21.15.102:3300/0 conn(0x7fd2c80ada40 0x7fd2c80aded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c806f0c0 con 0x7fd2c815e600 2024-09-15T22:52:10.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7fd2b8001680 con 0x7fd2c815e600 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 >> v1:172.21.15.31:6789/0 conn(0x7fd2c815e600 legacy=0x7fd2c806fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2ac003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2ac004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2ac004d50 0x7fd2ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c80b4e40 con 0x7fd2ac0039c0 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c806f710 con 0x7fd2ac004d50 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2ac00ba50 con 0x7fd2c80b40c0 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2ac003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2bf400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2ac004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cd000640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2ac004d50 0x7fd2ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 -- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 msgr2=0x7fd2ac004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:10.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2ac004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 -- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2ac004d50 msgr2=0x7fd2ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:10.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2ac004d50 0x7fd2ac0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2c7e00640 1 -- 172.21.15.31:0/2930714197 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ac003530 con 0x7fd2ac0039c0 2024-09-15T22:52:10.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2cd000640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2ac004d50 0x7fd2ac0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:10.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.871+0000 7fd2bf400640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c80b40c0 0x7fd2ac004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2ac003de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c160 tx=0x7fd2b801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1acfa91605e02f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8007c90 con 0x7fd2ac0039c0 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b80a9020 con 0x7fd2ac0039c0 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2c7400640 1 -- 172.21.15.31:0/2930714197 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b8005ae0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- 172.21.15.31:0/2930714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 msgr2=0x7fd2ac003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 --2- 172.21.15.31:0/2930714197 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2ac003de0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd2b800c160 tx=0x7fd2b801cbe0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.879 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cd000640 1 -- 172.21.15.31:0/2930714197 reap_dead start 2024-09-15T22:52:10.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- 172.21.15.31:0/2930714197 shutdown_connections 2024-09-15T22:52:10.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- 172.21.15.31:0/2930714197 >> 172.21.15.31:0/2930714197 conn(0x7fd2c8072800 msgr2=0x7fd2c8072c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:10.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- 172.21.15.31:0/2930714197 shutdown_connections 2024-09-15T22:52:10.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- 172.21.15.31:0/2930714197 wait complete. 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 Processor -- start 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.875+0000 7fd2cf000640 1 -- start start 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c8152a60 0x7fd2c8164490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c8152ee0 0x7fd2c81f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c81694b0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c815e9e0 con 0x7fd2c8152a60 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c8169630 con 0x7fd2c8152ee0 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.882 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35678/0 (socket says 172.21.15.31:35678) 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 -- 172.21.15.31:0/1758632589 learned_addr learned my addr 172.21.15.31:0/1758632589 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cd000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c8152ee0 0x7fd2c81f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2bf400640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c8152a60 0x7fd2c8164490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 -- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c8152ee0 msgr2=0x7fd2c81f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c8152ee0 0x7fd2c81f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 -- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c8152a60 msgr2=0x7fd2c8164490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c8152a60 0x7fd2c8164490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 -- 172.21.15.31:0/1758632589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c80cedd0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c7e00640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ab040 tx=0x7fd2ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80049f0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.883 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2b8004b90 con 0x7fd2ac0039c0 2024-09-15T22:52:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c80cf0b0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2b80070d0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c80cf670 con 0x7fd2ac0039c0 2024-09-15T22:52:10.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c80cfaa0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.879+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2b8007270 con 0x7fd2ac0039c0 2024-09-15T22:52:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.883+0000 7fd2c4c00640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 0x7fd2a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.883+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5864+0+0 (secure 0 0 0) 0x7fd2b811f4b0 con 0x7fd2ac0039c0 2024-09-15T22:52:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.883+0000 7fd2bf400640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 0x7fd2a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:10.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.883+0000 7fd2bf400640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 0x7fd2a4069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2c81561b0 tx=0x7fd2b0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:10.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:10.887+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2b80168f0 con 0x7fd2ac0039c0 2024-09-15T22:52:11.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.055+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd2c80aded0 con 0x7fd2ac0039c0 2024-09-15T22:52:11.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.695+0000 7fd2c4c00640 1 -- 172.21.15.31:0/1758632589 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v48) ==== 169+0+0 (secure 0 0 0) 0x7fd2b80c03a0 con 0x7fd2ac0039c0 2024-09-15T22:52:11.699 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 msgr2=0x7fd2a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 0x7fd2a4069db0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd2c81561b0 tx=0x7fd2b0008040 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 msgr2=0x7fd2c80ce7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2b80ab040 tx=0x7fd2ac005840 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 shutdown_connections 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2a40678f0 0x7fd2a4069db0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2c8152ee0 0x7fd2c81f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2c8152a60 0x7fd2c8164490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 --2- 172.21.15.31:0/1758632589 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2ac0039c0 0x7fd2c80ce7f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 >> 172.21.15.31:0/1758632589 conn(0x7fd2c8072800 msgr2=0x7fd2c815bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:11.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 shutdown_connections 2024-09-15T22:52:11.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.699+0000 7fd2cf000640 1 -- 172.21.15.31:0/1758632589 wait complete. 2024-09-15T22:52:11.731 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:52:11.734 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:52:11.776 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-15T22:52:11.777 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-15T22:52:11.778 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-15T22:52:11.779 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-15T22:52:11.780 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-15T22:52:11.781 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-15T22:52:11.782 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-15T22:52:11.783 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-15T22:52:11.784 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:52:11.785 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-15T22:52:11.786 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:52:11.787 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-09-15T22:52:11.788 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-15T22:52:11.789 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:52:11.790 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-15T22:52:11.791 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:52:11.792 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-15T22:52:11.793 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.794 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.795 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-15T22:52:11.796 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:52:11.797 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:52:11.798 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-15T22:52:11.799 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:52:11.800 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:52:11.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:52:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 Processor -- start 2024-09-15T22:52:11.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 -- start start 2024-09-15T22:52:11.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 0x7f23a80aef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23a80af7b0 con 0x7f23a80d0370 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f23a80afa90 con 0x7f23a80b3be0 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23ada00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f23a80b33e0 con 0x7f23a815c330 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f239e000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 0x7f23a80aef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:50138/0 (socket says 172.21.15.31:50138) 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 -- 172.21.15.31:0/800041654 learned_addr learned my addr 172.21.15.31:0/800041654 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a7400640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f23a80d0370 0x7f23a806dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:40422/0 (socket says 172.21.15.31:40422) 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f239e000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 0x7f23a80aef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:58032/0 (socket says 172.21.15.31:58032) 2024-09-15T22:52:11.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 -- 172.21.15.31:0/800041654 >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 msgr2=0x7f23a80aef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 --2- 172.21.15.31:0/800041654 >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 0x7f23a80aef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 -- 172.21.15.31:0/800041654 >> v1:172.21.15.102:6789/0 conn(0x7f23a80d0370 legacy=0x7f23a806dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.987+0000 7f23a6a00640 1 -- 172.21.15.31:0/800041654 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a80b36c0 con 0x7f23a815c330 2024-09-15T22:52:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23a6a00640 1 --2- 172.21.15.31:0/800041654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2398009e50 tx=0x7f239801c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fd1c2d20955713c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23a6000640 1 -- 172.21.15.31:0/800041654 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23980a5770 con 0x7f23a815c330 2024-09-15T22:52:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23a6000640 1 -- 172.21.15.31:0/800041654 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23980a5910 con 0x7f23a815c330 2024-09-15T22:52:11.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23a6000640 1 -- 172.21.15.31:0/800041654 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23980a5ce0 con 0x7f23a815c330 2024-09-15T22:52:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 -- 172.21.15.31:0/800041654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 msgr2=0x7f23a806f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 --2- 172.21.15.31:0/800041654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2398009e50 tx=0x7f239801c9a0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 -- 172.21.15.31:0/800041654 shutdown_connections 2024-09-15T22:52:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 --2- 172.21.15.31:0/800041654 >> v2:172.21.15.102:3300/0 conn(0x7f23a80b3be0 0x7f23a80aef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 --2- 172.21.15.31:0/800041654 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a806f6e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 -- 172.21.15.31:0/800041654 >> 172.21.15.31:0/800041654 conn(0x7f23a806be90 msgr2=0x7f23a806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 -- 172.21.15.31:0/800041654 shutdown_connections 2024-09-15T22:52:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.991+0000 7f23ada00640 1 -- 172.21.15.31:0/800041654 wait complete. 2024-09-15T22:52:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 Processor -- start 2024-09-15T22:52:11.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- start start 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23a80d0370 0x7f23a814dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a814e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b4140 con 0x7f23a80b3be0 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f23a80b3fc0 con 0x7f23a80d0370 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f23a81695a0 con 0x7f23a815c330 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:11.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35694/0 (socket says 172.21.15.31:35694) 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 -- 172.21.15.31:0/2639056943 learned_addr learned my addr 172.21.15.31:0/2639056943 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f239e000640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23a80d0370 0x7f23a814dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a7400640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a814e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 -- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 msgr2=0x7f23a814e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a814e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 -- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23a80d0370 msgr2=0x7f23a814dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23a80d0370 0x7f23a814dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:11.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 -- 172.21.15.31:0/2639056943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23a81661c0 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23a6a00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23980af040 tx=0x7f2398019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23980bc020 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23980b8670 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398009510 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23a8155fa0 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23a815c970 con 0x7f23a80b3be0 2024-09-15T22:52:12.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.995+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23a80aef40 con 0x7f23a80b3be0 2024-09-15T22:52:12.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.999+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f23980bf020 con 0x7f23a80b3be0 2024-09-15T22:52:12.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.999+0000 7f239f400640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 0x7f2384069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.999+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f2398120710 con 0x7f23a80b3be0 2024-09-15T22:52:12.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.999+0000 7f239e000640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 0x7f2384069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:11.999+0000 7f239e000640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 0x7f2384069db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f23a8151dd0 tx=0x7f2390009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.003+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f23980c6070 con 0x7f23a80b3be0 2024-09-15T22:52:12.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.175+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f23a80b00e0 con 0x7f23a80b3be0 2024-09-15T22:52:12.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.175+0000 7f239f400640 1 -- 172.21.15.31:0/2639056943 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f2398016620 con 0x7f23a80b3be0 2024-09-15T22:52:12.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 msgr2=0x7f2384069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.182 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 0x7f2384069db0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f23a8151dd0 tx=0x7f2390009190 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 msgr2=0x7f23a8099a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f23980af040 tx=0x7f2398019740 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 shutdown_connections 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23840678f0 0x7f2384069db0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f23a815c330 0x7f23a814e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f23a80d0370 0x7f23a814dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 --2- 172.21.15.31:0/2639056943 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f23a80b3be0 0x7f23a8099a80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 >> 172.21.15.31:0/2639056943 conn(0x7f23a806be90 msgr2=0x7f23a806f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 shutdown_connections 2024-09-15T22:52:12.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.179+0000 7f23ada00640 1 -- 172.21.15.31:0/2639056943 wait complete. 2024-09-15T22:52:12.201 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj' 2024-09-15T22:52:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 Processor -- start 2024-09-15T22:52:12.342 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 -- start start 2024-09-15T22:52:12.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b44158be0 0x7f6b440705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6b44070af0 0x7f6b44072740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b440730a0 con 0x7f6b44072c80 2024-09-15T22:52:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f6b44070120 con 0x7f6b44158be0 2024-09-15T22:52:12.344 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b49000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6b4415f920 con 0x7f6b44070af0 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b44158be0 0x7f6b440705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f6b44158be0 0x7f6b440705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35706/0 (socket says 172.21.15.31:35706) 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 -- 172.21.15.31:0/3509480903 learned_addr learned my addr 172.21.15.31:0/3509480903 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b42800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6b44072c80 0x7f6b440ad8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45654/0 (socket says 172.21.15.31:45654) 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b39400640 1 --2- 172.21.15.31:0/3509480903 >> v2:172.21.15.102:3300/0 conn(0x7f6b44070af0 0x7f6b44072740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 -- 172.21.15.31:0/3509480903 >> v2:172.21.15.102:3300/0 conn(0x7f6b44070af0 msgr2=0x7f6b44072740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 --2- 172.21.15.31:0/3509480903 >> v2:172.21.15.102:3300/0 conn(0x7f6b44070af0 0x7f6b44072740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 -- 172.21.15.31:0/3509480903 >> v1:172.21.15.31:6789/0 conn(0x7f6b44072c80 legacy=0x7f6b440ad8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41400640 1 -- 172.21.15.31:0/3509480903 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 179549354 0 0) 0x7f6b440730a0 con 0x7f6b44072c80 2024-09-15T22:52:12.345 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.339+0000 7f6b41e00640 1 -- 172.21.15.31:0/3509480903 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4406f7f0 con 0x7f6b44158be0 2024-09-15T22:52:12.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b41e00640 1 --2- 172.21.15.31:0/3509480903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b440705b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b02c0 tx=0x7f6b3401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8b787874f9397c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b41400640 1 -- 172.21.15.31:0/3509480903 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab610 con 0x7f6b44158be0 2024-09-15T22:52:12.347 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b41400640 1 -- 172.21.15.31:0/3509480903 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b340b0070 con 0x7f6b44158be0 2024-09-15T22:52:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b41400640 1 -- 172.21.15.31:0/3509480903 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340ab9d0 con 0x7f6b44158be0 2024-09-15T22:52:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 -- 172.21.15.31:0/3509480903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 msgr2=0x7f6b440705b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 --2- 172.21.15.31:0/3509480903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b440705b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6b440b02c0 tx=0x7f6b3401c520 comp rx=0 tx=0).stop 2024-09-15T22:52:12.348 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 -- 172.21.15.31:0/3509480903 shutdown_connections 2024-09-15T22:52:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 --2- 172.21.15.31:0/3509480903 >> v2:172.21.15.102:3300/0 conn(0x7f6b44070af0 0x7f6b44072740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 --2- 172.21.15.31:0/3509480903 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b440705b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 -- 172.21.15.31:0/3509480903 >> 172.21.15.31:0/3509480903 conn(0x7f6b4406c0c0 msgr2=0x7f6b4406c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 -- 172.21.15.31:0/3509480903 shutdown_connections 2024-09-15T22:52:12.349 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.343+0000 7f6b49000640 1 -- 172.21.15.31:0/3509480903 wait complete. 2024-09-15T22:52:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 Processor -- start 2024-09-15T22:52:12.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- start start 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b44070af0 0x7f6b441510a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b44072c80 0x7f6b441590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4416b050 con 0x7f6b44158be0 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6b4415f630 con 0x7f6b44072c80 2024-09-15T22:52:12.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6b4416b1d0 con 0x7f6b44070af0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35720/0 (socket says 172.21.15.31:35720) 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 -- 172.21.15.31:0/390445149 learned_addr learned my addr 172.21.15.31:0/390445149 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b39400640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b44072c80 0x7f6b441590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b41e00640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b44070af0 0x7f6b441510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 -- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b44070af0 msgr2=0x7f6b441510a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b44070af0 0x7f6b441510a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 -- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b44072c80 msgr2=0x7f6b441590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b44072c80 0x7f6b441590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 -- 172.21.15.31:0/390445149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b4415a920 con 0x7f6b44158be0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b42800640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c7d0 tx=0x7f6b3c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c018070 con 0x7f6b44158be0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00a640 con 0x7f6b44158be0 2024-09-15T22:52:12.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00aa30 con 0x7f6b44158be0 2024-09-15T22:52:12.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b4415ac00 con 0x7f6b44158be0 2024-09-15T22:52:12.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.347+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b4415b1c0 con 0x7f6b44158be0 2024-09-15T22:52:12.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b44072740 con 0x7f6b44158be0 2024-09-15T22:52:12.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6b3c01b070 con 0x7f6b44158be0 2024-09-15T22:52:12.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b3aa00640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 0x7f6b20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f6b3c085190 con 0x7f6b44158be0 2024-09-15T22:52:12.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b41e00640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 0x7f6b20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.351+0000 7f6b41e00640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 0x7f6b20069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b340a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.355+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6b3c055700 con 0x7f6b44158be0 2024-09-15T22:52:12.582 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.579+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]} v 0) -- 0x7f6b441552e0 con 0x7f6b44158be0 2024-09-15T22:52:12.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b3aa00640 1 -- 172.21.15.31:0/390445149 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_max_items_per_obj"]}]=0 v113) ==== 147+0+0 (secure 0 0 0) 0x7f6b3c059a00 con 0x7f6b44158be0 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 msgr2=0x7f6b20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 0x7f6b20069d80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6b340af000 tx=0x7f6b340a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 msgr2=0x7f6b44159610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c00c7d0 tx=0x7f6b3c00cc90 comp rx=0 tx=0).stop 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 shutdown_connections 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6b200678c0 0x7f6b20069d80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6b44158be0 0x7f6b44159610 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6b44072c80 0x7f6b441590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 --2- 172.21.15.31:0/390445149 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6b44070af0 0x7f6b441510a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 >> 172.21.15.31:0/390445149 conn(0x7f6b4406c0c0 msgr2=0x7f6b44155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 shutdown_connections 2024-09-15T22:52:12.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.699+0000 7f6b49000640 1 -- 172.21.15.31:0/390445149 wait complete. 2024-09-15T22:52:12.722 INFO:tasks.cephfs_test_runner:The maximum number of openfiles omap objects keys are now equal to ... ok 2024-09-15T22:52:12.723 INFO:tasks.cephfs_test_runner:Starting test: test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) Opening a file should increment omap_total_updates by 1. 2024-09-15T22:52:12.723 INFO:tasks.cephfs_test_runner:test_perf_counters (tasks.cephfs.test_openfiletable.OpenFileTable) 2024-09-15T22:52:12.723 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:12.864 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.859+0000 7f1d0da00640 1 Processor -- start 2024-09-15T22:52:12.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.859+0000 7f1d0da00640 1 -- start start 2024-09-15T22:52:12.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d0da00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1d0815c5f0 0x7f1d080b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.865 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d0da00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f1d080b64d0 0x7f1d0815ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d0da00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d0806fd60 con 0x7f1d0815c210 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d0da00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f1d080b6940 con 0x7f1d0815c5f0 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d0da00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f1d0815cd30 con 0x7f1d080b64d0 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f1d0815c210 0x7f1d0806f290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45658/0 (socket says 172.21.15.31:45658) 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06a00640 1 -- 172.21.15.31:0/1973263133 learned_addr learned my addr 172.21.15.31:0/1973263133 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:12.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06000640 1 --2- 172.21.15.31:0/1973263133 >> v2:172.21.15.31:3300/0 conn(0x7f1d0815c5f0 0x7f1d080b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d07400640 1 --2- 172.21.15.31:0/1973263133 >> v2:172.21.15.102:3300/0 conn(0x7f1d080b64d0 0x7f1d0815ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d05600640 1 -- 172.21.15.31:0/1973263133 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963832012 0 0) 0x7f1cf8001120 con 0x7f1d0815c210 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d05600640 1 -- 172.21.15.31:0/1973263133 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1cec003530 con 0x7f1d0815c210 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06000640 1 -- 172.21.15.31:0/1973263133 >> v2:172.21.15.102:3300/0 conn(0x7f1d080b64d0 msgr2=0x7f1d0815ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06000640 1 --2- 172.21.15.31:0/1973263133 >> v2:172.21.15.102:3300/0 conn(0x7f1d080b64d0 0x7f1d0815ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06000640 1 -- 172.21.15.31:0/1973263133 >> v1:172.21.15.31:6789/0 conn(0x7f1d0815c210 legacy=0x7f1d0806f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.867 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.863+0000 7f1d06000640 1 -- 172.21.15.31:0/1973263133 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0815d010 con 0x7f1d0815c5f0 2024-09-15T22:52:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d06000640 1 --2- 172.21.15.31:0/1973263133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d080b5f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806f9d0 tx=0x7f1cf401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa145e81964399e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d05600640 1 -- 172.21.15.31:0/1973263133 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40b1070 con 0x7f1d0815c5f0 2024-09-15T22:52:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d05600640 1 -- 172.21.15.31:0/1973263133 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1cf40ac620 con 0x7f1d0815c5f0 2024-09-15T22:52:12.869 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d05600640 1 -- 172.21.15.31:0/1973263133 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cf40ac9d0 con 0x7f1d0815c5f0 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- 172.21.15.31:0/1973263133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 msgr2=0x7f1d080b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1973263133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d080b5f90 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1d0806f9d0 tx=0x7f1cf401c3c0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- 172.21.15.31:0/1973263133 shutdown_connections 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1973263133 >> v2:172.21.15.102:3300/0 conn(0x7f1d080b64d0 0x7f1d0815ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1973263133 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d080b5f90 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.870 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- 172.21.15.31:0/1973263133 >> 172.21.15.31:0/1973263133 conn(0x7f1d0806bcc0 msgr2=0x7f1d0806c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- 172.21.15.31:0/1973263133 shutdown_connections 2024-09-15T22:52:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- 172.21.15.31:0/1973263133 wait complete. 2024-09-15T22:52:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 Processor -- start 2024-09-15T22:52:12.871 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- start start 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d080b64d0 0x7f1d08155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d0815c210 0x7f1d0814efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0815eb20 con 0x7f1d0815c5f0 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1d0815ca20 con 0x7f1d080b64d0 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.867+0000 7f1d0da00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1d0815eca0 con 0x7f1d0815c210 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.874 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35746/0 (socket says 172.21.15.31:35746) 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 -- 172.21.15.31:0/1830544633 learned_addr learned my addr 172.21.15.31:0/1830544633 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d06a00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d080b64d0 0x7f1d08155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d06000640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d0815c210 0x7f1d0814efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 -- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d0815c210 msgr2=0x7f1d0814efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d0815c210 0x7f1d0814efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 -- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d080b64d0 msgr2=0x7f1d08155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d080b64d0 0x7f1d08155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 -- 172.21.15.31:0/1830544633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d0814f4f0 con 0x7f1d0815c5f0 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d07400640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d00007e40 tx=0x7f1d0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014620 con 0x7f1d0815c5f0 2024-09-15T22:52:12.875 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d00019070 con 0x7f1d0815c5f0 2024-09-15T22:52:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d08159f90 con 0x7f1d0815c5f0 2024-09-15T22:52:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d00014a20 con 0x7f1d0815c5f0 2024-09-15T22:52:12.876 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d0815a550 con 0x7f1d0815c5f0 2024-09-15T22:52:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d0815f060 con 0x7f1d0815c5f0 2024-09-15T22:52:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f1d00014bc0 con 0x7f1d0815c5f0 2024-09-15T22:52:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.871+0000 7f1cfea00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 0x7f1ce8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.875+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f1d00086310 con 0x7f1d0815c5f0 2024-09-15T22:52:12.877 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.875+0000 7f1d06a00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 0x7f1ce8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:12.878 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.875+0000 7f1d06a00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 0x7f1ce8069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005890 tx=0x7f1cf8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:12.880 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:12.879+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1d00056910 con 0x7f1d0815c5f0 2024-09-15T22:52:13.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d08067b70 con 0x7f1d0815c5f0 2024-09-15T22:52:13.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1cfea00640 1 -- 172.21.15.31:0/1830544633 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) ==== 74+0+13397 (secure 0 0 0) 0x7f1d0005ac10 con 0x7f1d0815c5f0 2024-09-15T22:52:13.050 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:13.050 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":48,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:11.689840+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6834/263357593":"2024-09-16T22:52:08.590291+0000","172.21.15.31:6832/263357593":"2024-09-16T22:52:08.590291+0000","172.21.15.31:6835/3813108153":"2024-09-16T22:51:28.497858+0000","172.21.15.31:6833/3813108153":"2024-09-16T22:51:28.497858+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 msgr2=0x7f1ce8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 0x7f1ce8069d80 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1cf8005890 tx=0x7f1cf8009040 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 msgr2=0x7f1d081578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d00007e40 tx=0x7f1d0000e4b0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 shutdown_connections 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f1ce80678c0 0x7f1ce8069d80 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1d0815c5f0 0x7f1d081578f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1d0815c210 0x7f1d0814efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 --2- 172.21.15.31:0/1830544633 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f1d080b64d0 0x7f1d08155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 >> 172.21.15.31:0/1830544633 conn(0x7f1d0806bcc0 msgr2=0x7f1d080b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 shutdown_connections 2024-09-15T22:52:13.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.047+0000 7f1d0da00640 1 -- 172.21.15.31:0/1830544633 wait complete. 2024-09-15T22:52:13.072 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-15T22:50:05.613279+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-15T22:52:13.072 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-15T22:52:13.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.211+0000 7f8e33400640 1 Processor -- start 2024-09-15T22:52:13.216 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.211+0000 7f8e33400640 1 -- start start 2024-09-15T22:52:13.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e33400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 0x7f8e2c1694b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.217 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e33400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2c06dde0 con 0x7f8e2c070a20 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e33400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e2c0b63a0 con 0x7f8e2c0b5d50 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e33400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2c0b6fb0 con 0x7f8e2c1670c0 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e30a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8e2c070a20 0x7f8e2c070e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45662/0 (socket says 172.21.15.31:45662) 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e30a00640 1 -- 172.21.15.31:0/1952246105 learned_addr learned my addr 172.21.15.31:0/1952246105 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e31400640 1 --2- 172.21.15.31:0/1952246105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 0x7f8e2c1694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.218 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e2be00640 1 -- 172.21.15.31:0/1952246105 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084922341 0 0) 0x7f8e1c001120 con 0x7f8e2c070a20 2024-09-15T22:52:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e2be00640 1 -- 172.21.15.31:0/1952246105 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8e10003530 con 0x7f8e2c070a20 2024-09-15T22:52:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e31400640 1 -- 172.21.15.31:0/1952246105 >> v1:172.21.15.102:6789/0 conn(0x7f8e2c0b5d50 legacy=0x7f8e2c09b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e31400640 1 -- 172.21.15.31:0/1952246105 >> v1:172.21.15.31:6789/0 conn(0x7f8e2c070a20 legacy=0x7f8e2c070e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.219 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.215+0000 7f8e31400640 1 -- 172.21.15.31:0/1952246105 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c0b6680 con 0x7f8e2c1670c0 2024-09-15T22:52:13.221 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e31400640 1 --2- 172.21.15.31:0/1952246105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 0x7f8e2c1694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009dc0 tx=0x7f8e2401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d20930d0eaa67759 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e2be00640 1 -- 172.21.15.31:0/1952246105 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e240b2070 con 0x7f8e2c1670c0 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e2be00640 1 -- 172.21.15.31:0/1952246105 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e240a5940 con 0x7f8e2c1670c0 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e2be00640 1 -- 172.21.15.31:0/1952246105 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e240a5d10 con 0x7f8e2c1670c0 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- 172.21.15.31:0/1952246105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 msgr2=0x7f8e2c1694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 --2- 172.21.15.31:0/1952246105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 0x7f8e2c1694b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e24009dc0 tx=0x7f8e2401c990 comp rx=0 tx=0).stop 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- 172.21.15.31:0/1952246105 shutdown_connections 2024-09-15T22:52:13.222 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 --2- 172.21.15.31:0/1952246105 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c1670c0 0x7f8e2c1694b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- 172.21.15.31:0/1952246105 >> 172.21.15.31:0/1952246105 conn(0x7f8e2c0b3f40 msgr2=0x7f8e2c0b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- 172.21.15.31:0/1952246105 shutdown_connections 2024-09-15T22:52:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- 172.21.15.31:0/1952246105 wait complete. 2024-09-15T22:52:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 Processor -- start 2024-09-15T22:52:13.223 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- start start 2024-09-15T22:52:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c0b5d50 0x7f8e2c14cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2c1670c0 0x7f8e2c0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c0b75a0 con 0x7f8e2c070a20 2024-09-15T22:52:13.226 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8e2c0b7420 con 0x7f8e2c1670c0 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.219+0000 7f8e33400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8e2c16c620 con 0x7f8e2c0b5d50 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35758/0 (socket says 172.21.15.31:35758) 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 -- 172.21.15.31:0/3471343857 learned_addr learned my addr 172.21.15.31:0/3471343857 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e31400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2c1670c0 0x7f8e2c0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e23e00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c0b5d50 0x7f8e2c14cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 -- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c0b5d50 msgr2=0x7f8e2c14cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c0b5d50 0x7f8e2c14cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 -- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2c1670c0 msgr2=0x7f8e2c0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.227 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2c1670c0 0x7f8e2c0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 -- 172.21.15.31:0/3471343857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e2c0af660 con 0x7f8e2c070a20 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e30a00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c460 tx=0x7f8e1c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c017070 con 0x7f8e2c070a20 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c005cf0 con 0x7f8e2c070a20 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c007290 con 0x7f8e2c070a20 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e2c0af900 con 0x7f8e2c070a20 2024-09-15T22:52:13.228 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e2c0afec0 con 0x7f8e2c070a20 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e2c070e00 con 0x7f8e2c070a20 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.223+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8e1c01a070 con 0x7f8e2c070a20 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.227+0000 7f8e29600640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 0x7f8e08069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.227+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f8e1c084f10 con 0x7f8e2c070a20 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.227+0000 7f8e23e00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 0x7f8e08069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.227+0000 7f8e23e00640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 0x7f8e08069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c14f070 tx=0x7f8e14009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.231+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8e2c06dde0 con 0x7f8e2c070a20 2024-09-15T22:52:13.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8e2c0b1b90 con 0x7f8e2c070a20 2024-09-15T22:52:13.402 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e29600640 1 -- 172.21.15.31:0/3471343857 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v48) ==== 93+0+10 (secure 0 0 0) 0x7f8e1c055480 con 0x7f8e2c070a20 2024-09-15T22:52:13.402 INFO:teuthology.orchestra.run.smithi031.stdout:pg_num: 1 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 msgr2=0x7f8e08069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 0x7f8e08069d80 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c14f070 tx=0x7f8e14009040 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 msgr2=0x7f8e2c1fa900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c00c460 tx=0x7f8e1c00c920 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 shutdown_connections 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8e080678c0 0x7f8e08069d80 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8e2c1670c0 0x7f8e2c0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8e2c0b5d50 0x7f8e2c14cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 --2- 172.21.15.31:0/3471343857 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8e2c070a20 0x7f8e2c1fa900 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 >> 172.21.15.31:0/3471343857 conn(0x7f8e2c0b3f40 msgr2=0x7f8e2c0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:13.404 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 shutdown_connections 2024-09-15T22:52:13.405 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.399+0000 7f8e33400640 1 -- 172.21.15.31:0/3471343857 wait complete. 2024-09-15T22:52:13.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-09-15T22:52:13.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 Processor -- start 2024-09-15T22:52:13.563 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 -- start start 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f079c15fb30 0x7f079c09b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f079c0d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f079c09aae0 con 0x7f079c071f60 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f079c15ff10 con 0x7f079c15fb30 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a4400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f079c160cd0 con 0x7f079c071290 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a2400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f079c071f60 0x7f079c0ccde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:45670/0 (socket says 172.21.15.31:45670) 2024-09-15T22:52:13.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a2400640 1 -- 172.21.15.31:0/3542140077 learned_addr learned my addr 172.21.15.31:0/3542140077 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a1000640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f079c0d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f07a1a00640 1 --2- 172.21.15.31:0/3542140077 >> v2:172.21.15.102:3300/0 conn(0x7f079c15fb30 0x7f079c09b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.559+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5833349 0 0) 0x7f079c09aae0 con 0x7f079c071f60 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0784003530 con 0x7f079c071f60 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1911254672 0 0) 0x7f0784003530 con 0x7f079c071f60 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 msgr2=0x7f079c0d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:13.567 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f079c0d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 >> v2:172.21.15.102:3300/0 conn(0x7f079c15fb30 msgr2=0x7f079c09b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 --2- 172.21.15.31:0/3542140077 >> v2:172.21.15.102:3300/0 conn(0x7f079c15fb30 0x7f079c09b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c09ad80 con 0x7f079c071f60 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f0794001a00 con 0x7f079c071f60 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 >> v1:172.21.15.31:6789/0 conn(0x7f079c071f60 legacy=0x7f079c0ccde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f07840039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f0784004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0784004d50 0x7f07840051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.568 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f079c15ff10 con 0x7f0784003f90 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f079c160cd0 con 0x7f0784004d50 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f078400b9d0 con 0x7f079c071290 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f0784004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1a00640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f07840039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a2400640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0784004d50 0x7f07840051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 -- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 msgr2=0x7f07840039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c071290 0x7f07840039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 -- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0784004d50 msgr2=0x7f07840051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0784004d50 0x7f07840051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a1000640 1 -- 172.21.15.31:0/3542140077 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0784003530 con 0x7f0784003f90 2024-09-15T22:52:13.569 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.563+0000 7f07a2400640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0784004d50 0x7f07840051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a1000640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f0784004810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0788009b10 tx=0x7f078801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904a8e38dc56a707 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.570 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880b2070 con 0x7f0784003f90 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07880a5550 con 0x7f0784003f90 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f079be00640 1 -- 172.21.15.31:0/3542140077 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07880096b0 con 0x7f0784003f90 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- 172.21.15.31:0/3542140077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 msgr2=0x7f0784004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 --2- 172.21.15.31:0/3542140077 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f0784004810 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0788009b10 tx=0x7f078801ca70 comp rx=0 tx=0).stop 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a2400640 1 -- 172.21.15.31:0/3542140077 reap_dead start 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- 172.21.15.31:0/3542140077 shutdown_connections 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- 172.21.15.31:0/3542140077 >> 172.21.15.31:0/3542140077 conn(0x7f079c0d23b0 msgr2=0x7f079c0d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- 172.21.15.31:0/3542140077 shutdown_connections 2024-09-15T22:52:13.571 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- 172.21.15.31:0/3542140077 wait complete. 2024-09-15T22:52:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 Processor -- start 2024-09-15T22:52:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- start start 2024-09-15T22:52:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.573 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079c0b7b70 0x7f079c15c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c15cec0 0x7f079c0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f079c0d1200 con 0x7f0784003f90 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f079c160fb0 con 0x7f079c0b7b70 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a4400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f079c09bac0 con 0x7f079c15cec0 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a1a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:35772/0 (socket says 172.21.15.31:35772) 2024-09-15T22:52:13.574 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a1a00640 1 -- 172.21.15.31:0/3881458529 learned_addr learned my addr 172.21.15.31:0/3881458529 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.567+0000 7f07a1000640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079c0b7b70 0x7f079c15c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a2400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c15cec0 0x7f079c0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 -- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c15cec0 msgr2=0x7f079c0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c15cec0 0x7f079c0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 -- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079c0b7b70 msgr2=0x7f079c15c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079c0b7b70 0x7f079c15c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 -- 172.21.15.31:0/3881458529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079c0b6b10 con 0x7f0784003f90 2024-09-15T22:52:13.575 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1a00640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0790011b00 tx=0x7f0790009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079000fc10 con 0x7f0784003f90 2024-09-15T22:52:13.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f079000fdb0 con 0x7f0784003f90 2024-09-15T22:52:13.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790014660 con 0x7f0784003f90 2024-09-15T22:52:13.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f079c0b6db0 con 0x7f0784003f90 2024-09-15T22:52:13.576 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f079c0b7370 con 0x7f0784003f90 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f079c09b580 con 0x7f0784003f90 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0790012040 con 0x7f0784003f90 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 0x7f077c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f0790086230 con 0x7f0784003f90 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.571+0000 7f07a1000640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 0x7f077c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:13.577 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.575+0000 7f07a1000640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 0x7f077c069db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f07880af000 tx=0x7f07880046d0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:13.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.575+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0790019030 con 0x7f0784003f90 2024-09-15T22:52:13.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:13.803+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) -- 0x7f079c0b19c0 con 0x7f0784003f90 2024-09-15T22:52:14.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:52:14.445 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:52:14.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.703+0000 7f0799600640 1 -- 172.21.15.31:0/3881458529 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v115) ==== 146+0+0 (secure 0 0 0) 0x7f0790056e80 con 0x7f0784003f90 2024-09-15T22:52:14.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 msgr2=0x7f077c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:14.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 0x7f077c069db0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f07880af000 tx=0x7f07880046d0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 msgr2=0x7f079c1546a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:14.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0790011b00 tx=0x7f0790009f70 comp rx=0 tx=0).stop 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 shutdown_connections 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f077c0678f0 0x7f077c069db0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f079c15cec0 0x7f079c0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f079c0b7b70 0x7f079c15c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 --2- 172.21.15.31:0/3881458529 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0784003f90 0x7f079c1546a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 >> 172.21.15.31:0/3881458529 conn(0x7f079c0d23b0 msgr2=0x7f079c0d02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 shutdown_connections 2024-09-15T22:52:14.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.707+0000 7f07a4400640 1 -- 172.21.15.31:0/3881458529 wait complete. 2024-09-15T22:52:14.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-15T22:52:14.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.879+0000 7f9904e00640 1 Processor -- start 2024-09-15T22:52:14.884 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.879+0000 7f9904e00640 1 -- start start 2024-09-15T22:52:14.885 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 0x7f99000b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f990006ff20 0x7f990015ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990015d1f0 0x7f99000cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9900156d20 con 0x7f990006ff20 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f99000b40c0 con 0x7f990015c8d0 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f9904e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f99000b43a0 con 0x7f990015d1f0 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f990006ff20 0x7f990015ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f990006ff20 0x7f990015ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55472/0 (socket says 172.21.15.31:55472) 2024-09-15T22:52:14.886 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 -- 172.21.15.31:0/84968387 learned_addr learned my addr 172.21.15.31:0/84968387 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 -- 172.21.15.31:0/84968387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990015d1f0 msgr2=0x7f99000cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 --2- 172.21.15.31:0/84968387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990015d1f0 0x7f99000cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98fde00640 1 --2- 172.21.15.31:0/84968387 >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 0x7f99000b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 -- 172.21.15.31:0/84968387 >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 msgr2=0x7f99000b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 --2- 172.21.15.31:0/84968387 >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 0x7f99000b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98f5400640 1 -- 172.21.15.31:0/84968387 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99000b4680 con 0x7f990006ff20 2024-09-15T22:52:14.887 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.883+0000 7f98fde00640 1 --2- 172.21.15.31:0/84968387 >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 0x7f99000b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f98f5400640 1 --2- 172.21.15.31:0/84968387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990006ff20 0x7f990015ccb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9900074300 tx=0x7f98e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ee6528acaf5870 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f98fd400640 1 -- 172.21.15.31:0/84968387 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e80aa610 con 0x7f990006ff20 2024-09-15T22:52:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f98fd400640 1 -- 172.21.15.31:0/84968387 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98e80af070 con 0x7f990006ff20 2024-09-15T22:52:14.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f98fd400640 1 -- 172.21.15.31:0/84968387 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98e80aa9d0 con 0x7f990006ff20 2024-09-15T22:52:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- 172.21.15.31:0/84968387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990006ff20 msgr2=0x7f990015ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 --2- 172.21.15.31:0/84968387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990006ff20 0x7f990015ccb0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9900074300 tx=0x7f98e801c4f0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- 172.21.15.31:0/84968387 shutdown_connections 2024-09-15T22:52:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 --2- 172.21.15.31:0/84968387 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990015d1f0 0x7f99000cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.890 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 --2- 172.21.15.31:0/84968387 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990006ff20 0x7f990015ccb0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 --2- 172.21.15.31:0/84968387 >> v2:172.21.15.102:3300/0 conn(0x7f990015c8d0 0x7f99000b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- 172.21.15.31:0/84968387 >> 172.21.15.31:0/84968387 conn(0x7f990006be90 msgr2=0x7f990006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- 172.21.15.31:0/84968387 shutdown_connections 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- 172.21.15.31:0/84968387 wait complete. 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 Processor -- start 2024-09-15T22:52:14.891 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.887+0000 7f9904e00640 1 -- start start 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990006ff20 0x7f990014bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f990015c8d0 0x7f990014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f99000cfd50 con 0x7f990015d1f0 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f990015d600 con 0x7f990015c8d0 2024-09-15T22:52:14.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f99000cfed0 con 0x7f990006ff20 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55484/0 (socket says 172.21.15.31:55484) 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 -- 172.21.15.31:0/1411971930 learned_addr learned my addr 172.21.15.31:0/1411971930 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98f5400640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f990015c8d0 0x7f990014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fde00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990006ff20 0x7f990014bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 -- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990006ff20 msgr2=0x7f990014bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990006ff20 0x7f990014bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 -- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f990015c8d0 msgr2=0x7f990014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f990015c8d0 0x7f990014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 -- 172.21.15.31:0/1411971930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f990014c150 con 0x7f990015d1f0 2024-09-15T22:52:14.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98fe800640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f98f800b970 tx=0x7f98f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8019070 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98f800cb60 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98f8014440 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99000aea00 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99000aef80 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99000af640 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.891+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f98f801c070 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.895+0000 7f98f6a00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 0x7f98dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.895+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f98f8085860 con 0x7f990015d1f0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.895+0000 7f98fde00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 0x7f98dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:14.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.895+0000 7f98fde00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 0x7f98dc069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f000ab60 tx=0x7f98f0008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:14.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:14.899+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f99000af640 con 0x7f990015d1f0 2024-09-15T22:52:15.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.063+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f99000d0250 con 0x7f990015d1f0 2024-09-15T22:52:15.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f98f6a00640 1 -- 172.21.15.31:0/1411971930 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) ==== 122+0+0 (secure 0 0 0) 0x7f990014c150 con 0x7f990015d1f0 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 msgr2=0x7f98dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 0x7f98dc069d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f98f000ab60 tx=0x7f98f0008040 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 msgr2=0x7f990014ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f98f800b970 tx=0x7f98f800be30 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 shutdown_connections 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f98dc0678c0 0x7f98dc069d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f990015d1f0 0x7f990014ffe0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f990015c8d0 0x7f990014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 --2- 172.21.15.31:0/1411971930 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f990006ff20 0x7f990014bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.072 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 >> 172.21.15.31:0/1411971930 conn(0x7f990006be90 msgr2=0x7f990015bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 shutdown_connections 2024-09-15T22:52:15.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.067+0000 7f9904e00640 1 -- 172.21.15.31:0/1411971930 wait complete. 2024-09-15T22:52:15.091 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:52:15.091 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:52:15.179 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:52:15.279 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:52:15.279 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:15.279 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:15.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:52:15.288 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:15.288 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:15.297 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:15.297 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:15.297 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:15.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:52:15.345 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:15.345 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:15.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:15.354 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-15T22:52:15.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:15.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.523+0000 7f2604400640 1 Processor -- start 2024-09-15T22:52:15.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.523+0000 7f2604400640 1 -- start start 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2604400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f25fc0cd8f0 0x7f25fc0ce850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2604400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc0d0890 0x7f25fc0d0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2604400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25fc09aa40 con 0x7f25fc0715a0 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2604400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f25fc0d1200 con 0x7f25fc0d0890 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2604400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f25fc071980 con 0x7f25fc0cd8f0 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc0d0890 0x7f25fc0d0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f25fc0d0890 0x7f25fc0d0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55494/0 (socket says 172.21.15.31:55494) 2024-09-15T22:52:15.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 -- 172.21.15.31:0/3801203803 learned_addr learned my addr 172.21.15.31:0/3801203803 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:15.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 -- 172.21.15.31:0/3801203803 >> v2:172.21.15.102:3300/0 conn(0x7f25fc0cd8f0 msgr2=0x7f25fc0ce850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:15.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 --2- 172.21.15.31:0/3801203803 >> v2:172.21.15.102:3300/0 conn(0x7f25fc0cd8f0 0x7f25fc0ce850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 -- 172.21.15.31:0/3801203803 >> v1:172.21.15.102:6789/0 conn(0x7f25fc0715a0 legacy=0x7f25fc070230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:15.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.527+0000 7f2602400640 1 -- 172.21.15.31:0/3801203803 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc0cddd0 con 0x7f25fc0d0890 2024-09-15T22:52:15.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2602400640 1 --2- 172.21.15.31:0/3801203803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0d0890 0x7f25fc0d0cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25fc1611c0 tx=0x7f25f401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3194a4576510fdf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:15.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f25fbe00640 1 -- 172.21.15.31:0/3801203803 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40a5840 con 0x7f25fc0d0890 2024-09-15T22:52:15.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f25fbe00640 1 -- 172.21.15.31:0/3801203803 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f40a59e0 con 0x7f25fc0d0890 2024-09-15T22:52:15.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f25fbe00640 1 -- 172.21.15.31:0/3801203803 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f40a5db0 con 0x7f25fc0d0890 2024-09-15T22:52:15.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- 172.21.15.31:0/3801203803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0d0890 msgr2=0x7f25fc0d0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 --2- 172.21.15.31:0/3801203803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0d0890 0x7f25fc0d0cc0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f25fc1611c0 tx=0x7f25f401c980 comp rx=0 tx=0).stop 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- 172.21.15.31:0/3801203803 shutdown_connections 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 --2- 172.21.15.31:0/3801203803 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0d0890 0x7f25fc0d0cc0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 --2- 172.21.15.31:0/3801203803 >> v2:172.21.15.102:3300/0 conn(0x7f25fc0cd8f0 0x7f25fc0ce850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- 172.21.15.31:0/3801203803 >> 172.21.15.31:0/3801203803 conn(0x7f25fc0d23b0 msgr2=0x7f25fc0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- 172.21.15.31:0/3801203803 shutdown_connections 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- 172.21.15.31:0/3801203803 wait complete. 2024-09-15T22:52:15.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 Processor -- start 2024-09-15T22:52:15.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.531+0000 7f2604400640 1 -- start start 2024-09-15T22:52:15.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 0x7f25fc165830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25fc0d0890 0x7f25fc165d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc072120 con 0x7f25fc0715a0 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f25fc070940 con 0x7f25fc0cd8f0 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f25fc169460 con 0x7f25fc0d0890 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55504/0 (socket says 172.21.15.31:55504) 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 -- 172.21.15.31:0/4237915011 learned_addr learned my addr 172.21.15.31:0/4237915011 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601000640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 0x7f25fc165830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2602400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25fc0d0890 0x7f25fc165d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 -- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25fc0d0890 msgr2=0x7f25fc165d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25fc0d0890 0x7f25fc165d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 -- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 msgr2=0x7f25fc165830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 0x7f25fc165830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 -- 172.21.15.31:0/4237915011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25fc15e840 con 0x7f25fc0715a0 2024-09-15T22:52:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601000640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 0x7f25fc165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:15.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2601a00640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f25f000b410 tx=0x7f25f000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0015020 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25f0011830 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25fc0b6c00 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25f0011c20 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25fc0c6080 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25fc0ce850 con 0x7f25fc0715a0 2024-09-15T22:52:15.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.535+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f25f0018020 con 0x7f25fc0715a0 2024-09-15T22:52:15.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.539+0000 7f25f9600640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 0x7f25dc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:15.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.539+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5421+0+0 (secure 0 0 0) 0x7f25f0085bc0 con 0x7f25fc0715a0 2024-09-15T22:52:15.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.539+0000 7f2601000640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 0x7f25dc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:15.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.539+0000 7f2601000640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 0x7f25dc069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006fd0 tx=0x7f25e8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:15.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.543+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f25f001f020 con 0x7f25fc0715a0 2024-09-15T22:52:15.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25fc0b8330 con 0x7f25fc0715a0 2024-09-15T22:52:15.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f25f9600640 1 -- 172.21.15.31:0/4237915011 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+3917 (secure 0 0 0) 0x7f25f00172c0 con 0x7f25fc0715a0 2024-09-15T22:52:15.746 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:15.746 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":26,"btime":"2024-09-15T22:52:09:592541+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4802,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/3998016518","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":3998016518},{"type":"v1","addr":"172.21.15.31:6835","nonce":3998016518}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":5002,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3914175098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3914175098},{"type":"v1","addr":"172.21.15.102:6836","nonce":3914175098}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":18},{"gid":5097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/2952729649","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":2952729649},{"type":"v1","addr":"172.21.15.102:6837","nonce":2952729649}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5229,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/1877936858","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":1877936858},{"type":"v1","addr":"172.21.15.31:6834","nonce":1877936858}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[]} 2024-09-15T22:52:15.747 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 26 2024-09-15T22:52:15.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 msgr2=0x7f25dc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 0x7f25dc069d80 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f25e8006fd0 tx=0x7f25e8008040 comp rx=0 tx=0).stop 2024-09-15T22:52:15.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 msgr2=0x7f25fc15e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:15.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f25f000b410 tx=0x7f25f000b8d0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 shutdown_connections 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f25dc0678c0 0x7f25dc069d80 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f25fc0d0890 0x7f25fc165d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f25fc0cd8f0 0x7f25fc165830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 --2- 172.21.15.31:0/4237915011 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f25fc0715a0 0x7f25fc15e300 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 >> 172.21.15.31:0/4237915011 conn(0x7f25fc0d23b0 msgr2=0x7f25fc0b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 shutdown_connections 2024-09-15T22:52:15.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:15.743+0000 7f2604400640 1 -- 172.21.15.31:0/4237915011 wait complete. 2024-09-15T22:52:15.768 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:52:15.768 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:52:15.768 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:52:15.768 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:15.768 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:52:15.769 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:52:15.769 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:52:15.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:15.769 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:52:15.769 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:52:15.769 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:52:15.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:15.769 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:52:15.770 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:52:15.770 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:52:15.770 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:15.783 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:52:15.784 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:52:15.784 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:52:15.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:52:15.786 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:52:15.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:52:15.830 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:52:15.831 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:15.832 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:52:15.832 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:15.835 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:52:15.835 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:15.920 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-15T22:52:15.920 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-15T22:52:15.921 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:52:21.786 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:52:21.786 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:52:21.790 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:52:21.791 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:21.791 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-15T22:52:21.886 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:52:21.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.939+0000 7fa4b9e00640 1 Processor -- start 2024-09-15T22:52:21.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b9e00640 1 -- start start 2024-09-15T22:52:21.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4b4072160 0x7fa4b4072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:21.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b9e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b4072a80 con 0x7fa4b406e160 2024-09-15T22:52:21.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b9e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b41407b0 con 0x7fa4b413fa40 2024-09-15T22:52:21.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b9e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa4b413f640 con 0x7fa4b4072160 2024-09-15T22:52:21.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b2a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4b4072160 0x7fa4b4072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b3400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa4b406e160 0x7fa4b406e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56760/0 (socket says 172.21.15.31:56760) 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b3400640 1 -- 172.21.15.31:0/87283216 learned_addr learned my addr 172.21.15.31:0/87283216 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b2a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa4b4072160 0x7fa4b4072540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55536/0 (socket says 172.21.15.31:55536) 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b2a00640 1 -- 172.21.15.31:0/87283216 >> v1:172.21.15.102:6789/0 conn(0x7fa4b413fa40 legacy=0x7fa4b413fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b2a00640 1 -- 172.21.15.31:0/87283216 >> v1:172.21.15.31:6789/0 conn(0x7fa4b406e160 legacy=0x7fa4b406e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:21.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.943+0000 7fa4b2a00640 1 -- 172.21.15.31:0/87283216 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b4140a90 con 0x7fa4b4072160 2024-09-15T22:52:21.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b2a00640 1 --2- 172.21.15.31:0/87283216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b4072160 0x7fa4b4072540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097c0 tx=0x7fa4a401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60dfd40b8a36d970 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:21.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b2000640 1 -- 172.21.15.31:0/87283216 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40b0070 con 0x7fa4b4072160 2024-09-15T22:52:21.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b2000640 1 -- 172.21.15.31:0/87283216 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4a40ab600 con 0x7fa4b4072160 2024-09-15T22:52:21.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b2000640 1 -- 172.21.15.31:0/87283216 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4a40ab9d0 con 0x7fa4b4072160 2024-09-15T22:52:21.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- 172.21.15.31:0/87283216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b4072160 msgr2=0x7fa4b4072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:21.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/87283216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b4072160 0x7fa4b4072540 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40097c0 tx=0x7fa4a401c410 comp rx=0 tx=0).stop 2024-09-15T22:52:21.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- 172.21.15.31:0/87283216 shutdown_connections 2024-09-15T22:52:21.950 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/87283216 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b4072160 0x7fa4b4072540 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:21.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- 172.21.15.31:0/87283216 >> 172.21.15.31:0/87283216 conn(0x7fa4b4067e00 msgr2=0x7fa4b406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:21.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- 172.21.15.31:0/87283216 shutdown_connections 2024-09-15T22:52:21.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- 172.21.15.31:0/87283216 wait complete. 2024-09-15T22:52:21.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 Processor -- start 2024-09-15T22:52:21.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.947+0000 7fa4b9e00640 1 -- start start 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 0x7fa4b4152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4b4072160 0x7fa4b415a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40b39f0 con 0x7fa4b413fa40 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa4b40b3870 con 0x7fa4b406e160 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa4b40b3b70 con 0x7fa4b4072160 2024-09-15T22:52:21.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:21.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55550/0 (socket says 172.21.15.31:55550) 2024-09-15T22:52:21.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 -- 172.21.15.31:0/30637610 learned_addr learned my addr 172.21.15.31:0/30637610 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b2a00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 0x7fa4b4152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 -- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4b4072160 msgr2=0x7fa4b415a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4b4072160 0x7fa4b415a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 -- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 msgr2=0x7fa4b4152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 0x7fa4b4152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 -- 172.21.15.31:0/30637610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b4157c00 con 0x7fa4b413fa40 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b2a00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 0x7fa4b4152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b3400640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00cbc0 tx=0x7fa4ac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac017070 con 0x7fa4b413fa40 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa4ac00ad40 con 0x7fa4b413fa40 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4ac012600 con 0x7fa4b413fa40 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b4157ee0 con 0x7fa4b413fa40 2024-09-15T22:52:21.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4b41584a0 con 0x7fa4b413fa40 2024-09-15T22:52:21.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4b4072540 con 0x7fa4b413fa40 2024-09-15T22:52:21.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.951+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa4ac01a070 con 0x7fa4b413fa40 2024-09-15T22:52:21.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.955+0000 7fa4abe00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 0x7fa490069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:21.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.955+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(51..51 src has 1..51) ==== 5421+0+0 (secure 0 0 0) 0x7fa4ac085820 con 0x7fa4b413fa40 2024-09-15T22:52:21.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.955+0000 7fa4b2a00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 0x7fa490069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:21.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.955+0000 7fa4b2a00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 0x7fa490069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40ad000 tx=0x7fa4a4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:21.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:21.959+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa4ac055e20 con 0x7fa4b413fa40 2024-09-15T22:52:22.137 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:22.135+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fa4b40afd60 con 0x7fa4b413fa40 2024-09-15T22:52:22.226 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-15T22:52:23.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.731+0000 7fa4abe00640 1 -- 172.21.15.31:0/30637610 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v53) ==== 97+0+0 (secure 0 0 0) 0x7fa4ac05a120 con 0x7fa4b413fa40 2024-09-15T22:52:23.734 INFO:teuthology.orchestra.run.smithi031.stderr: removed all blocklist entries 2024-09-15T22:52:23.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 msgr2=0x7fa490069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 0x7fa490069d80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fa4a40ad000 tx=0x7fa4a4008040 comp rx=0 tx=0).stop 2024-09-15T22:52:23.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 msgr2=0x7fa4b415a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa4ac00cbc0 tx=0x7fa4ac00a430 comp rx=0 tx=0).stop 2024-09-15T22:52:23.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 shutdown_connections 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa4900678c0 0x7fa490069d80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa4b413fa40 0x7fa4b415a820 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa4b4072160 0x7fa4b415a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 --2- 172.21.15.31:0/30637610 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa4b406e160 0x7fa4b4152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 >> 172.21.15.31:0/30637610 conn(0x7fa4b4067e00 msgr2=0x7fa4b415d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 shutdown_connections 2024-09-15T22:52:23.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.735+0000 7fa4b9e00640 1 -- 172.21.15.31:0/30637610 wait complete. 2024-09-15T22:52:23.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-15T22:52:23.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.903+0000 7fcf7a000640 1 Processor -- start 2024-09-15T22:52:23.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.903+0000 7fcf7a000640 1 -- start start 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf7a000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcf74072870 0x7fcf7415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf7a000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf74072d40 con 0x7fcf7406f270 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf7a000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf74073020 con 0x7fcf740b47a0 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf7a000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcf7415ba60 con 0x7fcf74072870 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fcf7406f270 0x7fcf7406f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56774/0 (socket says 172.21.15.31:56774) 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73400640 1 -- 172.21.15.31:0/95275266 learned_addr learned my addr 172.21.15.31:0/95275266 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:23.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73e00640 1 --2- 172.21.15.31:0/95275266 >> v2:172.21.15.31:3300/0 conn(0x7fcf74072870 0x7fcf7415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:23.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf72a00640 1 -- 172.21.15.31:0/95275266 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3829640835 0 0) 0x7fcf74072d40 con 0x7fcf7406f270 2024-09-15T22:52:23.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf72a00640 1 -- 172.21.15.31:0/95275266 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf58003530 con 0x7fcf7406f270 2024-09-15T22:52:23.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73e00640 1 -- 172.21.15.31:0/95275266 >> v1:172.21.15.102:6789/0 conn(0x7fcf740b47a0 legacy=0x7fcf74072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73e00640 1 -- 172.21.15.31:0/95275266 >> v1:172.21.15.31:6789/0 conn(0x7fcf7406f270 legacy=0x7fcf7406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73e00640 1 -- 172.21.15.31:0/95275266 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf740b3cc0 con 0x7fcf74072870 2024-09-15T22:52:23.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.907+0000 7fcf73e00640 1 --2- 172.21.15.31:0/95275266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74072870 0x7fcf7415c840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58df48e972dbf1c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:23.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf72a00640 1 -- 172.21.15.31:0/95275266 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0b2070 con 0x7fcf74072870 2024-09-15T22:52:23.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf72a00640 1 -- 172.21.15.31:0/95275266 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0a5830 con 0x7fcf74072870 2024-09-15T22:52:23.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf72a00640 1 -- 172.21.15.31:0/95275266 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0a5be0 con 0x7fcf74072870 2024-09-15T22:52:23.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- 172.21.15.31:0/95275266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74072870 msgr2=0x7fcf7415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 --2- 172.21.15.31:0/95275266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74072870 0x7fcf7415c840 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c009d90 tx=0x7fcf6c01c970 comp rx=0 tx=0).stop 2024-09-15T22:52:23.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- 172.21.15.31:0/95275266 shutdown_connections 2024-09-15T22:52:23.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 --2- 172.21.15.31:0/95275266 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf74072870 0x7fcf7415c840 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- 172.21.15.31:0/95275266 >> 172.21.15.31:0/95275266 conn(0x7fcf74067e00 msgr2=0x7fcf7406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:23.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- 172.21.15.31:0/95275266 shutdown_connections 2024-09-15T22:52:23.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- 172.21.15.31:0/95275266 wait complete. 2024-09-15T22:52:23.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 Processor -- start 2024-09-15T22:52:23.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- start start 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf7406f270 0x7fcf74135970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 0x7fcf74145e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7415d310 con 0x7fcf740b47a0 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcf7415d190 con 0x7fcf7406f270 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf7a000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcf7406e160 con 0x7fcf74072870 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf73e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55556/0 (socket says 172.21.15.31:55556) 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.911+0000 7fcf73e00640 1 -- 172.21.15.31:0/1137126010 learned_addr learned my addr 172.21.15.31:0/1137126010 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73400640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf7406f270 0x7fcf74135970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6aa00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 0x7fcf74145e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:23.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 -- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 msgr2=0x7fcf74145e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 0x7fcf74145e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 -- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf7406f270 msgr2=0x7fcf74135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf7406f270 0x7fcf74135970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 -- 172.21.15.31:0/1137126010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf74151cf0 con 0x7fcf740b47a0 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6aa00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 0x7fcf74145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:23.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73e00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0b0040 tx=0x7fcf6c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0bd020 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf6c0039a0 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c0b2040 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf74151fd0 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf74152590 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf7415c840 con 0x7fcf740b47a0 2024-09-15T22:52:23.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcf6c0c0020 con 0x7fcf740b47a0 2024-09-15T22:52:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 0x7fcf50069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7fcf6c120970 con 0x7fcf740b47a0 2024-09-15T22:52:23.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.915+0000 7fcf73400640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 0x7fcf50069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:23.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.919+0000 7fcf73400640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 0x7fcf50069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf640011f0 tx=0x7fcf64009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:23.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:23.919+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcf6c0c7030 con 0x7fcf740b47a0 2024-09-15T22:52:24.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fcf7415b010 con 0x7fcf740b47a0 2024-09-15T22:52:24.145 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf6be00640 1 -- 172.21.15.31:0/1137126010 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) ==== 80+0+5304 (secure 0 0 0) 0x7fcf6c016560 con 0x7fcf740b47a0 2024-09-15T22:52:24.145 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "auth_dump": [ 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.a", 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdm9BbzFBAAh2krY1L9Wkr95inp5Aq6bg==", 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.b", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmhB0FIRAA3mEZDlQgVAwlFjGHz574fA==", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.c", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmRk8cHBAAeqI7fUCoJV3gJg9Oioc5Tg==", 2024-09-15T22:52:24.147 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mds.d", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmUJQsKBAAJ3V6BnnIR6KNLPHZE/DDwg==", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:52:24.148 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.0", 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBvZOdmx3vuLhAA7zs4BxFmuT8des6sufICgg==", 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.149 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.1", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBzZOdmVDxwChAAQu6SLevRyCQETBSsTxQ5dA==", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.2", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB2ZOdm7WMnIBAA0d3cDV8zSeyZYMz980Onug==", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.150 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.3", 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQB6ZOdmoV/nChAA3ATYaJdz/3xyw7fRhXUPRQ==", 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.4", 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCAZOdmMamwDxAAvnLbvnUZouVSVp/Ga8akcg==", 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.5", 2024-09-15T22:52:24.152 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCDZOdmicPoJhAA+L3TkVT/ou/gTr/l3oewUQ==", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.6", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCGZOdmXnN5OhAA9yDDXVneKaH4xm9sV06sZQ==", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.153 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "osd.7", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQCKZOdmK/adFBAAEPOZtpFn//S8b6bSnd+u6A==", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow profile osd", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile osd", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.0", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg==", 2024-09-15T22:52:24.154 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow r", 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.1", 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmhs+UNRAAaXrMB5Y6bgHy3AjQj15MAg==", 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.155 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.2", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmCeb6MRAAE7MMgVGIePOdK09iw/Ktfw==", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.3", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmYLZ2OxAAkWX7K+9kTnOFWCNklDBCzQ==", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow r", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow rw", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow rwx" 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "client.admin", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBrZOdm5W5PNBAAibGzoYys78utbVT7wdYKJg==", 2024-09-15T22:52:24.157 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mgr": "allow *", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow *", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.x", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmw9CDEBAAb7U4j7o6ZSig5nbXE52GCQ==", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "entity": "mgr.y", 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "key": "AQBsZOdmVYbJDBAAUAngBLy5hl9+p7TNGVLXPw==", 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "caps": { 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mds": "allow *", 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "mon": "allow profile mgr", 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: "osd": "allow *" 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2024-09-15T22:52:24.159 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:52:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 msgr2=0x7fcf50069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 0x7fcf50069db0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf640011f0 tx=0x7fcf64009040 comp rx=0 tx=0).stop 2024-09-15T22:52:24.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 msgr2=0x7fcf741512a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c0b0040 tx=0x7fcf6c019710 comp rx=0 tx=0).stop 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 shutdown_connections 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcf500678f0 0x7fcf50069db0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcf740b47a0 0x7fcf741512a0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcf74072870 0x7fcf74145e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 --2- 172.21.15.31:0/1137126010 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcf7406f270 0x7fcf74135970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 >> 172.21.15.31:0/1137126010 conn(0x7fcf74067e00 msgr2=0x7fcf74072160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 shutdown_connections 2024-09-15T22:52:24.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.143+0000 7fcf7a000640 1 -- 172.21.15.31:0/1137126010 wait complete. 2024-09-15T22:52:24.167 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-15T22:52:24.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.303+0000 7f8a6b000640 1 Processor -- start 2024-09-15T22:52:24.308 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.303+0000 7f8a6b000640 1 -- start start 2024-09-15T22:52:24.309 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a6409aa40 0x7f8a6409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6b000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a640d0ba0 0x7f8a640716d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6b000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a6409b360 con 0x7f8a64071c10 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6b000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8a64070630 con 0x7f8a640d0ba0 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8a64070910 con 0x7f8a6409aa40 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a640d0ba0 0x7f8a640716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8a640d0ba0 0x7f8a640716d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55562/0 (socket says 172.21.15.31:55562) 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 -- 172.21.15.31:0/3312390809 learned_addr learned my addr 172.21.15.31:0/3312390809 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a6a600640 1 --1- 172.21.15.31:0/3312390809 >> v1:172.21.15.102:6789/0 conn(0x7f8a64071c10 0x7f8a640cc940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:59370/0 (socket says 172.21.15.31:59370) 2024-09-15T22:52:24.310 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a6409aa40 0x7f8a6409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 -- 172.21.15.31:0/3312390809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a6409aa40 msgr2=0x7f8a6409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 --2- 172.21.15.31:0/3312390809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a6409aa40 0x7f8a6409ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 -- 172.21.15.31:0/3312390809 >> v1:172.21.15.102:6789/0 conn(0x7f8a64071c10 legacy=0x7f8a640cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.311 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.307+0000 7f8a69200640 1 -- 172.21.15.31:0/3312390809 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a64070bf0 con 0x7f8a640d0ba0 2024-09-15T22:52:24.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a69200640 1 --2- 172.21.15.31:0/3312390809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a640d0ba0 0x7f8a640716d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5b1bb213825a7df server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a63e00640 1 -- 172.21.15.31:0/3312390809 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500b5070 con 0x7f8a640d0ba0 2024-09-15T22:52:24.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a63e00640 1 -- 172.21.15.31:0/3312390809 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500a8a50 con 0x7f8a640d0ba0 2024-09-15T22:52:24.313 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a63e00640 1 -- 172.21.15.31:0/3312390809 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500a8e20 con 0x7f8a640d0ba0 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- 172.21.15.31:0/3312390809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a640d0ba0 msgr2=0x7f8a640716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 --2- 172.21.15.31:0/3312390809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a640d0ba0 0x7f8a640716d0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5001ed50 comp rx=0 tx=0).stop 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- 172.21.15.31:0/3312390809 shutdown_connections 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 --2- 172.21.15.31:0/3312390809 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a640d0ba0 0x7f8a640716d0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 --2- 172.21.15.31:0/3312390809 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a6409aa40 0x7f8a6409ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- 172.21.15.31:0/3312390809 >> 172.21.15.31:0/3312390809 conn(0x7f8a640b3ca0 msgr2=0x7f8a640b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:24.314 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- 172.21.15.31:0/3312390809 shutdown_connections 2024-09-15T22:52:24.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- 172.21.15.31:0/3312390809 wait complete. 2024-09-15T22:52:24.315 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 Processor -- start 2024-09-15T22:52:24.316 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.311+0000 7f8a6b000640 1 -- start start 2024-09-15T22:52:24.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a6409aa40 0x7f8a6415e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 0x7f8a6415ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8a6415c530 con 0x7f8a64071c10 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8a640711b0 con 0x7f8a6409aa40 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8a6415c6b0 con 0x7f8a640d0ba0 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55578/0 (socket says 172.21.15.31:55578) 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 -- 172.21.15.31:0/2440039512 learned_addr learned my addr 172.21.15.31:0/2440039512 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69200640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a6409aa40 0x7f8a6415e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6a600640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 0x7f8a6415ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 -- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 msgr2=0x7f8a6415ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 0x7f8a6415ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 -- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a6409aa40 msgr2=0x7f8a6415e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a6409aa40 0x7f8a6415e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 -- 172.21.15.31:0/2440039512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a640b7ff0 con 0x7f8a64071c10 2024-09-15T22:52:24.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6a600640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 0x7f8a6415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:24.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a69c00640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e960 tx=0x7f8a5800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a58017070 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5800ca00 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5800cdb0 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6415d630 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a640b5180 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a6415db50 con 0x7f8a64071c10 2024-09-15T22:52:24.320 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.315+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8a5801a070 con 0x7f8a64071c10 2024-09-15T22:52:24.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.319+0000 7f8a61600640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.319+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7f8a58085a60 con 0x7f8a64071c10 2024-09-15T22:52:24.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.319+0000 7f8a69200640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.319+0000 7f8a69200640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 0x7f8a44069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b2000 tx=0x7f8a500aa070 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.325 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.323+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8a6415db50 con 0x7f8a64071c10 2024-09-15T22:52:24.492 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8a640cd0e0 con 0x7f8a64071c10 2024-09-15T22:52:24.493 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a61600640 1 -- 172.21.15.31:0/2440039512 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v53) ==== 84+0+65 (secure 0 0 0) 0x7f8a640b7ff0 con 0x7f8a64071c10 2024-09-15T22:52:24.493 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout:[ 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout: "poolnum": 1, 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout: "poolname": ".mgr" 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2024-09-15T22:52:24.494 INFO:teuthology.orchestra.run.smithi031.stdout:] 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 msgr2=0x7f8a44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 0x7f8a44069d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a500b2000 tx=0x7f8a500aa070 comp rx=0 tx=0).stop 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 msgr2=0x7f8a640b7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f8a5800e960 tx=0x7f8a5800ee20 comp rx=0 tx=0).stop 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 shutdown_connections 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8a440678c0 0x7f8a44069d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8a640d0ba0 0x7f8a6415ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8a6409aa40 0x7f8a6415e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 --2- 172.21.15.31:0/2440039512 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8a64071c10 0x7f8a640b7ab0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 >> 172.21.15.31:0/2440039512 conn(0x7f8a640b3ca0 msgr2=0x7f8a6415b5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 shutdown_connections 2024-09-15T22:52:24.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.491+0000 7f8a6b000640 1 -- 172.21.15.31:0/2440039512 wait complete. 2024-09-15T22:52:24.516 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-15T22:52:24.516 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-15T22:52:24.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 Processor -- start 2024-09-15T22:52:24.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 -- start start 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7feb8c0d0010 0x7feb8c15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7feb8c06ff20 0x7feb8c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c156d20 con 0x7feb8c15c8d0 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c15d730 con 0x7feb8c06ff20 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb94000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c0b40c0 con 0x7feb8c0d0010 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb91600640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7feb8c15c8d0 0x7feb8c0b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:56780/0 (socket says 172.21.15.31:56780) 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb91600640 1 -- 172.21.15.31:0/1789791013 learned_addr learned my addr 172.21.15.31:0/1789791013 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb92000640 1 --2- 172.21.15.31:0/1789791013 >> v2:172.21.15.31:3300/0 conn(0x7feb8c06ff20 0x7feb8c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.663 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb90c00640 1 --2- 172.21.15.31:0/1789791013 >> v2:172.21.15.102:3300/0 conn(0x7feb8c0d0010 0x7feb8c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb92000640 1 -- 172.21.15.31:0/1789791013 >> v2:172.21.15.102:3300/0 conn(0x7feb8c0d0010 msgr2=0x7feb8c15ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb92000640 1 --2- 172.21.15.31:0/1789791013 >> v2:172.21.15.102:3300/0 conn(0x7feb8c0d0010 0x7feb8c15ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb92000640 1 -- 172.21.15.31:0/1789791013 >> v1:172.21.15.31:6789/0 conn(0x7feb8c15c8d0 legacy=0x7feb8c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb92000640 1 -- 172.21.15.31:0/1789791013 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0b43a0 con 0x7feb8c06ff20 2024-09-15T22:52:24.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.659+0000 7feb8be00640 1 -- 172.21.15.31:0/1789791013 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907205566 0 0) 0x7feb8c156d20 con 0x7feb8c15c8d0 2024-09-15T22:52:24.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb92000640 1 --2- 172.21.15.31:0/1789791013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c15d1f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0af860 tx=0x7feb8401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1880387cd6e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb8be00640 1 -- 172.21.15.31:0/1789791013 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb840b2070 con 0x7feb8c06ff20 2024-09-15T22:52:24.666 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb8be00640 1 -- 172.21.15.31:0/1789791013 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb840a59c0 con 0x7feb8c06ff20 2024-09-15T22:52:24.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb8be00640 1 -- 172.21.15.31:0/1789791013 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb840a5d90 con 0x7feb8c06ff20 2024-09-15T22:52:24.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 -- 172.21.15.31:0/1789791013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 msgr2=0x7feb8c15d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 --2- 172.21.15.31:0/1789791013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c15d1f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feb8c0af860 tx=0x7feb8401c900 comp rx=0 tx=0).stop 2024-09-15T22:52:24.667 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 -- 172.21.15.31:0/1789791013 shutdown_connections 2024-09-15T22:52:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 --2- 172.21.15.31:0/1789791013 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c15d1f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 --2- 172.21.15.31:0/1789791013 >> v2:172.21.15.102:3300/0 conn(0x7feb8c0d0010 0x7feb8c15ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 -- 172.21.15.31:0/1789791013 >> 172.21.15.31:0/1789791013 conn(0x7feb8c06be90 msgr2=0x7feb8c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 -- 172.21.15.31:0/1789791013 shutdown_connections 2024-09-15T22:52:24.668 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.663+0000 7feb94000640 1 -- 172.21.15.31:0/1789791013 wait complete. 2024-09-15T22:52:24.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 Processor -- start 2024-09-15T22:52:24.669 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- start start 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb8c0d0010 0x7feb8c154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 0x7feb8c151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c168820 con 0x7feb8c06ff20 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c1686a0 con 0x7feb8c0d0010 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c1689a0 con 0x7feb8c15c8d0 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:55602/0 (socket says 172.21.15.31:55602) 2024-09-15T22:52:24.671 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 -- 172.21.15.31:0/3758961070 learned_addr learned my addr 172.21.15.31:0/3758961070 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb90c00640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb8c0d0010 0x7feb8c154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb92000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 0x7feb8c151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 -- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 msgr2=0x7feb8c151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 0x7feb8c151df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 -- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb8c0d0010 msgr2=0x7feb8c154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb8c0d0010 0x7feb8c154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 -- 172.21.15.31:0/3758961070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c0b2be0 con 0x7feb8c06ff20 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb92000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 0x7feb8c151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb91600640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feb80005890 tx=0x7feb8000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80017070 con 0x7feb8c06ff20 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80005d10 con 0x7feb8c06ff20 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80007310 con 0x7feb8c06ff20 2024-09-15T22:52:24.672 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c155270 con 0x7feb8c06ff20 2024-09-15T22:52:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c14dc70 con 0x7feb8c06ff20 2024-09-15T22:52:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.667+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c0b3840 con 0x7feb8c06ff20 2024-09-15T22:52:24.673 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.671+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feb8001a070 con 0x7feb8c06ff20 2024-09-15T22:52:24.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.671+0000 7feb89600640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 0x7feb6c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:24.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.671+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5249+0+0 (secure 0 0 0) 0x7feb80084f50 con 0x7feb8c06ff20 2024-09-15T22:52:24.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.671+0000 7feb90c00640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 0x7feb6c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:24.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.671+0000 7feb90c00640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 0x7feb6c069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb8c1fe620 tx=0x7feb78008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:24.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.675+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feb80055bb0 con 0x7feb8c06ff20 2024-09-15T22:52:24.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:24.843+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feb8c14d2a0 con 0x7feb8c06ff20 2024-09-15T22:52:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.743+0000 7feb89600640 1 -- 172.21.15.31:0/3758961070 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v54) ==== 138+0+0 (secure 0 0 0) 0x7feb800554b0 con 0x7feb8c06ff20 2024-09-15T22:52:25.748 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' created 2024-09-15T22:52:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 msgr2=0x7feb6c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 0x7feb6c069d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feb8c1fe620 tx=0x7feb78008040 comp rx=0 tx=0).stop 2024-09-15T22:52:25.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 msgr2=0x7feb8c0b26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feb80005890 tx=0x7feb8000c8e0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 shutdown_connections 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feb6c0678c0 0x7feb6c069d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7feb8c15c8d0 0x7feb8c151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7feb8c0d0010 0x7feb8c154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 --2- 172.21.15.31:0/3758961070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7feb8c06ff20 0x7feb8c0b26a0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 >> 172.21.15.31:0/3758961070 conn(0x7feb8c06be90 msgr2=0x7feb8c06c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 shutdown_connections 2024-09-15T22:52:25.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.747+0000 7feb94000640 1 -- 172.21.15.31:0/3758961070 wait complete. 2024-09-15T22:52:25.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-15T22:52:25.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 Processor -- start 2024-09-15T22:52:25.933 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 -- start start 2024-09-15T22:52:25.934 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 0x7f7b700b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7006c3d0 0x7f7b700d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b700b6200 con 0x7f7b700b40d0 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f7b701481c0 con 0x7f7b7006c3d0 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b75800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7b7015edb0 con 0x7f7b70147de0 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7006c3d0 0x7f7b700d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f7b7006c3d0 0x7f7b700d0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50240/0 (socket says 172.21.15.31:50240) 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 -- 172.21.15.31:0/1186931778 learned_addr learned my addr 172.21.15.31:0/1186931778 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:25.935 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6ea00640 1 --2- 172.21.15.31:0/1186931778 >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 0x7f7b700b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 -- 172.21.15.31:0/1186931778 >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 msgr2=0x7f7b700b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 --2- 172.21.15.31:0/1186931778 >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 0x7f7b700b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 -- 172.21.15.31:0/1186931778 >> v1:172.21.15.31:6789/0 conn(0x7f7b700b40d0 legacy=0x7f7b7006bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6f400640 1 -- 172.21.15.31:0/1186931778 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7015f090 con 0x7f7b7006c3d0 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6e000640 1 -- 172.21.15.31:0/1186931778 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815590623 0 0) 0x7f7b700b6200 con 0x7f7b700b40d0 2024-09-15T22:52:25.936 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.931+0000 7f7b6ea00640 1 --2- 172.21.15.31:0/1186931778 >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 0x7f7b700b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:25.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b6f400640 1 --2- 172.21.15.31:0/1186931778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7006c3d0 0x7f7b700d0fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b700d2250 tx=0x7f7b6801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1bc0243358447a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:25.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b6e000640 1 -- 172.21.15.31:0/1186931778 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b680ac070 con 0x7f7b7006c3d0 2024-09-15T22:52:25.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b6e000640 1 -- 172.21.15.31:0/1186931778 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b680a6480 con 0x7f7b7006c3d0 2024-09-15T22:52:25.938 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b6e000640 1 -- 172.21.15.31:0/1186931778 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b680a6850 con 0x7f7b7006c3d0 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 -- 172.21.15.31:0/1186931778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7006c3d0 msgr2=0x7f7b700d0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 --2- 172.21.15.31:0/1186931778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7006c3d0 0x7f7b700d0fc0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7b700d2250 tx=0x7f7b6801c9c0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 -- 172.21.15.31:0/1186931778 shutdown_connections 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 --2- 172.21.15.31:0/1186931778 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b7006c3d0 0x7f7b700d0fc0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 --2- 172.21.15.31:0/1186931778 >> v2:172.21.15.102:3300/0 conn(0x7f7b70147de0 0x7f7b700b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 -- 172.21.15.31:0/1186931778 >> 172.21.15.31:0/1186931778 conn(0x7f7b7009aa40 msgr2=0x7f7b700b65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:25.939 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 -- 172.21.15.31:0/1186931778 shutdown_connections 2024-09-15T22:52:25.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 -- 172.21.15.31:0/1186931778 wait complete. 2024-09-15T22:52:25.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.935+0000 7f7b75800640 1 Processor -- start 2024-09-15T22:52:25.940 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- start start 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b7006c3d0 0x7f7b70146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 0x7f7b70143050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7b700b4500 con 0x7f7b700b40d0 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7015faa0 con 0x7f7b7006c3d0 2024-09-15T22:52:25.942 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7b700b4680 con 0x7f7b70147de0 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50244/0 (socket says 172.21.15.31:50244) 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 -- 172.21.15.31:0/4210655243 learned_addr learned my addr 172.21.15.31:0/4210655243 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b6ea00640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b7006c3d0 0x7f7b70146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b6f400640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 0x7f7b70143050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 -- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 msgr2=0x7f7b70143050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 0x7f7b70143050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 -- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b7006c3d0 msgr2=0x7f7b70146710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b7006c3d0 0x7f7b70146710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 -- 172.21.15.31:0/4210655243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b701388d0 con 0x7f7b700b40d0 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b6f400640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 0x7f7b70143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:25.943 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b66000640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c4d0 tx=0x7f7b5800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58017070 con 0x7f7b700b40d0 2024-09-15T22:52:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b58005480 con 0x7f7b700b40d0 2024-09-15T22:52:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b58003840 con 0x7f7b700b40d0 2024-09-15T22:52:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b70144a90 con 0x7f7b700b40d0 2024-09-15T22:52:25.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b700b17c0 con 0x7f7b700b40d0 2024-09-15T22:52:25.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.939+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b700d0fc0 con 0x7f7b700b40d0 2024-09-15T22:52:25.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.943+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f7b5801a070 con 0x7f7b700b40d0 2024-09-15T22:52:25.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.943+0000 7f7b67400640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 0x7f7b4c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:25.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.943+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 5619+0+0 (secure 0 0 0) 0x7f7b58084fd0 con 0x7f7b700b40d0 2024-09-15T22:52:25.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.943+0000 7f7b6ea00640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 0x7f7b4c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:25.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.943+0000 7f7b6ea00640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 0x7f7b4c069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b600045f0 tx=0x7f7b60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:25.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:25.947+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7b580555c0 con 0x7f7b700b40d0 2024-09-15T22:52:26.119 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.115+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7b7013f000 con 0x7f7b700b40d0 2024-09-15T22:52:26.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.747+0000 7f7b67400640 1 -- 172.21.15.31:0/4210655243 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v55) ==== 170+0+0 (secure 0 0 0) 0x7f7b580598c0 con 0x7f7b700b40d0 2024-09-15T22:52:26.752 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' created 2024-09-15T22:52:26.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 msgr2=0x7f7b4c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 0x7f7b4c069d80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7b600045f0 tx=0x7f7b60008040 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 msgr2=0x7f7b7013d930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c4d0 tx=0x7f7b5800c990 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 shutdown_connections 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7b4c0678c0 0x7f7b4c069d80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7b70147de0 0x7f7b70143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7b700b40d0 0x7f7b7013d930 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 --2- 172.21.15.31:0/4210655243 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f7b7006c3d0 0x7f7b70146710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 >> 172.21.15.31:0/4210655243 conn(0x7f7b7009aa40 msgr2=0x7f7b70160700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 shutdown_connections 2024-09-15T22:52:26.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.751+0000 7f7b75800640 1 -- 172.21.15.31:0/4210655243 wait complete. 2024-09-15T22:52:26.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-15T22:52:26.944 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.939+0000 7f4dde600640 1 Processor -- start 2024-09-15T22:52:26.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.939+0000 7f4dde600640 1 -- start start 2024-09-15T22:52:26.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dde600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd815e520 0x7f4dd80d02f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dde600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4dd81620d0 0x7f4dd80b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dde600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd80b3d50 con 0x7f4dd80d0830 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dde600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd80cf000 con 0x7f4dd81620d0 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dde600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd80cf250 con 0x7f4dd815e520 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4dd81620d0 0x7f4dd80b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4dd81620d0 0x7f4dd80b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50254/0 (socket says 172.21.15.31:50254) 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 -- 172.21.15.31:0/2923385613 learned_addr learned my addr 172.21.15.31:0/2923385613 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7400640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd815e520 0x7f4dd80d02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 -- 172.21.15.31:0/2923385613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd815e520 msgr2=0x7f4dd80d02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd815e520 0x7f4dd80d02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 -- 172.21.15.31:0/2923385613 >> v1:172.21.15.102:6789/0 conn(0x7f4dd80d0830 legacy=0x7f4dd806de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.948 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.943+0000 7f4dd7e00640 1 -- 172.21.15.31:0/2923385613 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd80cf530 con 0x7f4dd81620d0 2024-09-15T22:52:26.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dd7e00640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd81620d0 0x7f4dd80b3f70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009e50 tx=0x7f4dd001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2857a5f203417aa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dd6a00640 1 -- 172.21.15.31:0/2923385613 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00a5830 con 0x7f4dd81620d0 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dd6a00640 1 -- 172.21.15.31:0/2923385613 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dd00a59d0 con 0x7f4dd81620d0 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dd6a00640 1 -- 172.21.15.31:0/2923385613 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dd00a5da0 con 0x7f4dd81620d0 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- 172.21.15.31:0/2923385613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd81620d0 msgr2=0x7f4dd80b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd81620d0 0x7f4dd80b3f70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f4dd0009e50 tx=0x7f4dd001c970 comp rx=0 tx=0).stop 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- 172.21.15.31:0/2923385613 shutdown_connections 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd81620d0 0x7f4dd80b3f70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 --2- 172.21.15.31:0/2923385613 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd815e520 0x7f4dd80d02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- 172.21.15.31:0/2923385613 >> 172.21.15.31:0/2923385613 conn(0x7f4dd806be90 msgr2=0x7f4dd806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- 172.21.15.31:0/2923385613 shutdown_connections 2024-09-15T22:52:26.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- 172.21.15.31:0/2923385613 wait complete. 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 Processor -- start 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.947+0000 7f4dde600640 1 -- start start 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dd815e520 0x7f4dd814dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd81620d0 0x7f4dd806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd816b470 con 0x7f4dd80d0830 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd815e900 con 0x7f4dd815e520 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd816b5f0 con 0x7f4dd81620d0 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50258/0 (socket says 172.21.15.31:50258) 2024-09-15T22:52:26.953 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 -- 172.21.15.31:0/1550381119 learned_addr learned my addr 172.21.15.31:0/1550381119 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 -- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd81620d0 msgr2=0x7f4dd806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd81620d0 0x7f4dd806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 -- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dd815e520 msgr2=0x7f4dd814dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dd815e520 0x7f4dd814dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 -- 172.21.15.31:0/1550381119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd814ee40 con 0x7f4dd80d0830 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dd7400640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800e960 tx=0x7f4dc800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc8017070 con 0x7f4dd80d0830 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc800ca00 con 0x7f4dd80d0830 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd814f120 con 0x7f4dd80d0830 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc800cdb0 con 0x7f4dd80d0830 2024-09-15T22:52:26.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd814f6e0 con 0x7f4dd80d0830 2024-09-15T22:52:26.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd80d02f0 con 0x7f4dd80d0830 2024-09-15T22:52:26.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.951+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4dc801a070 con 0x7f4dd80d0830 2024-09-15T22:52:26.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.955+0000 7f4dcfe00640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 0x7f4db4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:26.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.955+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6001+0+0 (secure 0 0 0) 0x7f4dc8086520 con 0x7f4dd80d0830 2024-09-15T22:52:26.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.955+0000 7f4dcea00640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 0x7f4db4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:26.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.955+0000 7f4dcea00640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 0x7f4db4069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000f70 tx=0x7f4dc00079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:26.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:26.959+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4dc8056fa0 con 0x7f4dd80d0830 2024-09-15T22:52:27.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.159+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4dd80ce8d0 con 0x7f4dd80d0830 2024-09-15T22:52:27.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.787+0000 7f4dcfe00640 1 -- 172.21.15.31:0/1550381119 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 7 and data pool 8 v29) ==== 172+0+0 (secure 0 0 0) 0x7f4dc80568a0 con 0x7f4dd80d0830 2024-09-15T22:52:27.792 INFO:teuthology.orchestra.run.smithi031.stderr:new fs with metadata pool 7 and data pool 8 2024-09-15T22:52:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 msgr2=0x7f4db4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.804 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 0x7f4db4069db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4dc0000f70 tx=0x7f4dc00079e0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 msgr2=0x7f4dd814e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f4dc800e960 tx=0x7f4dc800ee20 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 shutdown_connections 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4db40678f0 0x7f4db4069db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4dd81620d0 0x7f4dd806f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4dd815e520 0x7f4dd814dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 --2- 172.21.15.31:0/1550381119 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4dd80d0830 0x7f4dd814e610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 >> 172.21.15.31:0/1550381119 conn(0x7f4dd806be90 msgr2=0x7f4dd815b5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:27.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.799+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 shutdown_connections 2024-09-15T22:52:27.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.803+0000 7f4dde600640 1 -- 172.21.15.31:0/1550381119 wait complete. 2024-09-15T22:52:27.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:27.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.975+0000 7f5a9c800640 1 Processor -- start 2024-09-15T22:52:27.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9c800640 1 -- start start 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9c800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a9415e8e0 0x7f5a9409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9c800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a940b7170 con 0x7f5a9409af80 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9c800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a940b7450 con 0x7f5a9415e500 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9c800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5a9409b3f0 con 0x7f5a9415e8e0 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a99400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5a9415e8e0 0x7f5a9409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9a800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5a9409af80 0x7f5a940cc0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46024/0 (socket says 172.21.15.31:46024) 2024-09-15T22:52:27.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a9a800640 1 -- 172.21.15.31:0/1784297822 learned_addr learned my addr 172.21.15.31:0/1784297822 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a99400640 1 -- 172.21.15.31:0/1784297822 >> v1:172.21.15.102:6789/0 conn(0x7f5a9415e500 legacy=0x7f5a940b6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a99400640 1 -- 172.21.15.31:0/1784297822 >> v1:172.21.15.31:6789/0 conn(0x7f5a9409af80 legacy=0x7f5a940cc0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.979+0000 7f5a99400640 1 -- 172.21.15.31:0/1784297822 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a940cb5f0 con 0x7f5a9415e8e0 2024-09-15T22:52:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a99400640 1 --2- 172.21.15.31:0/1784297822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9415e8e0 0x7f5a9409aa40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a840097c0 tx=0x7f5a8401c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f412df7c35e8995 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a98a00640 1 -- 172.21.15.31:0/1784297822 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840ab430 con 0x7f5a9415e8e0 2024-09-15T22:52:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a98a00640 1 -- 172.21.15.31:0/1784297822 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a840b0070 con 0x7f5a9415e8e0 2024-09-15T22:52:27.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a98a00640 1 -- 172.21.15.31:0/1784297822 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a840ab7f0 con 0x7f5a9415e8e0 2024-09-15T22:52:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- 172.21.15.31:0/1784297822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9415e8e0 msgr2=0x7f5a9409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 --2- 172.21.15.31:0/1784297822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9415e8e0 0x7f5a9409aa40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5a840097c0 tx=0x7f5a8401c430 comp rx=0 tx=0).stop 2024-09-15T22:52:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- 172.21.15.31:0/1784297822 shutdown_connections 2024-09-15T22:52:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 --2- 172.21.15.31:0/1784297822 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9415e8e0 0x7f5a9409aa40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- 172.21.15.31:0/1784297822 >> 172.21.15.31:0/1784297822 conn(0x7f5a940b3f70 msgr2=0x7f5a940b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:27.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- 172.21.15.31:0/1784297822 shutdown_connections 2024-09-15T22:52:27.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- 172.21.15.31:0/1784297822 wait complete. 2024-09-15T22:52:27.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 Processor -- start 2024-09-15T22:52:27.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.983+0000 7f5a9c800640 1 -- start start 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 0x7f5a9414d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a9415e8e0 0x7f5a940ce7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9409bb00 con 0x7f5a9409af80 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9409b980 con 0x7f5a9415e8e0 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5a940ccff0 con 0x7f5a9415e500 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50288/0 (socket says 172.21.15.31:50288) 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 -- 172.21.15.31:0/2752979511 learned_addr learned my addr 172.21.15.31:0/2752979511 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:27.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99400640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 0x7f5a9414d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9a800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a9415e8e0 0x7f5a940ce7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 -- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 msgr2=0x7f5a9414d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 0x7f5a9414d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 -- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a9415e8e0 msgr2=0x7f5a940ce7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a9415e8e0 0x7f5a940ce7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 -- 172.21.15.31:0/2752979511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a94152c70 con 0x7f5a9409af80 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99400640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 0x7f5a9414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a99e00640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c480 tx=0x7f5a8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88012830 con 0x7f5a9409af80 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a88017070 con 0x7f5a9409af80 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88012c30 con 0x7f5a9409af80 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a94152f50 con 0x7f5a9409af80 2024-09-15T22:52:27.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a94155470 con 0x7f5a9409af80 2024-09-15T22:52:27.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a941529d0 con 0x7f5a9409af80 2024-09-15T22:52:27.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.987+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5a8801c460 con 0x7f5a9409af80 2024-09-15T22:52:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.991+0000 7f5a8e000640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 0x7f5a78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.991+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f5a88085c40 con 0x7f5a9409af80 2024-09-15T22:52:27.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.991+0000 7f5a99400640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 0x7f5a78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:27.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.991+0000 7f5a99400640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 0x7f5a78069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a840af000 tx=0x7f5a840a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:27.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:27.995+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5a88056680 con 0x7f5a9409af80 2024-09-15T22:52:28.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.159+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a9409aa40 con 0x7f5a9409af80 2024-09-15T22:52:28.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.159+0000 7f5a8e000640 1 -- 172.21.15.31:0/2752979511 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16979 (secure 0 0 0) 0x7f5a88055f80 con 0x7f5a9409af80 2024-09-15T22:52:28.164 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:28.164 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:27.162533+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:52:24.890486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:52:26.164803+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 msgr2=0x7f5a78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 0x7f5a78069d80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f5a840af000 tx=0x7f5a840a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 msgr2=0x7f5a94152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c480 tx=0x7f5a8800c940 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 shutdown_connections 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5a780678c0 0x7f5a78069d80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5a9415e8e0 0x7f5a940ce7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5a9415e500 0x7f5a9414d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 --2- 172.21.15.31:0/2752979511 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5a9409af80 0x7f5a94152370 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 >> 172.21.15.31:0/2752979511 conn(0x7f5a940b3f70 msgr2=0x7f5a9406cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 shutdown_connections 2024-09-15T22:52:28.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.163+0000 7f5a9c800640 1 -- 172.21.15.31:0/2752979511 wait complete. 2024-09-15T22:52:28.186 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:28.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 Processor -- start 2024-09-15T22:52:28.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 -- start start 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f42f0072870 0x7f42f015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f0072d40 con 0x7f42f006f270 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42f0073020 con 0x7f42f00b47a0 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f7e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f42f015ba60 con 0x7f42f0072870 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f5400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f42f006f270 0x7f42f006f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46040/0 (socket says 172.21.15.31:46040) 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f5400640 1 -- 172.21.15.31:0/906830144 learned_addr learned my addr 172.21.15.31:0/906830144 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:28.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.323+0000 7f42f5e00640 1 --2- 172.21.15.31:0/906830144 >> v2:172.21.15.102:3300/0 conn(0x7f42f0072870 0x7f42f015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789468383 0 0) 0x7f42f0072d40 con 0x7f42f006f270 2024-09-15T22:52:28.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42d8003530 con 0x7f42f006f270 2024-09-15T22:52:28.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088457849 0 0) 0x7f42f0073020 con 0x7f42f00b47a0 2024-09-15T22:52:28.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42f0072d40 con 0x7f42f00b47a0 2024-09-15T22:52:28.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42f5e00640 1 -- 172.21.15.31:0/906830144 >> v1:172.21.15.102:6789/0 conn(0x7f42f00b47a0 legacy=0x7f42f0072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1905424587 0 0) 0x7f42d8003530 con 0x7f42f006f270 2024-09-15T22:52:28.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42f5e00640 1 -- 172.21.15.31:0/906830144 >> v1:172.21.15.31:6789/0 conn(0x7f42f006f270 legacy=0x7f42f006f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42f5e00640 1 -- 172.21.15.31:0/906830144 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f00b3cc0 con 0x7f42f0072870 2024-09-15T22:52:28.331 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42f5e00640 1 --2- 172.21.15.31:0/906830144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f015c840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e801c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3abbe3ec1ff2a769 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4001680 con 0x7f42f0072870 2024-09-15T22:52:28.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e80a64e0 con 0x7f42f0072870 2024-09-15T22:52:28.332 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.327+0000 7f42efe00640 1 -- 172.21.15.31:0/906830144 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e80a6890 con 0x7f42f0072870 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- 172.21.15.31:0/906830144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 msgr2=0x7f42f015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 --2- 172.21.15.31:0/906830144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f015c840 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009d90 tx=0x7f42e801c890 comp rx=0 tx=0).stop 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- 172.21.15.31:0/906830144 shutdown_connections 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 --2- 172.21.15.31:0/906830144 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f015c840 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- 172.21.15.31:0/906830144 >> 172.21.15.31:0/906830144 conn(0x7f42f0067e00 msgr2=0x7f42f006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- 172.21.15.31:0/906830144 shutdown_connections 2024-09-15T22:52:28.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- 172.21.15.31:0/906830144 wait complete. 2024-09-15T22:52:28.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 Processor -- start 2024-09-15T22:52:28.334 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- start start 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f01fa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 0x7f42f01fa9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f42f015d310 con 0x7f42f006f270 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f42f015d190 con 0x7f42f0072870 2024-09-15T22:52:28.336 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f7e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f42f01694e0 con 0x7f42f00b47a0 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50298/0 (socket says 172.21.15.31:50298) 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 -- 172.21.15.31:0/3960069645 learned_addr learned my addr 172.21.15.31:0/3960069645 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 0x7f42f01fa9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f4a00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f01fa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 -- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 msgr2=0x7f42f01fa9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 0x7f42f01fa9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 -- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 msgr2=0x7f42f01fa470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f01fa470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5400640 1 -- 172.21.15.31:0/3960069645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42f00abe60 con 0x7f42f006f270 2024-09-15T22:52:28.337 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.331+0000 7f42f5e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 0x7f42f01fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:28.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42f5400640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c780 tx=0x7f42e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4017070 con 0x7f42f006f270 2024-09-15T22:52:28.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42e4005b00 con 0x7f42f006f270 2024-09-15T22:52:28.338 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4007070 con 0x7f42f006f270 2024-09-15T22:52:28.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42f00ac140 con 0x7f42f006f270 2024-09-15T22:52:28.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42f00b0630 con 0x7f42f006f270 2024-09-15T22:52:28.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42f015c840 con 0x7f42f006f270 2024-09-15T22:52:28.339 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f42e401a070 con 0x7f42f006f270 2024-09-15T22:52:28.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 0x7f42d0069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f42e4085320 con 0x7f42f006f270 2024-09-15T22:52:28.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.335+0000 7f42f4a00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 0x7f42d0069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.340 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.339+0000 7f42f4a00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 0x7f42d0069db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b2820 tx=0x7f42dc009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.343 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.339+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f42e4055d60 con 0x7f42f006f270 2024-09-15T22:52:28.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.507+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f42f00ac310 con 0x7f42f006f270 2024-09-15T22:52:28.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.507+0000 7f42ed600640 1 -- 172.21.15.31:0/3960069645 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) ==== 74+0+16979 (secure 0 0 0) 0x7f42e4055660 con 0x7f42f006f270 2024-09-15T22:52:28.512 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:28.512 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":56,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:27.162533+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:52:24.890486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:52:26.164803+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 msgr2=0x7f42d0069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 0x7f42d0069db0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f42f00b2820 tx=0x7f42dc009040 comp rx=0 tx=0).stop 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 msgr2=0x7f42f014ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f42e400c780 tx=0x7f42e400cc40 comp rx=0 tx=0).stop 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 shutdown_connections 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f42d00678f0 0x7f42d0069db0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.514 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f42f00b47a0 0x7f42f01fa9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f42f0072870 0x7f42f01fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 --2- 172.21.15.31:0/3960069645 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f42f006f270 0x7f42f014ef80 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 >> 172.21.15.31:0/3960069645 conn(0x7f42f0067e00 msgr2=0x7f42f0074780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 shutdown_connections 2024-09-15T22:52:28.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.511+0000 7f42f7e00640 1 -- 172.21.15.31:0/3960069645 wait complete. 2024-09-15T22:52:28.533 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-15T22:52:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.671+0000 7f9fbfe00640 1 Processor -- start 2024-09-15T22:52:28.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.671+0000 7f9fbfe00640 1 -- start start 2024-09-15T22:52:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc015b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbfe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fc00d0560 0x7f9fc015c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbfe00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fc015bfc0 con 0x7f9fc00cd4f0 2024-09-15T22:52:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbfe00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9fc00cfc70 con 0x7f9fc00d0560 2024-09-15T22:52:28.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbfe00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc015c2a0 con 0x7f9fc00d0100 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fc00d0560 0x7f9fc015c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9fc00d0560 0x7f9fc015c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50304/0 (socket says 172.21.15.31:50304) 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 -- 172.21.15.31:0/2417271359 learned_addr learned my addr 172.21.15.31:0/2417271359 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbea00640 1 --1- 172.21.15.31:0/2417271359 >> v1:172.21.15.31:6789/0 conn(0x7f9fc00cd4f0 0x7f9fc00cd8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46042/0 (socket says 172.21.15.31:46042) 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fb6000640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc015b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 -- 172.21.15.31:0/2417271359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 msgr2=0x7f9fc015b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc015b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 -- 172.21.15.31:0/2417271359 >> v1:172.21.15.31:6789/0 conn(0x7f9fc00cd4f0 legacy=0x7f9fc00cd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.678 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.675+0000 7f9fbf400640 1 -- 172.21.15.31:0/2417271359 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc00cf900 con 0x7f9fc00d0560 2024-09-15T22:52:28.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbf400640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc015c690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009e50 tx=0x7f9fb801c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91caf9cc82823bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbe000640 1 -- 172.21.15.31:0/2417271359 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a5880 con 0x7f9fc00d0560 2024-09-15T22:52:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbe000640 1 -- 172.21.15.31:0/2417271359 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80a5a20 con 0x7f9fc00d0560 2024-09-15T22:52:28.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbe000640 1 -- 172.21.15.31:0/2417271359 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80a5df0 con 0x7f9fc00d0560 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- 172.21.15.31:0/2417271359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 msgr2=0x7f9fc015c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc015c690 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8009e50 tx=0x7f9fb801c9a0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- 172.21.15.31:0/2417271359 shutdown_connections 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc015c690 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/2417271359 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc015b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- 172.21.15.31:0/2417271359 >> 172.21.15.31:0/2417271359 conn(0x7f9fc0073430 msgr2=0x7f9fc006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- 172.21.15.31:0/2417271359 shutdown_connections 2024-09-15T22:52:28.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- 172.21.15.31:0/2417271359 wait complete. 2024-09-15T22:52:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 Processor -- start 2024-09-15T22:52:28.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- start start 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 0x7f9fc00aa390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc0140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc01418b0 con 0x7f9fc00d0560 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9fc0141730 con 0x7f9fc00cd4f0 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbfe00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9fc0168440 con 0x7f9fc00d0100 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.679+0000 7f9fbf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 0x7f9fc00aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fb6000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc0140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50316/0 (socket says 172.21.15.31:50316) 2024-09-15T22:52:28.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 -- 172.21.15.31:0/1108936722 learned_addr learned my addr 172.21.15.31:0/1108936722 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 0x7f9fc00aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:45330/0 (socket says 172.21.15.31:45330) 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 -- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 msgr2=0x7f9fc0140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc0140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 -- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 msgr2=0x7f9fc00aa390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 0x7f9fc00aa390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:28.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 -- 172.21.15.31:0/1108936722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fc0141b60 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbf400640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80af040 tx=0x7f9fb8019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80bc020 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9fb80b8670 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fb80b8a40 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fc0141e40 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fc0142400 con 0x7f9fc00d0560 2024-09-15T22:52:28.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fc015b4d0 con 0x7f9fc00d0560 2024-09-15T22:52:28.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.683+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9fb80bf020 con 0x7f9fc00d0560 2024-09-15T22:52:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.687+0000 7f9fb7400640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 0x7f9f9c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.687+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 6101+0+0 (secure 0 0 0) 0x7f9fb8120de0 con 0x7f9fc00d0560 2024-09-15T22:52:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.687+0000 7f9fbea00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 0x7f9f9c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:28.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.687+0000 7f9fbea00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 0x7f9f9c069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00b0530 tx=0x7f9fb0007e90 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:28.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.691+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9fb80c6030 con 0x7f9fc00d0560 2024-09-15T22:52:28.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:28.899+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9fc01425d0 con 0x7f9fc00d0560 2024-09-15T22:52:28.939 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-15T22:52:29.802 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.799+0000 7f9fb7400640 1 -- 172.21.15.31:0/1108936722 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) ==== 118+0+0 (secure 0 0 0) 0x7f9fb8016620 con 0x7f9fc00d0560 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 msgr2=0x7f9f9c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 0x7f9f9c069d80 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9fc00b0530 tx=0x7f9fb0007e90 comp rx=0 tx=0).stop 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 msgr2=0x7f9fc00ad960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9fb80af040 tx=0x7f9fb8019740 comp rx=0 tx=0).stop 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 shutdown_connections 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9f9c0678c0 0x7f9f9c069d80 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9fc00d0560 0x7f9fc00ad960 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9fc00d0100 0x7f9fc0140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.805 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 --2- 172.21.15.31:0/1108936722 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9fc00cd4f0 0x7f9fc00aa390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 >> 172.21.15.31:0/1108936722 conn(0x7f9fc0073430 msgr2=0x7f9fc00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:29.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 shutdown_connections 2024-09-15T22:52:29.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.803+0000 7f9fbfe00640 1 -- 172.21.15.31:0/1108936722 wait complete. 2024-09-15T22:52:29.829 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-15T22:52:29.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-15T22:52:29.977 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 Processor -- start 2024-09-15T22:52:29.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 -- start start 2024-09-15T22:52:29.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4a2406ff20 0x7f4a2415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a24156d20 con 0x7f4a2415c8d0 2024-09-15T22:52:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f4a2415d730 con 0x7f4a2406ff20 2024-09-15T22:52:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a29000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4a240b40c0 con 0x7f4a240d0010 2024-09-15T22:52:29.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:51058/0 (socket says 172.21.15.31:51058) 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 -- 172.21.15.31:0/2028951886 learned_addr learned my addr 172.21.15.31:0/2028951886 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a22800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f4a2406ff20 0x7f4a2415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a21e00640 1 --1- 172.21.15.31:0/2028951886 >> v1:172.21.15.102:6789/0 conn(0x7f4a2415c8d0 0x7f4a240b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:51664/0 (socket says 172.21.15.31:51664) 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 -- 172.21.15.31:0/2028951886 >> v2:172.21.15.102:3300/0 conn(0x7f4a2406ff20 msgr2=0x7f4a2415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 --2- 172.21.15.31:0/2028951886 >> v2:172.21.15.102:3300/0 conn(0x7f4a2406ff20 0x7f4a2415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 -- 172.21.15.31:0/2028951886 >> v1:172.21.15.102:6789/0 conn(0x7f4a2415c8d0 legacy=0x7f4a240b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.975+0000 7f4a19400640 1 -- 172.21.15.31:0/2028951886 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a240b43a0 con 0x7f4a240d0010 2024-09-15T22:52:29.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a19400640 1 --2- 172.21.15.31:0/2028951886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009870 tx=0x7f4a0c01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=82ddf1a866d32457 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:29.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a21400640 1 -- 172.21.15.31:0/2028951886 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a95f0 con 0x7f4a240d0010 2024-09-15T22:52:29.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a21400640 1 -- 172.21.15.31:0/2028951886 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a0c0a9790 con 0x7f4a240d0010 2024-09-15T22:52:29.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a21400640 1 -- 172.21.15.31:0/2028951886 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a0c0a9b60 con 0x7f4a240d0010 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 -- 172.21.15.31:0/2028951886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 msgr2=0x7f4a2415ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 --2- 172.21.15.31:0/2028951886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c009870 tx=0x7f4a0c01c530 comp rx=0 tx=0).stop 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 -- 172.21.15.31:0/2028951886 shutdown_connections 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 --2- 172.21.15.31:0/2028951886 >> v2:172.21.15.102:3300/0 conn(0x7f4a2406ff20 0x7f4a2415d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 --2- 172.21.15.31:0/2028951886 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a240d0010 0x7f4a2415ccb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 -- 172.21.15.31:0/2028951886 >> 172.21.15.31:0/2028951886 conn(0x7f4a2406be90 msgr2=0x7f4a2406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 -- 172.21.15.31:0/2028951886 shutdown_connections 2024-09-15T22:52:29.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.979+0000 7f4a29000640 1 -- 172.21.15.31:0/2028951886 wait complete. 2024-09-15T22:52:29.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 Processor -- start 2024-09-15T22:52:29.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- start start 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a2406ff20 0x7f4a24146620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a240d0010 0x7f4a241529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4a24168820 con 0x7f4a2415c8d0 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4a241686a0 con 0x7f4a240d0010 2024-09-15T22:52:29.987 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4a241689a0 con 0x7f4a2406ff20 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50322/0 (socket says 172.21.15.31:50322) 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 -- 172.21.15.31:0/3550636501 learned_addr learned my addr 172.21.15.31:0/3550636501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a19400640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a240d0010 0x7f4a241529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a21e00640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a2406ff20 0x7f4a24146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 -- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a2406ff20 msgr2=0x7f4a24146620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a2406ff20 0x7f4a24146620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 -- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a240d0010 msgr2=0x7f4a241529f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a240d0010 0x7f4a241529f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 -- 172.21.15.31:0/3550636501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a24152660 con 0x7f4a2415c8d0 2024-09-15T22:52:29.988 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a22800640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00efc0 tx=0x7f4a1c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c018020 con 0x7f4a2415c8d0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a1c014480 con 0x7f4a2415c8d0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a2415da00 con 0x7f4a2415c8d0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1c014870 con 0x7f4a2415c8d0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.983+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a24151e60 con 0x7f4a2415c8d0 2024-09-15T22:52:29.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a24151c80 con 0x7f4a2415c8d0 2024-09-15T22:52:29.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4a1c01b020 con 0x7f4a2415c8d0 2024-09-15T22:52:29.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a1aa00640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 0x7f4a00069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:29.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f4a1c086810 con 0x7f4a2415c8d0 2024-09-15T22:52:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a21e00640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 0x7f4a00069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:29.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.987+0000 7f4a21e00640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 0x7f4a00069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f70 tx=0x7f4a14007e30 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:29.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:29.991+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4a24151c80 con 0x7f4a2415c8d0 2024-09-15T22:52:30.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.191+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4a240b3840 con 0x7f4a2415c8d0 2024-09-15T22:52:30.803 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.799+0000 7f4a1aa00640 1 -- 172.21.15.31:0/3550636501 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) ==== 122+0+0 (secure 0 0 0) 0x7f4a1c022070 con 0x7f4a2415c8d0 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 msgr2=0x7f4a00069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 0x7f4a00069d80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4a14000f70 tx=0x7f4a14007e30 comp rx=0 tx=0).stop 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 msgr2=0x7f4a24152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f4a1c00efc0 tx=0x7f4a1c00c490 comp rx=0 tx=0).stop 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 shutdown_connections 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4a000678c0 0x7f4a00069d80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4a2415c8d0 0x7f4a24152f30 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.806 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4a240d0010 0x7f4a241529f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 --2- 172.21.15.31:0/3550636501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4a2406ff20 0x7f4a24146620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 >> 172.21.15.31:0/3550636501 conn(0x7f4a2406be90 msgr2=0x7f4a240cef00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:30.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 shutdown_connections 2024-09-15T22:52:30.807 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.803+0000 7f4a29000640 1 -- 172.21.15.31:0/3550636501 wait complete. 2024-09-15T22:52:30.828 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-15T22:52:30.829 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:30.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.967+0000 7f0d59200640 1 Processor -- start 2024-09-15T22:52:30.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.967+0000 7f0d59200640 1 -- start start 2024-09-15T22:52:30.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d59200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5413fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d59200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d5406e160 0x7f0d5406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d59200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d541407b0 con 0x7f0d54072160 2024-09-15T22:52:30.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d59200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5413f640 con 0x7f0d5406e160 2024-09-15T22:52:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d59200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0d541413c0 con 0x7f0d5413fa40 2024-09-15T22:52:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d49400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5413fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d51e00640 1 --1- >> v1:172.21.15.102:6789/0 conn(0x7f0d54072160 0x7f0d54072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.102:6789/0 says I am v1:172.21.15.31:51676/0 (socket says 172.21.15.31:51676) 2024-09-15T22:52:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d52800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0d5406e160 0x7f0d5406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d51e00640 1 -- 172.21.15.31:0/2115914505 learned_addr learned my addr 172.21.15.31:0/2115914505 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d51400640 1 -- 172.21.15.31:0/2115914505 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871235921 0 0) 0x7f0d541407b0 con 0x7f0d54072160 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d51400640 1 -- 172.21.15.31:0/2115914505 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d38003530 con 0x7f0d54072160 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d52800640 1 -- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 msgr2=0x7f0d5413fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d52800640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5413fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d52800640 1 -- 172.21.15.31:0/2115914505 >> v1:172.21.15.102:6789/0 conn(0x7f0d54072160 legacy=0x7f0d54072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d52800640 1 -- 172.21.15.31:0/2115914505 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d54140a90 con 0x7f0d5406e160 2024-09-15T22:52:30.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.971+0000 7f0d49400640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5413fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:30.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d52800640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d5406e610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009d90 tx=0x7f0d4c01c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263973fdf2f72bee server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d51400640 1 -- 172.21.15.31:0/2115914505 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0b2070 con 0x7f0d5406e160 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d51400640 1 -- 172.21.15.31:0/2115914505 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0a5890 con 0x7f0d5406e160 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d51400640 1 -- 172.21.15.31:0/2115914505 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c0a5c60 con 0x7f0d5406e160 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 -- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 msgr2=0x7f0d5406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d5406e610 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c009d90 tx=0x7f0d4c01c8e0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 -- 172.21.15.31:0/2115914505 shutdown_connections 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d5406e610 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 --2- 172.21.15.31:0/2115914505 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5413fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 -- 172.21.15.31:0/2115914505 >> 172.21.15.31:0/2115914505 conn(0x7f0d54067e00 msgr2=0x7f0d5406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:30.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 -- 172.21.15.31:0/2115914505 shutdown_connections 2024-09-15T22:52:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.975+0000 7f0d59200640 1 -- 172.21.15.31:0/2115914505 wait complete. 2024-09-15T22:52:30.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 Processor -- start 2024-09-15T22:52:30.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- start start 2024-09-15T22:52:30.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d540af490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5415d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54168ee0 con 0x7f0d54072160 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0d54168d60 con 0x7f0d5406e160 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0d54169060 con 0x7f0d5413fa40 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50334/0 (socket says 172.21.15.31:50334) 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 -- 172.21.15.31:0/499470545 learned_addr learned my addr 172.21.15.31:0/499470545 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d51e00640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d540af490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d52800640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5415d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 -- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 msgr2=0x7f0d5415d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5415d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 -- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 msgr2=0x7f0d540af490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:30.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d540af490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:30.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 -- 172.21.15.31:0/499470545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d540aeba0 con 0x7f0d54072160 2024-09-15T22:52:30.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d49400640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00e930 tx=0x7f0d3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c017070 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d3c00ca00 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d3c00cdd0 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d540b0b80 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d540b1140 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.979+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d541407b0 con 0x7f0d54072160 2024-09-15T22:52:30.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.983+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0d3c01a070 con 0x7f0d54072160 2024-09-15T22:52:30.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.983+0000 7f0d4aa00640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 0x7f0d30069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:30.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.983+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0d3c0860a0 con 0x7f0d54072160 2024-09-15T22:52:30.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.983+0000 7f0d51e00640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 0x7f0d30069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:30.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.983+0000 7f0d51e00640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 0x7f0d30069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d44007fd0 tx=0x7f0d44009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:30.990 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:30.987+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0d3c056360 con 0x7f0d54072160 2024-09-15T22:52:31.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.187+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d5406f9d0 con 0x7f0d54072160 2024-09-15T22:52:31.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d4aa00640 1 -- 172.21.15.31:0/499470545 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5217 (secure 0 0 0) 0x7f0d3c05a660 con 0x7f0d54072160 2024-09-15T22:52:31.193 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:31.193 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"btime":"2024-09-15T22:52:30:802133+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3847880962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3847880962},{"type":"v1","addr":"172.21.15.102:6836","nonce":3847880962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/52513834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":52513834},{"type":"v1","addr":"172.21.15.102:6837","nonce":52513834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/411861553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":411861553},{"type":"v1","addr":"172.21.15.31:6833","nonce":411861553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:30.196577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/678504006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":678504006},{"type":"v1","addr":"172.21.15.31:6835","nonce":678504006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-15T22:52:31.193 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 33 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 msgr2=0x7f0d30069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 0x7f0d30069d80 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0d44007fd0 tx=0x7f0d44009040 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 msgr2=0x7f0d5415c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c00e930 tx=0x7f0d3c00edf0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 shutdown_connections 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0d300678c0 0x7f0d30069d80 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0d5413fa40 0x7f0d5415d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0d54072160 0x7f0d5415c530 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 --2- 172.21.15.31:0/499470545 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0d5406e160 0x7f0d540af490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 >> 172.21.15.31:0/499470545 conn(0x7f0d54067e00 msgr2=0x7f0d5413dc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 shutdown_connections 2024-09-15T22:52:31.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.191+0000 7f0d59200640 1 -- 172.21.15.31:0/499470545 wait complete. 2024-09-15T22:52:31.213 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:31.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 Processor -- start 2024-09-15T22:52:31.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 -- start start 2024-09-15T22:52:31.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ef406f270 0x7f0ef406f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef406fb90 con 0x7f0ef4072870 2024-09-15T22:52:31.354 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef4072d40 con 0x7f0ef40b47a0 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0efb200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef415ba60 con 0x7f0ef406f270 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ef406f270 0x7f0ef406f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0ef406f270 0x7f0ef406f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50342/0 (socket says 172.21.15.31:50342) 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 -- 172.21.15.31:0/4257419606 learned_addr learned my addr 172.21.15.31:0/4257419606 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef9200640 1 --1- 172.21.15.31:0/4257419606 >> v1:172.21.15.31:6789/0 conn(0x7f0ef4072870 0x7f0ef415c840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46048/0 (socket says 172.21.15.31:46048) 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 -- 172.21.15.31:0/4257419606 >> v1:172.21.15.102:6789/0 conn(0x7f0ef40b47a0 legacy=0x7f0ef4072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 -- 172.21.15.31:0/4257419606 >> v1:172.21.15.31:6789/0 conn(0x7f0ef4072870 legacy=0x7f0ef415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.351+0000 7f0ef3e00640 1 -- 172.21.15.31:0/4257419606 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef4073020 con 0x7f0ef406f270 2024-09-15T22:52:31.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/4257419606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef406f270 0x7f0ef406f650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009870 tx=0x7f0ee401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=737b32e0eca796bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0ef3400640 1 -- 172.21.15.31:0/4257419606 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40b2070 con 0x7f0ef406f270 2024-09-15T22:52:31.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0ef3400640 1 -- 172.21.15.31:0/4257419606 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee40a9070 con 0x7f0ef406f270 2024-09-15T22:52:31.358 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0ef3400640 1 -- 172.21.15.31:0/4257419606 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee40ad880 con 0x7f0ef406f270 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 -- 172.21.15.31:0/4257419606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef406f270 msgr2=0x7f0ef406f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 --2- 172.21.15.31:0/4257419606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef406f270 0x7f0ef406f650 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0ee4009870 tx=0x7f0ee401c560 comp rx=0 tx=0).stop 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 -- 172.21.15.31:0/4257419606 shutdown_connections 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 --2- 172.21.15.31:0/4257419606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef406f270 0x7f0ef406f650 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 -- 172.21.15.31:0/4257419606 >> 172.21.15.31:0/4257419606 conn(0x7f0ef4067e00 msgr2=0x7f0ef406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 -- 172.21.15.31:0/4257419606 shutdown_connections 2024-09-15T22:52:31.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.355+0000 7f0efb200640 1 -- 172.21.15.31:0/4257419606 wait complete. 2024-09-15T22:52:31.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 Processor -- start 2024-09-15T22:52:31.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- start start 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 0x7f0ef40b29e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ef4072870 0x7f0ef4153330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4155b90 con 0x7f0ef40b47a0 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef4155a10 con 0x7f0ef406f270 2024-09-15T22:52:31.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef40b4bb0 con 0x7f0ef4072870 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50344/0 (socket says 172.21.15.31:50344) 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 -- 172.21.15.31:0/1813046260 learned_addr learned my addr 172.21.15.31:0/1813046260 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 0x7f0ef40b29e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0eebe00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ef4072870 0x7f0ef4153330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 -- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ef4072870 msgr2=0x7f0ef4153330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ef4072870 0x7f0ef4153330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 -- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 msgr2=0x7f0ef40b29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 0x7f0ef40b29e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 -- 172.21.15.31:0/1813046260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef40b5920 con 0x7f0ef40b47a0 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 0x7f0ef40b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef9200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c7a0 tx=0x7f0eec00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec017070 con 0x7f0ef40b47a0 2024-09-15T22:52:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0eec00a640 con 0x7f0ef40b47a0 2024-09-15T22:52:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0eec00a9f0 con 0x7f0ef40b47a0 2024-09-15T22:52:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef40b2430 con 0x7f0ef40b47a0 2024-09-15T22:52:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef40b0d60 con 0x7f0ef40b47a0 2024-09-15T22:52:31.365 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.359+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef406f650 con 0x7f0ef40b47a0 2024-09-15T22:52:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.363+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0eec01a070 con 0x7f0ef40b47a0 2024-09-15T22:52:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.363+0000 7f0ef0c00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 0x7f0ed0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.363+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0eec085330 con 0x7f0ef40b47a0 2024-09-15T22:52:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.363+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 0x7f0ed0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.363+0000 7f0ef3e00640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 0x7f0ed0069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af000 tx=0x7f0ee40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.369 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.367+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0eec055680 con 0x7f0ef40b47a0 2024-09-15T22:52:31.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.535+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef4151910 con 0x7f0ef40b47a0 2024-09-15T22:52:31.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.535+0000 7f0ef0c00640 1 -- 172.21.15.31:0/1813046260 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16966 (secure 0 0 0) 0x7f0eec059980 con 0x7f0ef40b47a0 2024-09-15T22:52:31.539 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:31.539 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":57,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:28.768724+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:52:24.890486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:52:26.164803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 msgr2=0x7f0ed0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 0x7f0ed0069d80 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0ee40af000 tx=0x7f0ee40a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 msgr2=0x7f0ef4153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0eec00c7a0 tx=0x7f0eec00cc60 comp rx=0 tx=0).stop 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 shutdown_connections 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0ed00678c0 0x7f0ed0069d80 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0ef40b47a0 0x7f0ef4153870 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0ef4072870 0x7f0ef4153330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 --2- 172.21.15.31:0/1813046260 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0ef406f270 0x7f0ef40b29e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 >> 172.21.15.31:0/1813046260 conn(0x7f0ef4067e00 msgr2=0x7f0ef4154e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 shutdown_connections 2024-09-15T22:52:31.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.539+0000 7f0efb200640 1 -- 172.21.15.31:0/1813046260 wait complete. 2024-09-15T22:52:31.560 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:52:31.560 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:52:31.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 Processor -- start 2024-09-15T22:52:31.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 -- start start 2024-09-15T22:52:31.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f73940b47a0 0x7f7394072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7394072ad0 con 0x7f739406f270 2024-09-15T22:52:31.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7394072d40 con 0x7f73940726a0 2024-09-15T22:52:31.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7399600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f739415ba60 con 0x7f73940b47a0 2024-09-15T22:52:31.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7392a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f739406f270 0x7f739406f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46060/0 (socket says 172.21.15.31:46060) 2024-09-15T22:52:31.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7392a00640 1 -- 172.21.15.31:0/3566175169 learned_addr learned my addr 172.21.15.31:0/3566175169 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896711340 0 0) 0x7f7394072ad0 con 0x7f739406f270 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7378003530 con 0x7f739406f270 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7392000640 1 --2- 172.21.15.31:0/3566175169 >> v2:172.21.15.102:3300/0 conn(0x7f73940b47a0 0x7f7394072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3593801468 0 0) 0x7f7378003530 con 0x7f739406f270 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 >> v2:172.21.15.102:3300/0 conn(0x7f73940b47a0 msgr2=0x7f7394072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 --2- 172.21.15.31:0/3566175169 >> v2:172.21.15.102:3300/0 conn(0x7f73940b47a0 0x7f7394072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 >> v1:172.21.15.102:6789/0 conn(0x7f73940726a0 legacy=0x7f739415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394073020 con 0x7f739406f270 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f7384001680 con 0x7f739406f270 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 >> v1:172.21.15.31:6789/0 conn(0x7f739406f270 legacy=0x7f739406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780039c0 0x7f7378003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7378004810 0x7f7378004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 0x7f737800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f739415ba60 con 0x7f73780051d0 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f737800c120 con 0x7f73780039c0 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f737800e530 con 0x7f7378004810 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7393400640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 0x7f737800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7392000640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7378004810 0x7f7378004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.699+0000 7f7392a00640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780039c0 0x7f7378003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 -- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7378004810 msgr2=0x7f7378004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7378004810 0x7f7378004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 -- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780039c0 msgr2=0x7f7378003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:31.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780039c0 0x7f7378003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 -- 172.21.15.31:0/3566175169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7378003530 con 0x7f73780051d0 2024-09-15T22:52:31.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 -- 172.21.15.31:0/3566175169 reap_dead start 2024-09-15T22:52:31.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7393400640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 0x7f737800b9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f738c001e70 tx=0x7f738c01c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cd69590a4aaf65 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c001a90 con 0x7f73780051d0 2024-09-15T22:52:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c003bc0 con 0x7f73780051d0 2024-09-15T22:52:31.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7391600640 1 -- 172.21.15.31:0/3566175169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c005020 con 0x7f73780051d0 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 -- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 msgr2=0x7f737800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 0x7f737800b9d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f738c001e70 tx=0x7f738c01c780 comp rx=0 tx=0).stop 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 -- 172.21.15.31:0/3566175169 shutdown_connections 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 --2- 172.21.15.31:0/3566175169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f73780051d0 0x7f737800b9d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 -- 172.21.15.31:0/3566175169 >> 172.21.15.31:0/3566175169 conn(0x7f7394067e00 msgr2=0x7f739406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 -- 172.21.15.31:0/3566175169 shutdown_connections 2024-09-15T22:52:31.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.703+0000 7f7399600640 1 -- 172.21.15.31:0/3566175169 wait complete. 2024-09-15T22:52:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 Processor -- start 2024-09-15T22:52:31.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 -- start start 2024-09-15T22:52:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 0x7f73940aedd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7394159b30 0x7f7394159fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f73940b4310 con 0x7f7394157a20 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f73940affa0 con 0x7f73780051d0 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f73940b3fa0 con 0x7f7394159b30 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50360/0 (socket says 172.21.15.31:50360) 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 -- 172.21.15.31:0/1141021409 learned_addr learned my addr 172.21.15.31:0/1141021409 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7392a00640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 0x7f73940aedd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7392000640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7394159b30 0x7f7394159fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 -- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7394159b30 msgr2=0x7f7394159fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7394159b30 0x7f7394159fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 -- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 msgr2=0x7f73940aedd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 0x7f73940aedd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 -- 172.21.15.31:0/1141021409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7394158710 con 0x7f7394157a20 2024-09-15T22:52:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7392a00640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 0x7f73940aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7393400640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f738c01c5b0 tx=0x7f7378005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c007dc0 con 0x7f7394157a20 2024-09-15T22:52:31.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f738c003980 con 0x7f7394157a20 2024-09-15T22:52:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c001a90 con 0x7f7394157a20 2024-09-15T22:52:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.707+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73941589f0 con 0x7f7394157a20 2024-09-15T22:52:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7394158fb0 con 0x7f7394157a20 2024-09-15T22:52:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73940b4c30 con 0x7f7394157a20 2024-09-15T22:52:31.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f738c0a6480 con 0x7f7394157a20 2024-09-15T22:52:31.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f738aa00640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 0x7f7374069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:31.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f738c11f220 con 0x7f7394157a20 2024-09-15T22:52:31.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.711+0000 7f7392a00640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 0x7f7374069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:31.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.715+0000 7f7392a00640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 0x7f7374069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73940cfd70 tx=0x7f7384009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:31.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.715+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f738c0b7060 con 0x7f7394157a20 2024-09-15T22:52:31.889 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.883+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f739406ca60 con 0x7f73740678c0 2024-09-15T22:52:31.892 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f738aa00640 1 -- 172.21.15.31:0/1141021409 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f739406ca60 con 0x7f73740678c0 2024-09-15T22:52:31.895 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:31.897 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 msgr2=0x7f7374069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 0x7f7374069d80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f73940cfd70 tx=0x7f7384009040 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 msgr2=0x7f7394157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f738c01c5b0 tx=0x7f7378005840 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 shutdown_connections 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f73740678c0 0x7f7374069d80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7394157a20 0x7f7394157e90 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7394159b30 0x7f7394159fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 --2- 172.21.15.31:0/1141021409 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f73780051d0 0x7f73940aedd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 >> 172.21.15.31:0/1141021409 conn(0x7f7394067e00 msgr2=0x7f739415c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 shutdown_connections 2024-09-15T22:52:31.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:31.891+0000 7f7399600640 1 -- 172.21.15.31:0/1141021409 wait complete. 2024-09-15T22:52:31.915 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-15T22:52:31.586264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226920,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747800,"statfs":{"total":773094113280,"available":772861747200,"internally_reserved":0,"allocated":6660096,"data_stored":3633300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.834536"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042309+0000","last_change":"2024-09-15T22:52:27.805813+0000","last_active":"2024-09-15T22:52:30.042309+0000","last_peered":"2024-09-15T22:52:30.042309+0000","last_clean":"2024-09-15T22:52:30.042309+0000","last_became_active":"2024-09-15T22:52:27.804488+0000","last_became_peered":"2024-09-15T22:52:27.804488+0000","last_unstale":"2024-09-15T22:52:30.042309+0000","last_undegraded":"2024-09-15T22:52:30.042309+0000","last_fullsized":"2024-09-15T22:52:30.042309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:16.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811709+0000","last_change":"2024-09-15T22:52:27.785730+0000","last_active":"2024-09-15T22:52:28.811709+0000","last_peered":"2024-09-15T22:52:28.811709+0000","last_clean":"2024-09-15T22:52:28.811709+0000","last_became_active":"2024-09-15T22:52:27.781253+0000","last_became_peered":"2024-09-15T22:52:27.781253+0000","last_unstale":"2024-09-15T22:52:28.811709+0000","last_undegraded":"2024-09-15T22:52:28.811709+0000","last_fullsized":"2024-09-15T22:52:28.811709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:12.861703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775650+0000","last_change":"2024-09-15T22:52:27.798045+0000","last_active":"2024-09-15T22:52:28.775650+0000","last_peered":"2024-09-15T22:52:28.775650+0000","last_clean":"2024-09-15T22:52:28.775650+0000","last_became_active":"2024-09-15T22:52:27.797650+0000","last_became_peered":"2024-09-15T22:52:27.797650+0000","last_unstale":"2024-09-15T22:52:28.775650+0000","last_undegraded":"2024-09-15T22:52:28.775650+0000","last_fullsized":"2024-09-15T22:52:28.775650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.679516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811586+0000","last_change":"2024-09-15T22:52:27.783418+0000","last_active":"2024-09-15T22:52:28.811586+0000","last_peered":"2024-09-15T22:52:28.811586+0000","last_clean":"2024-09-15T22:52:28.811586+0000","last_became_active":"2024-09-15T22:52:27.783140+0000","last_became_peered":"2024-09-15T22:52:27.783140+0000","last_unstale":"2024-09-15T22:52:28.811586+0000","last_undegraded":"2024-09-15T22:52:28.811586+0000","last_fullsized":"2024-09-15T22:52:28.811586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:03.929610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774820+0000","last_change":"2024-09-15T22:52:27.791140+0000","last_active":"2024-09-15T22:52:28.774820+0000","last_peered":"2024-09-15T22:52:28.774820+0000","last_clean":"2024-09-15T22:52:28.774820+0000","last_became_active":"2024-09-15T22:52:27.790782+0000","last_became_peered":"2024-09-15T22:52:27.790782+0000","last_unstale":"2024-09-15T22:52:28.774820+0000","last_undegraded":"2024-09-15T22:52:28.774820+0000","last_fullsized":"2024-09-15T22:52:28.774820+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:50.994864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042119+0000","last_change":"2024-09-15T22:52:27.793120+0000","last_active":"2024-09-15T22:52:30.042119+0000","last_peered":"2024-09-15T22:52:30.042119+0000","last_clean":"2024-09-15T22:52:30.042119+0000","last_became_active":"2024-09-15T22:52:27.792811+0000","last_became_peered":"2024-09-15T22:52:27.792811+0000","last_unstale":"2024-09-15T22:52:30.042119+0000","last_undegraded":"2024-09-15T22:52:30.042119+0000","last_fullsized":"2024-09-15T22:52:30.042119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:57.097296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775156+0000","last_change":"2024-09-15T22:52:27.791727+0000","last_active":"2024-09-15T22:52:28.775156+0000","last_peered":"2024-09-15T22:52:28.775156+0000","last_clean":"2024-09-15T22:52:28.775156+0000","last_became_active":"2024-09-15T22:52:27.791434+0000","last_became_peered":"2024-09-15T22:52:27.791434+0000","last_unstale":"2024-09-15T22:52:28.775156+0000","last_undegraded":"2024-09-15T22:52:28.775156+0000","last_fullsized":"2024-09-15T22:52:28.775156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:56.990877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394219+0000","last_change":"2024-09-15T22:52:27.795935+0000","last_active":"2024-09-15T22:52:29.394219+0000","last_peered":"2024-09-15T22:52:29.394219+0000","last_clean":"2024-09-15T22:52:29.394219+0000","last_became_active":"2024-09-15T22:52:27.795723+0000","last_became_peered":"2024-09-15T22:52:27.795723+0000","last_unstale":"2024-09-15T22:52:29.394219+0000","last_undegraded":"2024-09-15T22:52:29.394219+0000","last_fullsized":"2024-09-15T22:52:29.394219+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:42.740480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394763+0000","last_change":"2024-09-15T22:52:27.794942+0000","last_active":"2024-09-15T22:52:29.394763+0000","last_peered":"2024-09-15T22:52:29.394763+0000","last_clean":"2024-09-15T22:52:29.394763+0000","last_became_active":"2024-09-15T22:52:27.794648+0000","last_became_peered":"2024-09-15T22:52:27.794648+0000","last_unstale":"2024-09-15T22:52:29.394763+0000","last_undegraded":"2024-09-15T22:52:29.394763+0000","last_fullsized":"2024-09-15T22:52:29.394763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:22.592189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042297+0000","last_change":"2024-09-15T22:52:27.801182+0000","last_active":"2024-09-15T22:52:30.042297+0000","last_peered":"2024-09-15T22:52:30.042297+0000","last_clean":"2024-09-15T22:52:30.042297+0000","last_became_active":"2024-09-15T22:52:27.800782+0000","last_became_peered":"2024-09-15T22:52:27.800782+0000","last_unstale":"2024-09-15T22:52:30.042297+0000","last_undegraded":"2024-09-15T22:52:30.042297+0000","last_fullsized":"2024-09-15T22:52:30.042297+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:33.237804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.043047+0000","last_change":"2024-09-15T22:52:27.797989+0000","last_active":"2024-09-15T22:52:30.043047+0000","last_peered":"2024-09-15T22:52:30.043047+0000","last_clean":"2024-09-15T22:52:30.043047+0000","last_became_active":"2024-09-15T22:52:27.797672+0000","last_became_peered":"2024-09-15T22:52:27.797672+0000","last_unstale":"2024-09-15T22:52:30.043047+0000","last_undegraded":"2024-09-15T22:52:30.043047+0000","last_fullsized":"2024-09-15T22:52:30.043047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:02.888897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394650+0000","last_change":"2024-09-15T22:52:27.794531+0000","last_active":"2024-09-15T22:52:29.394650+0000","last_peered":"2024-09-15T22:52:29.394650+0000","last_clean":"2024-09-15T22:52:29.394650+0000","last_became_active":"2024-09-15T22:52:27.792373+0000","last_became_peered":"2024-09-15T22:52:27.792373+0000","last_unstale":"2024-09-15T22:52:29.394650+0000","last_undegraded":"2024-09-15T22:52:29.394650+0000","last_fullsized":"2024-09-15T22:52:29.394650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:10.650939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042016+0000","last_change":"2024-09-15T22:52:27.805541+0000","last_active":"2024-09-15T22:52:30.042016+0000","last_peered":"2024-09-15T22:52:30.042016+0000","last_clean":"2024-09-15T22:52:30.042016+0000","last_became_active":"2024-09-15T22:52:27.800858+0000","last_became_peered":"2024-09-15T22:52:27.800858+0000","last_unstale":"2024-09-15T22:52:30.042016+0000","last_undegraded":"2024-09-15T22:52:30.042016+0000","last_fullsized":"2024-09-15T22:52:30.042016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:28.472703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775544+0000","last_change":"2024-09-15T22:52:27.791086+0000","last_active":"2024-09-15T22:52:28.775544+0000","last_peered":"2024-09-15T22:52:28.775544+0000","last_clean":"2024-09-15T22:52:28.775544+0000","last_became_active":"2024-09-15T22:52:27.790818+0000","last_became_peered":"2024-09-15T22:52:27.790818+0000","last_unstale":"2024-09-15T22:52:28.775544+0000","last_undegraded":"2024-09-15T22:52:28.775544+0000","last_fullsized":"2024-09-15T22:52:28.775544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:17.926378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811383+0000","last_change":"2024-09-15T22:52:27.789666+0000","last_active":"2024-09-15T22:52:28.811383+0000","last_peered":"2024-09-15T22:52:28.811383+0000","last_clean":"2024-09-15T22:52:28.811383+0000","last_became_active":"2024-09-15T22:52:27.789330+0000","last_became_peered":"2024-09-15T22:52:27.789330+0000","last_unstale":"2024-09-15T22:52:28.811383+0000","last_undegraded":"2024-09-15T22:52:28.811383+0000","last_fullsized":"2024-09-15T22:52:28.811383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:16.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.041950+0000","last_change":"2024-09-15T22:52:27.789112+0000","last_active":"2024-09-15T22:52:30.041950+0000","last_peered":"2024-09-15T22:52:30.041950+0000","last_clean":"2024-09-15T22:52:30.041950+0000","last_became_active":"2024-09-15T22:52:27.788747+0000","last_became_peered":"2024-09-15T22:52:27.788747+0000","last_unstale":"2024-09-15T22:52:30.041950+0000","last_undegraded":"2024-09-15T22:52:30.041950+0000","last_fullsized":"2024-09-15T22:52:30.041950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.670087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776276+0000","last_change":"2024-09-15T22:52:27.802806+0000","last_active":"2024-09-15T22:52:28.776276+0000","last_peered":"2024-09-15T22:52:28.776276+0000","last_clean":"2024-09-15T22:52:28.776276+0000","last_became_active":"2024-09-15T22:52:27.802191+0000","last_became_peered":"2024-09-15T22:52:27.802191+0000","last_unstale":"2024-09-15T22:52:28.776276+0000","last_undegraded":"2024-09-15T22:52:28.776276+0000","last_fullsized":"2024-09-15T22:52:28.776276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:22.592189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811771+0000","last_change":"2024-09-15T22:52:27.781217+0000","last_active":"2024-09-15T22:52:28.811771+0000","last_peered":"2024-09-15T22:52:28.811771+0000","last_clean":"2024-09-15T22:52:28.811771+0000","last_became_active":"2024-09-15T22:52:27.780897+0000","last_became_peered":"2024-09-15T22:52:27.780897+0000","last_unstale":"2024-09-15T22:52:28.811771+0000","last_undegraded":"2024-09-15T22:52:28.811771+0000","last_fullsized":"2024-09-15T22:52:28.811771+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:09.097095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775778+0000","last_change":"2024-09-15T22:52:27.796077+0000","last_active":"2024-09-15T22:52:28.775778+0000","last_peered":"2024-09-15T22:52:28.775778+0000","last_clean":"2024-09-15T22:52:28.775778+0000","last_became_active":"2024-09-15T22:52:27.795790+0000","last_became_peered":"2024-09-15T22:52:27.795790+0000","last_unstale":"2024-09-15T22:52:28.775778+0000","last_undegraded":"2024-09-15T22:52:28.775778+0000","last_fullsized":"2024-09-15T22:52:28.775778+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:18.600022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042049+0000","last_change":"2024-09-15T22:52:27.797479+0000","last_active":"2024-09-15T22:52:30.042049+0000","last_peered":"2024-09-15T22:52:30.042049+0000","last_clean":"2024-09-15T22:52:30.042049+0000","last_became_active":"2024-09-15T22:52:27.797181+0000","last_became_peered":"2024-09-15T22:52:27.797181+0000","last_unstale":"2024-09-15T22:52:30.042049+0000","last_undegraded":"2024-09-15T22:52:30.042049+0000","last_fullsized":"2024-09-15T22:52:30.042049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:56.285322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042053+0000","last_change":"2024-09-15T22:52:27.792894+0000","last_active":"2024-09-15T22:52:30.042053+0000","last_peered":"2024-09-15T22:52:30.042053+0000","last_clean":"2024-09-15T22:52:30.042053+0000","last_became_active":"2024-09-15T22:52:27.792665+0000","last_became_peered":"2024-09-15T22:52:27.792665+0000","last_unstale":"2024-09-15T22:52:30.042053+0000","last_undegraded":"2024-09-15T22:52:30.042053+0000","last_fullsized":"2024-09-15T22:52:30.042053+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:50.994864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394222+0000","last_change":"2024-09-15T22:52:27.795302+0000","last_active":"2024-09-15T22:52:29.394222+0000","last_peered":"2024-09-15T22:52:29.394222+0000","last_clean":"2024-09-15T22:52:29.394222+0000","last_became_active":"2024-09-15T22:52:27.795062+0000","last_became_peered":"2024-09-15T22:52:27.795062+0000","last_unstale":"2024-09-15T22:52:29.394222+0000","last_undegraded":"2024-09-15T22:52:29.394222+0000","last_fullsized":"2024-09-15T22:52:29.394222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:09.063674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042846+0000","last_change":"2024-09-15T22:52:27.791114+0000","last_active":"2024-09-15T22:52:30.042846+0000","last_peered":"2024-09-15T22:52:30.042846+0000","last_clean":"2024-09-15T22:52:30.042846+0000","last_became_active":"2024-09-15T22:52:27.790846+0000","last_became_peered":"2024-09-15T22:52:27.790846+0000","last_unstale":"2024-09-15T22:52:30.042846+0000","last_undegraded":"2024-09-15T22:52:30.042846+0000","last_fullsized":"2024-09-15T22:52:30.042846+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:19.747851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775141+0000","last_change":"2024-09-15T22:52:27.802091+0000","last_active":"2024-09-15T22:52:28.775141+0000","last_peered":"2024-09-15T22:52:28.775141+0000","last_clean":"2024-09-15T22:52:28.775141+0000","last_became_active":"2024-09-15T22:52:27.798472+0000","last_became_peered":"2024-09-15T22:52:27.798472+0000","last_unstale":"2024-09-15T22:52:28.775141+0000","last_undegraded":"2024-09-15T22:52:28.775141+0000","last_fullsized":"2024-09-15T22:52:28.775141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:08.610651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776303+0000","last_change":"2024-09-15T22:52:27.796872+0000","last_active":"2024-09-15T22:52:28.776303+0000","last_peered":"2024-09-15T22:52:28.776303+0000","last_clean":"2024-09-15T22:52:28.776303+0000","last_became_active":"2024-09-15T22:52:27.796335+0000","last_became_peered":"2024-09-15T22:52:27.796335+0000","last_unstale":"2024-09-15T22:52:28.776303+0000","last_undegraded":"2024-09-15T22:52:28.776303+0000","last_fullsized":"2024-09-15T22:52:28.776303+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:50.540166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394434+0000","last_change":"2024-09-15T22:52:27.788713+0000","last_active":"2024-09-15T22:52:29.394434+0000","last_peered":"2024-09-15T22:52:29.394434+0000","last_clean":"2024-09-15T22:52:29.394434+0000","last_became_active":"2024-09-15T22:52:27.788420+0000","last_became_peered":"2024-09-15T22:52:27.788420+0000","last_unstale":"2024-09-15T22:52:29.394434+0000","last_undegraded":"2024-09-15T22:52:29.394434+0000","last_fullsized":"2024-09-15T22:52:29.394434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:18.600022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042297+0000","last_change":"2024-09-15T22:52:27.799848+0000","last_active":"2024-09-15T22:52:30.042297+0000","last_peered":"2024-09-15T22:52:30.042297+0000","last_clean":"2024-09-15T22:52:30.042297+0000","last_became_active":"2024-09-15T22:52:27.799244+0000","last_became_peered":"2024-09-15T22:52:27.799244+0000","last_unstale":"2024-09-15T22:52:30.042297+0000","last_undegraded":"2024-09-15T22:52:30.042297+0000","last_fullsized":"2024-09-15T22:52:30.042297+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:21.472206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042262+0000","last_change":"2024-09-15T22:52:27.797674+0000","last_active":"2024-09-15T22:52:30.042262+0000","last_peered":"2024-09-15T22:52:30.042262+0000","last_clean":"2024-09-15T22:52:30.042262+0000","last_became_active":"2024-09-15T22:52:27.797387+0000","last_became_peered":"2024-09-15T22:52:27.797387+0000","last_unstale":"2024-09-15T22:52:30.042262+0000","last_undegraded":"2024-09-15T22:52:30.042262+0000","last_fullsized":"2024-09-15T22:52:30.042262+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.670087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775835+0000","last_change":"2024-09-15T22:52:27.793315+0000","last_active":"2024-09-15T22:52:28.775835+0000","last_peered":"2024-09-15T22:52:28.775835+0000","last_clean":"2024-09-15T22:52:28.775835+0000","last_became_active":"2024-09-15T22:52:27.793042+0000","last_became_peered":"2024-09-15T22:52:27.793042+0000","last_unstale":"2024-09-15T22:52:28.775835+0000","last_undegraded":"2024-09-15T22:52:28.775835+0000","last_fullsized":"2024-09-15T22:52:28.775835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:18.207146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811463+0000","last_change":"2024-09-15T22:52:27.792803+0000","last_active":"2024-09-15T22:52:28.811463+0000","last_peered":"2024-09-15T22:52:28.811463+0000","last_clean":"2024-09-15T22:52:28.811463+0000","last_became_active":"2024-09-15T22:52:27.792541+0000","last_became_peered":"2024-09-15T22:52:27.792541+0000","last_unstale":"2024-09-15T22:52:28.811463+0000","last_undegraded":"2024-09-15T22:52:28.811463+0000","last_fullsized":"2024-09-15T22:52:28.811463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.377865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776098+0000","last_change":"2024-09-15T22:52:27.796747+0000","last_active":"2024-09-15T22:52:28.776098+0000","last_peered":"2024-09-15T22:52:28.776098+0000","last_clean":"2024-09-15T22:52:28.776098+0000","last_became_active":"2024-09-15T22:52:27.794078+0000","last_became_peered":"2024-09-15T22:52:27.794078+0000","last_unstale":"2024-09-15T22:52:28.776098+0000","last_undegraded":"2024-09-15T22:52:28.776098+0000","last_fullsized":"2024-09-15T22:52:28.776098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:10.650939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774314+0000","last_change":"2024-09-15T22:52:27.787936+0000","last_active":"2024-09-15T22:52:28.774314+0000","last_peered":"2024-09-15T22:52:28.774314+0000","last_clean":"2024-09-15T22:52:28.774314+0000","last_became_active":"2024-09-15T22:52:27.787502+0000","last_became_peered":"2024-09-15T22:52:27.787502+0000","last_unstale":"2024-09-15T22:52:28.774314+0000","last_undegraded":"2024-09-15T22:52:28.774314+0000","last_fullsized":"2024-09-15T22:52:28.774314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:33.280008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811216+0000","last_change":"2024-09-15T22:52:27.781962+0000","last_active":"2024-09-15T22:52:28.811216+0000","last_peered":"2024-09-15T22:52:28.811216+0000","last_clean":"2024-09-15T22:52:28.811216+0000","last_became_active":"2024-09-15T22:52:27.781683+0000","last_became_peered":"2024-09-15T22:52:27.781683+0000","last_unstale":"2024-09-15T22:52:28.811216+0000","last_undegraded":"2024-09-15T22:52:28.811216+0000","last_fullsized":"2024-09-15T22:52:28.811216+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:33.237804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042264+0000","last_change":"2024-09-15T22:52:26.772720+0000","last_active":"2024-09-15T22:52:30.042264+0000","last_peered":"2024-09-15T22:52:30.042264+0000","last_clean":"2024-09-15T22:52:30.042264+0000","last_became_active":"2024-09-15T22:52:26.772441+0000","last_became_peered":"2024-09-15T22:52:26.772441+0000","last_unstale":"2024-09-15T22:52:30.042264+0000","last_undegraded":"2024-09-15T22:52:30.042264+0000","last_fullsized":"2024-09-15T22:52:30.042264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774621+0000","last_change":"2024-09-15T22:52:27.785002+0000","last_active":"2024-09-15T22:52:28.774621+0000","last_peered":"2024-09-15T22:52:28.774621+0000","last_clean":"2024-09-15T22:52:28.774621+0000","last_became_active":"2024-09-15T22:52:27.784697+0000","last_became_peered":"2024-09-15T22:52:27.784697+0000","last_unstale":"2024-09-15T22:52:28.774621+0000","last_undegraded":"2024-09-15T22:52:28.774621+0000","last_fullsized":"2024-09-15T22:52:28.774621+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:26.803442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042403+0000","last_change":"2024-09-15T22:52:26.770807+0000","last_active":"2024-09-15T22:52:30.042403+0000","last_peered":"2024-09-15T22:52:30.042403+0000","last_clean":"2024-09-15T22:52:30.042403+0000","last_became_active":"2024-09-15T22:52:26.770528+0000","last_became_peered":"2024-09-15T22:52:26.770528+0000","last_unstale":"2024-09-15T22:52:30.042403+0000","last_undegraded":"2024-09-15T22:52:30.042403+0000","last_fullsized":"2024-09-15T22:52:30.042403+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042130+0000","last_change":"2024-09-15T22:52:27.791839+0000","last_active":"2024-09-15T22:52:30.042130+0000","last_peered":"2024-09-15T22:52:30.042130+0000","last_clean":"2024-09-15T22:52:30.042130+0000","last_became_active":"2024-09-15T22:52:27.791498+0000","last_became_peered":"2024-09-15T22:52:27.791498+0000","last_unstale":"2024-09-15T22:52:30.042130+0000","last_undegraded":"2024-09-15T22:52:30.042130+0000","last_fullsized":"2024-09-15T22:52:30.042130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:25.083930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042298+0000","last_change":"2024-09-15T22:52:26.773486+0000","last_active":"2024-09-15T22:52:30.042298+0000","last_peered":"2024-09-15T22:52:30.042298+0000","last_clean":"2024-09-15T22:52:30.042298+0000","last_became_active":"2024-09-15T22:52:26.772513+0000","last_became_peered":"2024-09-15T22:52:26.772513+0000","last_unstale":"2024-09-15T22:52:30.042298+0000","last_undegraded":"2024-09-15T22:52:30.042298+0000","last_fullsized":"2024-09-15T22:52:30.042298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394382+0000","last_change":"2024-09-15T22:52:27.794635+0000","last_active":"2024-09-15T22:52:29.394382+0000","last_peered":"2024-09-15T22:52:29.394382+0000","last_clean":"2024-09-15T22:52:29.394382+0000","last_became_active":"2024-09-15T22:52:27.794107+0000","last_became_peered":"2024-09-15T22:52:27.794107+0000","last_unstale":"2024-09-15T22:52:29.394382+0000","last_undegraded":"2024-09-15T22:52:29.394382+0000","last_fullsized":"2024-09-15T22:52:29.394382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.948512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774829+0000","last_change":"2024-09-15T22:52:26.778209+0000","last_active":"2024-09-15T22:52:28.774829+0000","last_peered":"2024-09-15T22:52:28.774829+0000","last_clean":"2024-09-15T22:52:28.774829+0000","last_became_active":"2024-09-15T22:52:26.777455+0000","last_became_peered":"2024-09-15T22:52:26.777455+0000","last_unstale":"2024-09-15T22:52:28.774829+0000","last_undegraded":"2024-09-15T22:52:28.774829+0000","last_fullsized":"2024-09-15T22:52:28.774829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:41.156426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774557+0000","last_change":"2024-09-15T22:52:27.797062+0000","last_active":"2024-09-15T22:52:28.774557+0000","last_peered":"2024-09-15T22:52:28.774557+0000","last_clean":"2024-09-15T22:52:28.774557+0000","last_became_active":"2024-09-15T22:52:27.796745+0000","last_became_peered":"2024-09-15T22:52:27.796745+0000","last_unstale":"2024-09-15T22:52:28.774557+0000","last_undegraded":"2024-09-15T22:52:28.774557+0000","last_fullsized":"2024-09-15T22:52:28.774557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:56.285322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775941+0000","last_change":"2024-09-15T22:52:26.787726+0000","last_active":"2024-09-15T22:52:28.775941+0000","last_peered":"2024-09-15T22:52:28.775941+0000","last_clean":"2024-09-15T22:52:28.775941+0000","last_became_active":"2024-09-15T22:52:26.787211+0000","last_became_peered":"2024-09-15T22:52:26.787211+0000","last_unstale":"2024-09-15T22:52:28.775941+0000","last_undegraded":"2024-09-15T22:52:28.775941+0000","last_fullsized":"2024-09-15T22:52:28.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:55.278578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811510+0000","last_change":"2024-09-15T22:52:27.793838+0000","last_active":"2024-09-15T22:52:28.811510+0000","last_peered":"2024-09-15T22:52:28.811510+0000","last_clean":"2024-09-15T22:52:28.811510+0000","last_became_active":"2024-09-15T22:52:27.793337+0000","last_became_peered":"2024-09-15T22:52:27.793337+0000","last_unstale":"2024-09-15T22:52:28.811510+0000","last_undegraded":"2024-09-15T22:52:28.811510+0000","last_fullsized":"2024-09-15T22:52:28.811510+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:33.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774992+0000","last_change":"2024-09-15T22:52:26.774282+0000","last_active":"2024-09-15T22:52:28.774992+0000","last_peered":"2024-09-15T22:52:28.774992+0000","last_clean":"2024-09-15T22:52:28.774992+0000","last_became_active":"2024-09-15T22:52:26.773963+0000","last_became_peered":"2024-09-15T22:52:26.773963+0000","last_unstale":"2024-09-15T22:52:28.774992+0000","last_undegraded":"2024-09-15T22:52:28.774992+0000","last_fullsized":"2024-09-15T22:52:28.774992+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394596+0000","last_change":"2024-09-15T22:52:27.788659+0000","last_active":"2024-09-15T22:52:29.394596+0000","last_peered":"2024-09-15T22:52:29.394596+0000","last_clean":"2024-09-15T22:52:29.394596+0000","last_became_active":"2024-09-15T22:52:27.788368+0000","last_became_peered":"2024-09-15T22:52:27.788368+0000","last_unstale":"2024-09-15T22:52:29.394596+0000","last_undegraded":"2024-09-15T22:52:29.394596+0000","last_fullsized":"2024-09-15T22:52:29.394596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.345714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.041935+0000","last_change":"2024-09-15T22:52:26.768480+0000","last_active":"2024-09-15T22:52:30.041935+0000","last_peered":"2024-09-15T22:52:30.041935+0000","last_clean":"2024-09-15T22:52:30.041935+0000","last_became_active":"2024-09-15T22:52:26.768185+0000","last_became_peered":"2024-09-15T22:52:26.768185+0000","last_unstale":"2024-09-15T22:52:30.041935+0000","last_undegraded":"2024-09-15T22:52:30.041935+0000","last_fullsized":"2024-09-15T22:52:30.041935+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:19.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811720+0000","last_change":"2024-09-15T22:52:27.794119+0000","last_active":"2024-09-15T22:52:28.811720+0000","last_peered":"2024-09-15T22:52:28.811720+0000","last_clean":"2024-09-15T22:52:28.811720+0000","last_became_active":"2024-09-15T22:52:27.793899+0000","last_became_peered":"2024-09-15T22:52:27.793899+0000","last_unstale":"2024-09-15T22:52:28.811720+0000","last_undegraded":"2024-09-15T22:52:28.811720+0000","last_fullsized":"2024-09-15T22:52:28.811720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:02.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775965+0000","last_change":"2024-09-15T22:52:26.777737+0000","last_active":"2024-09-15T22:52:28.775965+0000","last_peered":"2024-09-15T22:52:28.775965+0000","last_clean":"2024-09-15T22:52:28.775965+0000","last_became_active":"2024-09-15T22:52:26.777440+0000","last_became_peered":"2024-09-15T22:52:26.777440+0000","last_unstale":"2024-09-15T22:52:28.775965+0000","last_undegraded":"2024-09-15T22:52:28.775965+0000","last_fullsized":"2024-09-15T22:52:28.775965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:10.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774114+0000","last_change":"2024-09-15T22:52:27.794940+0000","last_active":"2024-09-15T22:52:28.774114+0000","last_peered":"2024-09-15T22:52:28.774114+0000","last_clean":"2024-09-15T22:52:28.774114+0000","last_became_active":"2024-09-15T22:52:27.794675+0000","last_became_peered":"2024-09-15T22:52:27.794675+0000","last_unstale":"2024-09-15T22:52:28.774114+0000","last_undegraded":"2024-09-15T22:52:28.774114+0000","last_fullsized":"2024-09-15T22:52:28.774114+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:18.799306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811726+0000","last_change":"2024-09-15T22:52:26.778968+0000","last_active":"2024-09-15T22:52:28.811726+0000","last_peered":"2024-09-15T22:52:28.811726+0000","last_clean":"2024-09-15T22:52:28.811726+0000","last_became_active":"2024-09-15T22:52:26.778702+0000","last_became_peered":"2024-09-15T22:52:26.778702+0000","last_unstale":"2024-09-15T22:52:28.811726+0000","last_undegraded":"2024-09-15T22:52:28.811726+0000","last_fullsized":"2024-09-15T22:52:28.811726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:05.630852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774451+0000","last_change":"2024-09-15T22:52:27.788001+0000","last_active":"2024-09-15T22:52:28.774451+0000","last_peered":"2024-09-15T22:52:28.774451+0000","last_clean":"2024-09-15T22:52:28.774451+0000","last_became_active":"2024-09-15T22:52:27.787715+0000","last_became_peered":"2024-09-15T22:52:27.787715+0000","last_unstale":"2024-09-15T22:52:28.774451+0000","last_undegraded":"2024-09-15T22:52:28.774451+0000","last_fullsized":"2024-09-15T22:52:28.774451+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:09.081809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774588+0000","last_change":"2024-09-15T22:52:26.780780+0000","last_active":"2024-09-15T22:52:28.774588+0000","last_peered":"2024-09-15T22:52:28.774588+0000","last_clean":"2024-09-15T22:52:28.774588+0000","last_became_active":"2024-09-15T22:52:26.780462+0000","last_became_peered":"2024-09-15T22:52:26.780462+0000","last_unstale":"2024-09-15T22:52:28.774588+0000","last_undegraded":"2024-09-15T22:52:28.774588+0000","last_fullsized":"2024-09-15T22:52:28.774588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775673+0000","last_change":"2024-09-15T22:52:27.793219+0000","last_active":"2024-09-15T22:52:28.775673+0000","last_peered":"2024-09-15T22:52:28.775673+0000","last_clean":"2024-09-15T22:52:28.775673+0000","last_became_active":"2024-09-15T22:52:27.792908+0000","last_became_peered":"2024-09-15T22:52:27.792908+0000","last_unstale":"2024-09-15T22:52:28.775673+0000","last_undegraded":"2024-09-15T22:52:28.775673+0000","last_fullsized":"2024-09-15T22:52:28.775673+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.948512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811605+0000","last_change":"2024-09-15T22:52:26.782632+0000","last_active":"2024-09-15T22:52:28.811605+0000","last_peered":"2024-09-15T22:52:28.811605+0000","last_clean":"2024-09-15T22:52:28.811605+0000","last_became_active":"2024-09-15T22:52:26.782353+0000","last_became_peered":"2024-09-15T22:52:26.782353+0000","last_unstale":"2024-09-15T22:52:28.811605+0000","last_undegraded":"2024-09-15T22:52:28.811605+0000","last_fullsized":"2024-09-15T22:52:28.811605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:17.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774844+0000","last_change":"2024-09-15T22:52:27.799501+0000","last_active":"2024-09-15T22:52:28.774844+0000","last_peered":"2024-09-15T22:52:28.774844+0000","last_clean":"2024-09-15T22:52:28.774844+0000","last_became_active":"2024-09-15T22:52:27.799215+0000","last_became_peered":"2024-09-15T22:52:27.799215+0000","last_unstale":"2024-09-15T22:52:28.774844+0000","last_undegraded":"2024-09-15T22:52:28.774844+0000","last_fullsized":"2024-09-15T22:52:28.774844+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:06.637596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394761+0000","last_change":"2024-09-15T22:52:26.786171+0000","last_active":"2024-09-15T22:52:29.394761+0000","last_peered":"2024-09-15T22:52:29.394761+0000","last_clean":"2024-09-15T22:52:29.394761+0000","last_became_active":"2024-09-15T22:52:26.785571+0000","last_became_peered":"2024-09-15T22:52:26.785571+0000","last_unstale":"2024-09-15T22:52:29.394761+0000","last_undegraded":"2024-09-15T22:52:29.394761+0000","last_fullsized":"2024-09-15T22:52:29.394761+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:20.490638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774763+0000","last_change":"2024-09-15T22:52:27.785105+0000","last_active":"2024-09-15T22:52:28.774763+0000","last_peered":"2024-09-15T22:52:28.774763+0000","last_clean":"2024-09-15T22:52:28.774763+0000","last_became_active":"2024-09-15T22:52:27.784547+0000","last_became_peered":"2024-09-15T22:52:27.784547+0000","last_unstale":"2024-09-15T22:52:28.774763+0000","last_undegraded":"2024-09-15T22:52:28.774763+0000","last_fullsized":"2024-09-15T22:52:28.774763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:41.315752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776059+0000","last_change":"2024-09-15T22:52:26.780713+0000","last_active":"2024-09-15T22:52:28.776059+0000","last_peered":"2024-09-15T22:52:28.776059+0000","last_clean":"2024-09-15T22:52:28.776059+0000","last_became_active":"2024-09-15T22:52:26.780398+0000","last_became_peered":"2024-09-15T22:52:26.780398+0000","last_unstale":"2024-09-15T22:52:28.776059+0000","last_undegraded":"2024-09-15T22:52:28.776059+0000","last_fullsized":"2024-09-15T22:52:28.776059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:49.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775940+0000","last_change":"2024-09-15T22:52:27.793814+0000","last_active":"2024-09-15T22:52:28.775940+0000","last_peered":"2024-09-15T22:52:28.775940+0000","last_clean":"2024-09-15T22:52:28.775940+0000","last_became_active":"2024-09-15T22:52:27.792443+0000","last_became_peered":"2024-09-15T22:52:27.792443+0000","last_unstale":"2024-09-15T22:52:28.775940+0000","last_undegraded":"2024-09-15T22:52:28.775940+0000","last_fullsized":"2024-09-15T22:52:28.775940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.345714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042046+0000","last_change":"2024-09-15T22:52:26.781376+0000","last_active":"2024-09-15T22:52:30.042046+0000","last_peered":"2024-09-15T22:52:30.042046+0000","last_clean":"2024-09-15T22:52:30.042046+0000","last_became_active":"2024-09-15T22:52:26.781061+0000","last_became_peered":"2024-09-15T22:52:26.781061+0000","last_unstale":"2024-09-15T22:52:30.042046+0000","last_undegraded":"2024-09-15T22:52:30.042046+0000","last_fullsized":"2024-09-15T22:52:30.042046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:21.490593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394595+0000","last_change":"2024-09-15T22:52:27.786176+0000","last_active":"2024-09-15T22:52:29.394595+0000","last_peered":"2024-09-15T22:52:29.394595+0000","last_clean":"2024-09-15T22:52:29.394595+0000","last_became_active":"2024-09-15T22:52:27.785882+0000","last_became_peered":"2024-09-15T22:52:27.785882+0000","last_unstale":"2024-09-15T22:52:29.394595+0000","last_undegraded":"2024-09-15T22:52:29.394595+0000","last_fullsized":"2024-09-15T22:52:29.394595+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:18.207146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811388+0000","last_change":"2024-09-15T22:52:26.775790+0000","last_active":"2024-09-15T22:52:28.811388+0000","last_peered":"2024-09-15T22:52:28.811388+0000","last_clean":"2024-09-15T22:52:28.811388+0000","last_became_active":"2024-09-15T22:52:26.775518+0000","last_became_peered":"2024-09-15T22:52:26.775518+0000","last_unstale":"2024-09-15T22:52:28.811388+0000","last_undegraded":"2024-09-15T22:52:28.811388+0000","last_fullsized":"2024-09-15T22:52:28.811388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:49.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776164+0000","last_change":"2024-09-15T22:52:27.802576+0000","last_active":"2024-09-15T22:52:28.776164+0000","last_peered":"2024-09-15T22:52:28.776164+0000","last_clean":"2024-09-15T22:52:28.776164+0000","last_became_active":"2024-09-15T22:52:27.801548+0000","last_became_peered":"2024-09-15T22:52:27.801548+0000","last_unstale":"2024-09-15T22:52:28.776164+0000","last_undegraded":"2024-09-15T22:52:28.776164+0000","last_fullsized":"2024-09-15T22:52:28.776164+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:47.744099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394351+0000","last_change":"2024-09-15T22:52:26.779791+0000","last_active":"2024-09-15T22:52:29.394351+0000","last_peered":"2024-09-15T22:52:29.394351+0000","last_clean":"2024-09-15T22:52:29.394351+0000","last_became_active":"2024-09-15T22:52:26.779443+0000","last_became_peered":"2024-09-15T22:52:26.779443+0000","last_unstale":"2024-09-15T22:52:29.394351+0000","last_undegraded":"2024-09-15T22:52:29.394351+0000","last_fullsized":"2024-09-15T22:52:29.394351+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:27.465959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394247+0000","last_change":"2024-09-15T22:52:27.788071+0000","last_active":"2024-09-15T22:52:29.394247+0000","last_peered":"2024-09-15T22:52:29.394247+0000","last_clean":"2024-09-15T22:52:29.394247+0000","last_became_active":"2024-09-15T22:52:27.787743+0000","last_became_peered":"2024-09-15T22:52:27.787743+0000","last_unstale":"2024-09-15T22:52:29.394247+0000","last_undegraded":"2024-09-15T22:52:29.394247+0000","last_fullsized":"2024-09-15T22:52:29.394247+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:17.926378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776376+0000","last_change":"2024-09-15T22:52:26.781735+0000","last_active":"2024-09-15T22:52:28.776376+0000","last_peered":"2024-09-15T22:52:28.776376+0000","last_clean":"2024-09-15T22:52:28.776376+0000","last_became_active":"2024-09-15T22:52:26.781416+0000","last_became_peered":"2024-09-15T22:52:26.781416+0000","last_unstale":"2024-09-15T22:52:28.776376+0000","last_undegraded":"2024-09-15T22:52:28.776376+0000","last_fullsized":"2024-09-15T22:52:28.776376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:05.630852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042516+0000","last_change":"2024-09-15T22:52:27.807225+0000","last_active":"2024-09-15T22:52:30.042516+0000","last_peered":"2024-09-15T22:52:30.042516+0000","last_clean":"2024-09-15T22:52:30.042516+0000","last_became_active":"2024-09-15T22:52:27.805803+0000","last_became_peered":"2024-09-15T22:52:27.805803+0000","last_unstale":"2024-09-15T22:52:30.042516+0000","last_undegraded":"2024-09-15T22:52:30.042516+0000","last_fullsized":"2024-09-15T22:52:30.042516+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:33.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.043185+0000","last_change":"2024-09-15T22:52:26.770355+0000","last_active":"2024-09-15T22:52:30.043185+0000","last_peered":"2024-09-15T22:52:30.043185+0000","last_clean":"2024-09-15T22:52:30.043185+0000","last_became_active":"2024-09-15T22:52:26.770075+0000","last_became_peered":"2024-09-15T22:52:26.770075+0000","last_unstale":"2024-09-15T22:52:30.043185+0000","last_undegraded":"2024-09-15T22:52:30.043185+0000","last_fullsized":"2024-09-15T22:52:30.043185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:52.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774925+0000","last_change":"2024-09-15T22:52:27.794887+0000","last_active":"2024-09-15T22:52:28.774925+0000","last_peered":"2024-09-15T22:52:28.774925+0000","last_clean":"2024-09-15T22:52:28.774925+0000","last_became_active":"2024-09-15T22:52:27.794581+0000","last_became_peered":"2024-09-15T22:52:27.794581+0000","last_unstale":"2024-09-15T22:52:28.774925+0000","last_undegraded":"2024-09-15T22:52:28.774925+0000","last_fullsized":"2024-09-15T22:52:28.774925+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:25.083930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042182+0000","last_change":"2024-09-15T22:52:26.783446+0000","last_active":"2024-09-15T22:52:30.042182+0000","last_peered":"2024-09-15T22:52:30.042182+0000","last_clean":"2024-09-15T22:52:30.042182+0000","last_became_active":"2024-09-15T22:52:26.783152+0000","last_became_peered":"2024-09-15T22:52:26.783152+0000","last_unstale":"2024-09-15T22:52:30.042182+0000","last_undegraded":"2024-09-15T22:52:30.042182+0000","last_fullsized":"2024-09-15T22:52:30.042182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:08.185195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042009+0000","last_change":"2024-09-15T22:52:27.804090+0000","last_active":"2024-09-15T22:52:30.042009+0000","last_peered":"2024-09-15T22:52:30.042009+0000","last_clean":"2024-09-15T22:52:30.042009+0000","last_became_active":"2024-09-15T22:52:27.803819+0000","last_became_peered":"2024-09-15T22:52:27.803819+0000","last_unstale":"2024-09-15T22:52:30.042009+0000","last_undegraded":"2024-09-15T22:52:30.042009+0000","last_fullsized":"2024-09-15T22:52:30.042009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:55.424282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042204+0000","last_change":"2024-09-15T22:52:26.776288+0000","last_active":"2024-09-15T22:52:30.042204+0000","last_peered":"2024-09-15T22:52:30.042204+0000","last_clean":"2024-09-15T22:52:30.042204+0000","last_became_active":"2024-09-15T22:52:26.776017+0000","last_became_peered":"2024-09-15T22:52:26.776017+0000","last_unstale":"2024-09-15T22:52:30.042204+0000","last_undegraded":"2024-09-15T22:52:30.042204+0000","last_fullsized":"2024-09-15T22:52:30.042204+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774823+0000","last_change":"2024-09-15T22:52:27.792806+0000","last_active":"2024-09-15T22:52:28.774823+0000","last_peered":"2024-09-15T22:52:28.774823+0000","last_clean":"2024-09-15T22:52:28.774823+0000","last_became_active":"2024-09-15T22:52:27.792486+0000","last_became_peered":"2024-09-15T22:52:27.792486+0000","last_unstale":"2024-09-15T22:52:28.774823+0000","last_undegraded":"2024-09-15T22:52:28.774823+0000","last_fullsized":"2024-09-15T22:52:28.774823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:07.890838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042122+0000","last_change":"2024-09-15T22:52:26.766560+0000","last_active":"2024-09-15T22:52:30.042122+0000","last_peered":"2024-09-15T22:52:30.042122+0000","last_clean":"2024-09-15T22:52:30.042122+0000","last_became_active":"2024-09-15T22:52:26.766149+0000","last_became_peered":"2024-09-15T22:52:26.766149+0000","last_unstale":"2024-09-15T22:52:30.042122+0000","last_undegraded":"2024-09-15T22:52:30.042122+0000","last_fullsized":"2024-09-15T22:52:30.042122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042249+0000","last_change":"2024-09-15T22:52:27.792096+0000","last_active":"2024-09-15T22:52:30.042249+0000","last_peered":"2024-09-15T22:52:30.042249+0000","last_clean":"2024-09-15T22:52:30.042249+0000","last_became_active":"2024-09-15T22:52:27.789084+0000","last_became_peered":"2024-09-15T22:52:27.789084+0000","last_unstale":"2024-09-15T22:52:30.042249+0000","last_undegraded":"2024-09-15T22:52:30.042249+0000","last_fullsized":"2024-09-15T22:52:30.042249+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:01.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394121+0000","last_change":"2024-09-15T22:52:26.785913+0000","last_active":"2024-09-15T22:52:29.394121+0000","last_peered":"2024-09-15T22:52:29.394121+0000","last_clean":"2024-09-15T22:52:29.394121+0000","last_became_active":"2024-09-15T22:52:26.785607+0000","last_became_peered":"2024-09-15T22:52:26.785607+0000","last_unstale":"2024-09-15T22:52:29.394121+0000","last_undegraded":"2024-09-15T22:52:29.394121+0000","last_fullsized":"2024-09-15T22:52:29.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:57.663343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775458+0000","last_change":"2024-09-15T22:52:27.792668+0000","last_active":"2024-09-15T22:52:28.775458+0000","last_peered":"2024-09-15T22:52:28.775458+0000","last_clean":"2024-09-15T22:52:28.775458+0000","last_became_active":"2024-09-15T22:52:27.792373+0000","last_became_peered":"2024-09-15T22:52:27.792373+0000","last_unstale":"2024-09-15T22:52:28.775458+0000","last_undegraded":"2024-09-15T22:52:28.775458+0000","last_fullsized":"2024-09-15T22:52:28.775458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:09.063674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775262+0000","last_change":"2024-09-15T22:52:26.783189+0000","last_active":"2024-09-15T22:52:28.775262+0000","last_peered":"2024-09-15T22:52:28.775262+0000","last_clean":"2024-09-15T22:52:28.775262+0000","last_became_active":"2024-09-15T22:52:26.782869+0000","last_became_peered":"2024-09-15T22:52:26.782869+0000","last_unstale":"2024-09-15T22:52:28.775262+0000","last_undegraded":"2024-09-15T22:52:28.775262+0000","last_fullsized":"2024-09-15T22:52:28.775262+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:16.138827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042456+0000","last_change":"2024-09-15T22:52:27.795822+0000","last_active":"2024-09-15T22:52:30.042456+0000","last_peered":"2024-09-15T22:52:30.042456+0000","last_clean":"2024-09-15T22:52:30.042456+0000","last_became_active":"2024-09-15T22:52:27.795555+0000","last_became_peered":"2024-09-15T22:52:27.795555+0000","last_unstale":"2024-09-15T22:52:30.042456+0000","last_undegraded":"2024-09-15T22:52:30.042456+0000","last_fullsized":"2024-09-15T22:52:30.042456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.377865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042517+0000","last_change":"2024-09-15T22:52:26.782756+0000","last_active":"2024-09-15T22:52:30.042517+0000","last_peered":"2024-09-15T22:52:30.042517+0000","last_clean":"2024-09-15T22:52:30.042517+0000","last_became_active":"2024-09-15T22:52:26.782480+0000","last_became_peered":"2024-09-15T22:52:26.782480+0000","last_unstale":"2024-09-15T22:52:30.042517+0000","last_undegraded":"2024-09-15T22:52:30.042517+0000","last_fullsized":"2024-09-15T22:52:30.042517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:56.081977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774485+0000","last_change":"2024-09-15T22:52:27.784266+0000","last_active":"2024-09-15T22:52:28.774485+0000","last_peered":"2024-09-15T22:52:28.774485+0000","last_clean":"2024-09-15T22:52:28.774485+0000","last_became_active":"2024-09-15T22:52:27.783953+0000","last_became_peered":"2024-09-15T22:52:27.783953+0000","last_unstale":"2024-09-15T22:52:28.774485+0000","last_undegraded":"2024-09-15T22:52:28.774485+0000","last_fullsized":"2024-09-15T22:52:28.774485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:48.069621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042267+0000","last_change":"2024-09-15T22:52:26.782664+0000","last_active":"2024-09-15T22:52:30.042267+0000","last_peered":"2024-09-15T22:52:30.042267+0000","last_clean":"2024-09-15T22:52:30.042267+0000","last_became_active":"2024-09-15T22:52:26.782410+0000","last_became_peered":"2024-09-15T22:52:26.782410+0000","last_unstale":"2024-09-15T22:52:30.042267+0000","last_undegraded":"2024-09-15T22:52:30.042267+0000","last_fullsized":"2024-09-15T22:52:30.042267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042271+0000","last_change":"2024-09-15T22:52:27.790909+0000","last_active":"2024-09-15T22:52:30.042271+0000","last_peered":"2024-09-15T22:52:30.042271+0000","last_clean":"2024-09-15T22:52:30.042271+0000","last_became_active":"2024-09-15T22:52:27.790493+0000","last_became_peered":"2024-09-15T22:52:27.790493+0000","last_unstale":"2024-09-15T22:52:30.042271+0000","last_undegraded":"2024-09-15T22:52:30.042271+0000","last_fullsized":"2024-09-15T22:52:30.042271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:21.497383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811667+0000","last_change":"2024-09-15T22:52:26.784628+0000","last_active":"2024-09-15T22:52:28.811667+0000","last_peered":"2024-09-15T22:52:28.811667+0000","last_clean":"2024-09-15T22:52:28.811667+0000","last_became_active":"2024-09-15T22:52:26.784293+0000","last_became_peered":"2024-09-15T22:52:26.784293+0000","last_unstale":"2024-09-15T22:52:28.811667+0000","last_undegraded":"2024-09-15T22:52:28.811667+0000","last_fullsized":"2024-09-15T22:52:28.811667+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:55.278578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394287+0000","last_change":"2024-09-15T22:52:27.789808+0000","last_active":"2024-09-15T22:52:29.394287+0000","last_peered":"2024-09-15T22:52:29.394287+0000","last_clean":"2024-09-15T22:52:29.394287+0000","last_became_active":"2024-09-15T22:52:27.789518+0000","last_became_peered":"2024-09-15T22:52:27.789518+0000","last_unstale":"2024-09-15T22:52:29.394287+0000","last_undegraded":"2024-09-15T22:52:29.394287+0000","last_fullsized":"2024-09-15T22:52:29.394287+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.679516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775420+0000","last_change":"2024-09-15T22:52:26.779223+0000","last_active":"2024-09-15T22:52:28.775420+0000","last_peered":"2024-09-15T22:52:28.775420+0000","last_clean":"2024-09-15T22:52:28.775420+0000","last_became_active":"2024-09-15T22:52:26.778968+0000","last_became_peered":"2024-09-15T22:52:26.778968+0000","last_unstale":"2024-09-15T22:52:28.775420+0000","last_undegraded":"2024-09-15T22:52:28.775420+0000","last_fullsized":"2024-09-15T22:52:28.775420+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:17.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775327+0000","last_change":"2024-09-15T22:52:27.800877+0000","last_active":"2024-09-15T22:52:28.775327+0000","last_peered":"2024-09-15T22:52:28.775327+0000","last_clean":"2024-09-15T22:52:28.775327+0000","last_became_active":"2024-09-15T22:52:27.800619+0000","last_became_peered":"2024-09-15T22:52:27.800619+0000","last_unstale":"2024-09-15T22:52:28.775327+0000","last_undegraded":"2024-09-15T22:52:28.775327+0000","last_fullsized":"2024-09-15T22:52:28.775327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:51.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394413+0000","last_change":"2024-09-15T22:52:26.781554+0000","last_active":"2024-09-15T22:52:29.394413+0000","last_peered":"2024-09-15T22:52:29.394413+0000","last_clean":"2024-09-15T22:52:29.394413+0000","last_became_active":"2024-09-15T22:52:26.779958+0000","last_became_peered":"2024-09-15T22:52:26.779958+0000","last_unstale":"2024-09-15T22:52:29.394413+0000","last_undegraded":"2024-09-15T22:52:29.394413+0000","last_fullsized":"2024-09-15T22:52:29.394413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:56.090551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774289+0000","last_change":"2024-09-15T22:52:27.783986+0000","last_active":"2024-09-15T22:52:28.774289+0000","last_peered":"2024-09-15T22:52:28.774289+0000","last_clean":"2024-09-15T22:52:28.774289+0000","last_became_active":"2024-09-15T22:52:27.783510+0000","last_became_peered":"2024-09-15T22:52:27.783510+0000","last_unstale":"2024-09-15T22:52:28.774289+0000","last_undegraded":"2024-09-15T22:52:28.774289+0000","last_fullsized":"2024-09-15T22:52:28.774289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:16.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394229+0000","last_change":"2024-09-15T22:52:26.768445+0000","last_active":"2024-09-15T22:52:29.394229+0000","last_peered":"2024-09-15T22:52:29.394229+0000","last_clean":"2024-09-15T22:52:29.394229+0000","last_became_active":"2024-09-15T22:52:26.768104+0000","last_became_peered":"2024-09-15T22:52:26.768104+0000","last_unstale":"2024-09-15T22:52:29.394229+0000","last_undegraded":"2024-09-15T22:52:29.394229+0000","last_fullsized":"2024-09-15T22:52:29.394229+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:54.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775395+0000","last_change":"2024-09-15T22:52:27.797942+0000","last_active":"2024-09-15T22:52:28.775395+0000","last_peered":"2024-09-15T22:52:28.775395+0000","last_clean":"2024-09-15T22:52:28.775395+0000","last_became_active":"2024-09-15T22:52:27.797498+0000","last_became_peered":"2024-09-15T22:52:27.797498+0000","last_unstale":"2024-09-15T22:52:28.775395+0000","last_undegraded":"2024-09-15T22:52:28.775395+0000","last_fullsized":"2024-09-15T22:52:28.775395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:42.740480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774181+0000","last_change":"2024-09-15T22:52:26.775042+0000","last_active":"2024-09-15T22:52:28.774181+0000","last_peered":"2024-09-15T22:52:28.774181+0000","last_clean":"2024-09-15T22:52:28.774181+0000","last_became_active":"2024-09-15T22:52:26.772282+0000","last_became_peered":"2024-09-15T22:52:26.772282+0000","last_unstale":"2024-09-15T22:52:28.774181+0000","last_undegraded":"2024-09-15T22:52:28.774181+0000","last_fullsized":"2024-09-15T22:52:28.774181+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394746+0000","last_change":"2024-09-15T22:52:27.787993+0000","last_active":"2024-09-15T22:52:29.394746+0000","last_peered":"2024-09-15T22:52:29.394746+0000","last_clean":"2024-09-15T22:52:29.394746+0000","last_became_active":"2024-09-15T22:52:27.787665+0000","last_became_peered":"2024-09-15T22:52:27.787665+0000","last_unstale":"2024-09-15T22:52:29.394746+0000","last_undegraded":"2024-09-15T22:52:29.394746+0000","last_fullsized":"2024-09-15T22:52:29.394746+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:47.744099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774541+0000","last_change":"2024-09-15T22:52:26.773395+0000","last_active":"2024-09-15T22:52:28.774541+0000","last_peered":"2024-09-15T22:52:28.774541+0000","last_clean":"2024-09-15T22:52:28.774541+0000","last_became_active":"2024-09-15T22:52:26.773067+0000","last_became_peered":"2024-09-15T22:52:26.773067+0000","last_unstale":"2024-09-15T22:52:28.774541+0000","last_undegraded":"2024-09-15T22:52:28.774541+0000","last_fullsized":"2024-09-15T22:52:28.774541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:03.865092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042076+0000","last_change":"2024-09-15T22:52:27.795540+0000","last_active":"2024-09-15T22:52:30.042076+0000","last_peered":"2024-09-15T22:52:30.042076+0000","last_clean":"2024-09-15T22:52:30.042076+0000","last_became_active":"2024-09-15T22:52:27.795271+0000","last_became_peered":"2024-09-15T22:52:27.795271+0000","last_unstale":"2024-09-15T22:52:30.042076+0000","last_undegraded":"2024-09-15T22:52:30.042076+0000","last_fullsized":"2024-09-15T22:52:30.042076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:06.637596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.810687+0000","last_change":"2024-09-15T22:52:26.781397+0000","last_active":"2024-09-15T22:52:28.810687+0000","last_peered":"2024-09-15T22:52:28.810687+0000","last_clean":"2024-09-15T22:52:28.810687+0000","last_became_active":"2024-09-15T22:52:26.780880+0000","last_became_peered":"2024-09-15T22:52:26.780880+0000","last_unstale":"2024-09-15T22:52:28.810687+0000","last_undegraded":"2024-09-15T22:52:28.810687+0000","last_fullsized":"2024-09-15T22:52:28.810687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:24.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811152+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:52:28.811152+0000","last_peered":"2024-09-15T22:52:28.811152+0000","last_clean":"2024-09-15T22:52:28.811152+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:52:28.811152+0000","last_undegraded":"2024-09-15T22:52:28.811152+0000","last_fullsized":"2024-09-15T22:52:28.811152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1277952,"data_stored":896460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":684032,"data_stored":306620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":305968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":306550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":692224,"data_stored":307602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":307580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":684032,"data_stored":306128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:52:31.920 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:52:32.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 Processor -- start 2024-09-15T22:52:32.097 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 -- start start 2024-09-15T22:52:32.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6f9c15f770 0x7f6f9c09aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c0d0c70 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9c0d0f50 con 0x7f6f9c09af80 2024-09-15T22:52:32.098 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa2c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6f9c160040 con 0x7f6f9c15f770 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9be00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6f9c15e6d0 0x7f6f9c0d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46062/0 (socket says 172.21.15.31:46062) 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9be00640 1 -- 172.21.15.31:0/515083468 learned_addr learned my addr 172.21.15.31:0/515083468 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f93400640 1 --2- 172.21.15.31:0/515083468 >> v2:172.21.15.102:3300/0 conn(0x7f6f9c15f770 0x7f6f9c09aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2428303932 0 0) 0x7f6f9c0d0c70 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f80003530 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560192750 0 0) 0x7f6f9c0d0f50 con 0x7f6f9c09af80 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9c0d0c70 con 0x7f6f9c09af80 2024-09-15T22:52:32.100 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4084319283 0 0) 0x7f6f80003530 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 >> v2:172.21.15.102:3300/0 conn(0x7f6f9c15f770 msgr2=0x7f6f9c09aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 --2- 172.21.15.31:0/515083468 >> v2:172.21.15.102:3300/0 conn(0x7f6f9c15f770 0x7f6f9c09aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 >> v1:172.21.15.102:6789/0 conn(0x7f6f9c09af80 legacy=0x7f6f9c161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c0d1230 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f6f8c001680 con 0x7f6f9c15e6d0 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 >> v1:172.21.15.31:6789/0 conn(0x7f6f9c15e6d0 legacy=0x7f6f9c0d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f80003ba0 0x7f6f80003fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f80004810 0x7f6f80004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 0x7f6f8000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8000c0a0 con 0x7f6f800051d0 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f8000c220 con 0x7f6f80004810 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f8000c420 con 0x7f6f80003ba0 2024-09-15T22:52:32.101 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 0x7f6f8000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f93400640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f80004810 0x7f6f80004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6f9be00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f80003ba0 0x7f6f80003fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 -- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f80003ba0 msgr2=0x7f6f80003fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f80003ba0 0x7f6f80003fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 -- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f80004810 msgr2=0x7f6f80004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f80004810 0x7f6f80004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.102 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.095+0000 7f6fa0c00640 1 -- 172.21.15.31:0/515083468 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f80003530 con 0x7f6f800051d0 2024-09-15T22:52:32.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa0c00640 1 -- 172.21.15.31:0/515083468 reap_dead start 2024-09-15T22:52:32.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 0x7f6f8000b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6f94001fd0 tx=0x7f6f9401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d2e9da92a51eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f94001c20 con 0x7f6f800051d0 2024-09-15T22:52:32.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94003b80 con 0x7f6f800051d0 2024-09-15T22:52:32.103 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6f9b400640 1 -- 172.21.15.31:0/515083468 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f940050d0 con 0x7f6f800051d0 2024-09-15T22:52:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 -- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 msgr2=0x7f6f8000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 0x7f6f8000b9d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f6f94001fd0 tx=0x7f6f9401c720 comp rx=0 tx=0).stop 2024-09-15T22:52:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 -- 172.21.15.31:0/515083468 shutdown_connections 2024-09-15T22:52:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/515083468 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f800051d0 0x7f6f8000b9d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.104 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 -- 172.21.15.31:0/515083468 >> 172.21.15.31:0/515083468 conn(0x7f6f9c0d23b0 msgr2=0x7f6f9c0d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:32.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 -- 172.21.15.31:0/515083468 shutdown_connections 2024-09-15T22:52:32.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.099+0000 7f6fa2c00640 1 -- 172.21.15.31:0/515083468 wait complete. 2024-09-15T22:52:32.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 Processor -- start 2024-09-15T22:52:32.105 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- start start 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f800051d0 0x7f6f9c1599b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 0x7f6f9c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c15eab0 con 0x7f6f9c0b0690 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6f9c15fbb0 con 0x7f6f9c0b0210 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6f9c0d17f0 con 0x7f6f800051d0 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50364/0 (socket says 172.21.15.31:50364) 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 -- 172.21.15.31:0/37470323 learned_addr learned my addr 172.21.15.31:0/37470323 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:32.107 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f9be00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f800051d0 0x7f6f9c1599b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f93400640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 0x7f6f9c0cc9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 -- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f800051d0 msgr2=0x7f6f9c1599b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f800051d0 0x7f6f9c1599b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 -- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 msgr2=0x7f6f9c0cc9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 0x7f6f9c0cc9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 -- 172.21.15.31:0/37470323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9c1f4580 con 0x7f6f9c0b0690 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f93400640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 0x7f6f9c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa0c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6f9401cfc0 tx=0x7f6f80005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f940b9070 con 0x7f6f9c0b0690 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f94001c00 con 0x7f6f9c0b0690 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f940ad040 con 0x7f6f9c0b0690 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9c1f4860 con 0x7f6f9c0b0690 2024-09-15T22:52:32.109 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.103+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f9c1f4e20 con 0x7f6f9c0b0690 2024-09-15T22:52:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f9c09aa40 con 0x7f6f9c0b0690 2024-09-15T22:52:32.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6f94003b80 con 0x7f6f9c0b0690 2024-09-15T22:52:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6f98c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 0x7f6f78069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f6f9411f2b0 con 0x7f6f9c0b0690 2024-09-15T22:52:32.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6f9be00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 0x7f6f78069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.112 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.107+0000 7f6f9be00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 0x7f6f78069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001060 tx=0x7f6f8c007ba0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.115 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.111+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f6f8c007e20 con 0x7f6f9c0b0690 2024-09-15T22:52:32.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.275+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f9c09b570 con 0x7f6f780678c0 2024-09-15T22:52:32.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.279+0000 7f6f98c00640 1 -- 172.21.15.31:0/37470323 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251955 (secure 0 0 0) 0x7f6f9c09b570 con 0x7f6f780678c0 2024-09-15T22:52:32.286 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:32.287 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:52:32.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 msgr2=0x7f6f78069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 0x7f6f78069d80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6f8c001060 tx=0x7f6f8c007ba0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 msgr2=0x7f6f9c0ccf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f6f9401cfc0 tx=0x7f6f80005840 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 shutdown_connections 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6f780678c0 0x7f6f78069d80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6f9c0b0690 0x7f6f9c0ccf20 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6f9c0b0210 0x7f6f9c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 --2- 172.21.15.31:0/37470323 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6f800051d0 0x7f6f9c1599b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 >> 172.21.15.31:0/37470323 conn(0x7f6f9c0d23b0 msgr2=0x7f6f9c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 shutdown_connections 2024-09-15T22:52:32.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.283+0000 7f6fa2c00640 1 -- 172.21.15.31:0/37470323 wait complete. 2024-09-15T22:52:32.306 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-15T22:52:31.586264+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":137,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226920,"kb_used_data":6504,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747800,"statfs":{"total":773094113280,"available":772861747200,"internally_reserved":0,"allocated":6660096,"data_stored":3633300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.834536"},"pg_stats":[{"pgid":"8.3f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042309+0000","last_change":"2024-09-15T22:52:27.805813+0000","last_active":"2024-09-15T22:52:30.042309+0000","last_peered":"2024-09-15T22:52:30.042309+0000","last_clean":"2024-09-15T22:52:30.042309+0000","last_became_active":"2024-09-15T22:52:27.804488+0000","last_became_peered":"2024-09-15T22:52:27.804488+0000","last_unstale":"2024-09-15T22:52:30.042309+0000","last_undegraded":"2024-09-15T22:52:30.042309+0000","last_fullsized":"2024-09-15T22:52:30.042309+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:16.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.3e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811709+0000","last_change":"2024-09-15T22:52:27.785730+0000","last_active":"2024-09-15T22:52:28.811709+0000","last_peered":"2024-09-15T22:52:28.811709+0000","last_clean":"2024-09-15T22:52:28.811709+0000","last_became_active":"2024-09-15T22:52:27.781253+0000","last_became_peered":"2024-09-15T22:52:27.781253+0000","last_unstale":"2024-09-15T22:52:28.811709+0000","last_undegraded":"2024-09-15T22:52:28.811709+0000","last_fullsized":"2024-09-15T22:52:28.811709+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:44:12.861703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775650+0000","last_change":"2024-09-15T22:52:27.798045+0000","last_active":"2024-09-15T22:52:28.775650+0000","last_peered":"2024-09-15T22:52:28.775650+0000","last_clean":"2024-09-15T22:52:28.775650+0000","last_became_active":"2024-09-15T22:52:27.797650+0000","last_became_peered":"2024-09-15T22:52:27.797650+0000","last_unstale":"2024-09-15T22:52:28.775650+0000","last_undegraded":"2024-09-15T22:52:28.775650+0000","last_fullsized":"2024-09-15T22:52:28.775650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.679516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.3c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811586+0000","last_change":"2024-09-15T22:52:27.783418+0000","last_active":"2024-09-15T22:52:28.811586+0000","last_peered":"2024-09-15T22:52:28.811586+0000","last_clean":"2024-09-15T22:52:28.811586+0000","last_became_active":"2024-09-15T22:52:27.783140+0000","last_became_peered":"2024-09-15T22:52:27.783140+0000","last_unstale":"2024-09-15T22:52:28.811586+0000","last_undegraded":"2024-09-15T22:52:28.811586+0000","last_fullsized":"2024-09-15T22:52:28.811586+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:01:03.929610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.3b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774820+0000","last_change":"2024-09-15T22:52:27.791140+0000","last_active":"2024-09-15T22:52:28.774820+0000","last_peered":"2024-09-15T22:52:28.774820+0000","last_clean":"2024-09-15T22:52:28.774820+0000","last_became_active":"2024-09-15T22:52:27.790782+0000","last_became_peered":"2024-09-15T22:52:27.790782+0000","last_unstale":"2024-09-15T22:52:28.774820+0000","last_undegraded":"2024-09-15T22:52:28.774820+0000","last_fullsized":"2024-09-15T22:52:28.774820+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:50.994864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.3a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042119+0000","last_change":"2024-09-15T22:52:27.793120+0000","last_active":"2024-09-15T22:52:30.042119+0000","last_peered":"2024-09-15T22:52:30.042119+0000","last_clean":"2024-09-15T22:52:30.042119+0000","last_became_active":"2024-09-15T22:52:27.792811+0000","last_became_peered":"2024-09-15T22:52:27.792811+0000","last_unstale":"2024-09-15T22:52:30.042119+0000","last_undegraded":"2024-09-15T22:52:30.042119+0000","last_fullsized":"2024-09-15T22:52:30.042119+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:57.097296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.39","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775156+0000","last_change":"2024-09-15T22:52:27.791727+0000","last_active":"2024-09-15T22:52:28.775156+0000","last_peered":"2024-09-15T22:52:28.775156+0000","last_clean":"2024-09-15T22:52:28.775156+0000","last_became_active":"2024-09-15T22:52:27.791434+0000","last_became_peered":"2024-09-15T22:52:27.791434+0000","last_unstale":"2024-09-15T22:52:28.775156+0000","last_undegraded":"2024-09-15T22:52:28.775156+0000","last_fullsized":"2024-09-15T22:52:28.775156+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:57:56.990877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.38","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394219+0000","last_change":"2024-09-15T22:52:27.795935+0000","last_active":"2024-09-15T22:52:29.394219+0000","last_peered":"2024-09-15T22:52:29.394219+0000","last_clean":"2024-09-15T22:52:29.394219+0000","last_became_active":"2024-09-15T22:52:27.795723+0000","last_became_peered":"2024-09-15T22:52:27.795723+0000","last_unstale":"2024-09-15T22:52:29.394219+0000","last_undegraded":"2024-09-15T22:52:29.394219+0000","last_fullsized":"2024-09-15T22:52:29.394219+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:42.740480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.37","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394763+0000","last_change":"2024-09-15T22:52:27.794942+0000","last_active":"2024-09-15T22:52:29.394763+0000","last_peered":"2024-09-15T22:52:29.394763+0000","last_clean":"2024-09-15T22:52:29.394763+0000","last_became_active":"2024-09-15T22:52:27.794648+0000","last_became_peered":"2024-09-15T22:52:27.794648+0000","last_unstale":"2024-09-15T22:52:29.394763+0000","last_undegraded":"2024-09-15T22:52:29.394763+0000","last_fullsized":"2024-09-15T22:52:29.394763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:22.592189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.36","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042297+0000","last_change":"2024-09-15T22:52:27.801182+0000","last_active":"2024-09-15T22:52:30.042297+0000","last_peered":"2024-09-15T22:52:30.042297+0000","last_clean":"2024-09-15T22:52:30.042297+0000","last_became_active":"2024-09-15T22:52:27.800782+0000","last_became_peered":"2024-09-15T22:52:27.800782+0000","last_unstale":"2024-09-15T22:52:30.042297+0000","last_undegraded":"2024-09-15T22:52:30.042297+0000","last_fullsized":"2024-09-15T22:52:30.042297+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:33.237804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.35","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.043047+0000","last_change":"2024-09-15T22:52:27.797989+0000","last_active":"2024-09-15T22:52:30.043047+0000","last_peered":"2024-09-15T22:52:30.043047+0000","last_clean":"2024-09-15T22:52:30.043047+0000","last_became_active":"2024-09-15T22:52:27.797672+0000","last_became_peered":"2024-09-15T22:52:27.797672+0000","last_unstale":"2024-09-15T22:52:30.043047+0000","last_undegraded":"2024-09-15T22:52:30.043047+0000","last_fullsized":"2024-09-15T22:52:30.043047+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:22:02.888897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.34","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394650+0000","last_change":"2024-09-15T22:52:27.794531+0000","last_active":"2024-09-15T22:52:29.394650+0000","last_peered":"2024-09-15T22:52:29.394650+0000","last_clean":"2024-09-15T22:52:29.394650+0000","last_became_active":"2024-09-15T22:52:27.792373+0000","last_became_peered":"2024-09-15T22:52:27.792373+0000","last_unstale":"2024-09-15T22:52:29.394650+0000","last_undegraded":"2024-09-15T22:52:29.394650+0000","last_fullsized":"2024-09-15T22:52:29.394650+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:10.650939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.33","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042016+0000","last_change":"2024-09-15T22:52:27.805541+0000","last_active":"2024-09-15T22:52:30.042016+0000","last_peered":"2024-09-15T22:52:30.042016+0000","last_clean":"2024-09-15T22:52:30.042016+0000","last_became_active":"2024-09-15T22:52:27.800858+0000","last_became_peered":"2024-09-15T22:52:27.800858+0000","last_unstale":"2024-09-15T22:52:30.042016+0000","last_undegraded":"2024-09-15T22:52:30.042016+0000","last_fullsized":"2024-09-15T22:52:30.042016+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:28.472703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.32","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775544+0000","last_change":"2024-09-15T22:52:27.791086+0000","last_active":"2024-09-15T22:52:28.775544+0000","last_peered":"2024-09-15T22:52:28.775544+0000","last_clean":"2024-09-15T22:52:28.775544+0000","last_became_active":"2024-09-15T22:52:27.790818+0000","last_became_peered":"2024-09-15T22:52:27.790818+0000","last_unstale":"2024-09-15T22:52:28.775544+0000","last_undegraded":"2024-09-15T22:52:28.775544+0000","last_fullsized":"2024-09-15T22:52:28.775544+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:17.926378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.31","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811383+0000","last_change":"2024-09-15T22:52:27.789666+0000","last_active":"2024-09-15T22:52:28.811383+0000","last_peered":"2024-09-15T22:52:28.811383+0000","last_clean":"2024-09-15T22:52:28.811383+0000","last_became_active":"2024-09-15T22:52:27.789330+0000","last_became_peered":"2024-09-15T22:52:27.789330+0000","last_unstale":"2024-09-15T22:52:28.811383+0000","last_undegraded":"2024-09-15T22:52:28.811383+0000","last_fullsized":"2024-09-15T22:52:28.811383+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:05:16.398072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.30","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.041950+0000","last_change":"2024-09-15T22:52:27.789112+0000","last_active":"2024-09-15T22:52:30.041950+0000","last_peered":"2024-09-15T22:52:30.041950+0000","last_clean":"2024-09-15T22:52:30.041950+0000","last_became_active":"2024-09-15T22:52:27.788747+0000","last_became_peered":"2024-09-15T22:52:27.788747+0000","last_unstale":"2024-09-15T22:52:30.041950+0000","last_undegraded":"2024-09-15T22:52:30.041950+0000","last_fullsized":"2024-09-15T22:52:30.041950+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.670087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776276+0000","last_change":"2024-09-15T22:52:27.802806+0000","last_active":"2024-09-15T22:52:28.776276+0000","last_peered":"2024-09-15T22:52:28.776276+0000","last_clean":"2024-09-15T22:52:28.776276+0000","last_became_active":"2024-09-15T22:52:27.802191+0000","last_became_peered":"2024-09-15T22:52:27.802191+0000","last_unstale":"2024-09-15T22:52:28.776276+0000","last_undegraded":"2024-09-15T22:52:28.776276+0000","last_fullsized":"2024-09-15T22:52:28.776276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:50:22.592189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811771+0000","last_change":"2024-09-15T22:52:27.781217+0000","last_active":"2024-09-15T22:52:28.811771+0000","last_peered":"2024-09-15T22:52:28.811771+0000","last_clean":"2024-09-15T22:52:28.811771+0000","last_became_active":"2024-09-15T22:52:27.780897+0000","last_became_peered":"2024-09-15T22:52:27.780897+0000","last_unstale":"2024-09-15T22:52:28.811771+0000","last_undegraded":"2024-09-15T22:52:28.811771+0000","last_fullsized":"2024-09-15T22:52:28.811771+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:47:09.097095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775778+0000","last_change":"2024-09-15T22:52:27.796077+0000","last_active":"2024-09-15T22:52:28.775778+0000","last_peered":"2024-09-15T22:52:28.775778+0000","last_clean":"2024-09-15T22:52:28.775778+0000","last_became_active":"2024-09-15T22:52:27.795790+0000","last_became_peered":"2024-09-15T22:52:27.795790+0000","last_unstale":"2024-09-15T22:52:28.775778+0000","last_undegraded":"2024-09-15T22:52:28.775778+0000","last_fullsized":"2024-09-15T22:52:28.775778+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:18.600022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.2c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042049+0000","last_change":"2024-09-15T22:52:27.797479+0000","last_active":"2024-09-15T22:52:30.042049+0000","last_peered":"2024-09-15T22:52:30.042049+0000","last_clean":"2024-09-15T22:52:30.042049+0000","last_became_active":"2024-09-15T22:52:27.797181+0000","last_became_peered":"2024-09-15T22:52:27.797181+0000","last_unstale":"2024-09-15T22:52:30.042049+0000","last_undegraded":"2024-09-15T22:52:30.042049+0000","last_fullsized":"2024-09-15T22:52:30.042049+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:56.285322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042053+0000","last_change":"2024-09-15T22:52:27.792894+0000","last_active":"2024-09-15T22:52:30.042053+0000","last_peered":"2024-09-15T22:52:30.042053+0000","last_clean":"2024-09-15T22:52:30.042053+0000","last_became_active":"2024-09-15T22:52:27.792665+0000","last_became_peered":"2024-09-15T22:52:27.792665+0000","last_unstale":"2024-09-15T22:52:30.042053+0000","last_undegraded":"2024-09-15T22:52:30.042053+0000","last_fullsized":"2024-09-15T22:52:30.042053+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:50.994864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394222+0000","last_change":"2024-09-15T22:52:27.795302+0000","last_active":"2024-09-15T22:52:29.394222+0000","last_peered":"2024-09-15T22:52:29.394222+0000","last_clean":"2024-09-15T22:52:29.394222+0000","last_became_active":"2024-09-15T22:52:27.795062+0000","last_became_peered":"2024-09-15T22:52:27.795062+0000","last_unstale":"2024-09-15T22:52:29.394222+0000","last_undegraded":"2024-09-15T22:52:29.394222+0000","last_fullsized":"2024-09-15T22:52:29.394222+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:09.063674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.29","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042846+0000","last_change":"2024-09-15T22:52:27.791114+0000","last_active":"2024-09-15T22:52:30.042846+0000","last_peered":"2024-09-15T22:52:30.042846+0000","last_clean":"2024-09-15T22:52:30.042846+0000","last_became_active":"2024-09-15T22:52:27.790846+0000","last_became_peered":"2024-09-15T22:52:27.790846+0000","last_unstale":"2024-09-15T22:52:30.042846+0000","last_undegraded":"2024-09-15T22:52:30.042846+0000","last_fullsized":"2024-09-15T22:52:30.042846+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:19.747851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.28","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775141+0000","last_change":"2024-09-15T22:52:27.802091+0000","last_active":"2024-09-15T22:52:28.775141+0000","last_peered":"2024-09-15T22:52:28.775141+0000","last_clean":"2024-09-15T22:52:28.775141+0000","last_became_active":"2024-09-15T22:52:27.798472+0000","last_became_peered":"2024-09-15T22:52:27.798472+0000","last_unstale":"2024-09-15T22:52:28.775141+0000","last_undegraded":"2024-09-15T22:52:28.775141+0000","last_fullsized":"2024-09-15T22:52:28.775141+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:04:08.610651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.27","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776303+0000","last_change":"2024-09-15T22:52:27.796872+0000","last_active":"2024-09-15T22:52:28.776303+0000","last_peered":"2024-09-15T22:52:28.776303+0000","last_clean":"2024-09-15T22:52:28.776303+0000","last_became_active":"2024-09-15T22:52:27.796335+0000","last_became_peered":"2024-09-15T22:52:27.796335+0000","last_unstale":"2024-09-15T22:52:28.776303+0000","last_undegraded":"2024-09-15T22:52:28.776303+0000","last_fullsized":"2024-09-15T22:52:28.776303+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:38:50.540166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.26","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394434+0000","last_change":"2024-09-15T22:52:27.788713+0000","last_active":"2024-09-15T22:52:29.394434+0000","last_peered":"2024-09-15T22:52:29.394434+0000","last_clean":"2024-09-15T22:52:29.394434+0000","last_became_active":"2024-09-15T22:52:27.788420+0000","last_became_peered":"2024-09-15T22:52:27.788420+0000","last_unstale":"2024-09-15T22:52:29.394434+0000","last_undegraded":"2024-09-15T22:52:29.394434+0000","last_fullsized":"2024-09-15T22:52:29.394434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:39:18.600022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.25","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042297+0000","last_change":"2024-09-15T22:52:27.799848+0000","last_active":"2024-09-15T22:52:30.042297+0000","last_peered":"2024-09-15T22:52:30.042297+0000","last_clean":"2024-09-15T22:52:30.042297+0000","last_became_active":"2024-09-15T22:52:27.799244+0000","last_became_peered":"2024-09-15T22:52:27.799244+0000","last_unstale":"2024-09-15T22:52:30.042297+0000","last_undegraded":"2024-09-15T22:52:30.042297+0000","last_fullsized":"2024-09-15T22:52:30.042297+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:53:21.472206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.24","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042262+0000","last_change":"2024-09-15T22:52:27.797674+0000","last_active":"2024-09-15T22:52:30.042262+0000","last_peered":"2024-09-15T22:52:30.042262+0000","last_clean":"2024-09-15T22:52:30.042262+0000","last_became_active":"2024-09-15T22:52:27.797387+0000","last_became_peered":"2024-09-15T22:52:27.797387+0000","last_unstale":"2024-09-15T22:52:30.042262+0000","last_undegraded":"2024-09-15T22:52:30.042262+0000","last_fullsized":"2024-09-15T22:52:30.042262+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:58.670087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.23","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775835+0000","last_change":"2024-09-15T22:52:27.793315+0000","last_active":"2024-09-15T22:52:28.775835+0000","last_peered":"2024-09-15T22:52:28.775835+0000","last_clean":"2024-09-15T22:52:28.775835+0000","last_became_active":"2024-09-15T22:52:27.793042+0000","last_became_peered":"2024-09-15T22:52:27.793042+0000","last_unstale":"2024-09-15T22:52:28.775835+0000","last_undegraded":"2024-09-15T22:52:28.775835+0000","last_fullsized":"2024-09-15T22:52:28.775835+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:18.207146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.22","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811463+0000","last_change":"2024-09-15T22:52:27.792803+0000","last_active":"2024-09-15T22:52:28.811463+0000","last_peered":"2024-09-15T22:52:28.811463+0000","last_clean":"2024-09-15T22:52:28.811463+0000","last_became_active":"2024-09-15T22:52:27.792541+0000","last_became_peered":"2024-09-15T22:52:27.792541+0000","last_unstale":"2024-09-15T22:52:28.811463+0000","last_undegraded":"2024-09-15T22:52:28.811463+0000","last_fullsized":"2024-09-15T22:52:28.811463+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.377865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.21","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776098+0000","last_change":"2024-09-15T22:52:27.796747+0000","last_active":"2024-09-15T22:52:28.776098+0000","last_peered":"2024-09-15T22:52:28.776098+0000","last_clean":"2024-09-15T22:52:28.776098+0000","last_became_active":"2024-09-15T22:52:27.794078+0000","last_became_peered":"2024-09-15T22:52:27.794078+0000","last_unstale":"2024-09-15T22:52:28.776098+0000","last_undegraded":"2024-09-15T22:52:28.776098+0000","last_fullsized":"2024-09-15T22:52:28.776098+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:11:10.650939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.20","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774314+0000","last_change":"2024-09-15T22:52:27.787936+0000","last_active":"2024-09-15T22:52:28.774314+0000","last_peered":"2024-09-15T22:52:28.774314+0000","last_clean":"2024-09-15T22:52:28.774314+0000","last_became_active":"2024-09-15T22:52:27.787502+0000","last_became_peered":"2024-09-15T22:52:27.787502+0000","last_unstale":"2024-09-15T22:52:28.774314+0000","last_undegraded":"2024-09-15T22:52:28.774314+0000","last_fullsized":"2024-09-15T22:52:28.774314+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:40:33.280008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811216+0000","last_change":"2024-09-15T22:52:27.781962+0000","last_active":"2024-09-15T22:52:28.811216+0000","last_peered":"2024-09-15T22:52:28.811216+0000","last_clean":"2024-09-15T22:52:28.811216+0000","last_became_active":"2024-09-15T22:52:27.781683+0000","last_became_peered":"2024-09-15T22:52:27.781683+0000","last_unstale":"2024-09-15T22:52:28.811216+0000","last_undegraded":"2024-09-15T22:52:28.811216+0000","last_fullsized":"2024-09-15T22:52:28.811216+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:04:33.237804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1f","version":"56'4","reported_seq":18,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042264+0000","last_change":"2024-09-15T22:52:26.772720+0000","last_active":"2024-09-15T22:52:30.042264+0000","last_peered":"2024-09-15T22:52:30.042264+0000","last_clean":"2024-09-15T22:52:30.042264+0000","last_became_active":"2024-09-15T22:52:26.772441+0000","last_became_peered":"2024-09-15T22:52:26.772441+0000","last_unstale":"2024-09-15T22:52:30.042264+0000","last_undegraded":"2024-09-15T22:52:30.042264+0000","last_fullsized":"2024-09-15T22:52:30.042264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774621+0000","last_change":"2024-09-15T22:52:27.785002+0000","last_active":"2024-09-15T22:52:28.774621+0000","last_peered":"2024-09-15T22:52:28.774621+0000","last_clean":"2024-09-15T22:52:28.774621+0000","last_became_active":"2024-09-15T22:52:27.784697+0000","last_became_peered":"2024-09-15T22:52:27.784697+0000","last_unstale":"2024-09-15T22:52:28.774621+0000","last_undegraded":"2024-09-15T22:52:28.774621+0000","last_fullsized":"2024-09-15T22:52:28.774621+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:58:26.803442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1e","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042403+0000","last_change":"2024-09-15T22:52:26.770807+0000","last_active":"2024-09-15T22:52:30.042403+0000","last_peered":"2024-09-15T22:52:30.042403+0000","last_clean":"2024-09-15T22:52:30.042403+0000","last_became_active":"2024-09-15T22:52:26.770528+0000","last_became_peered":"2024-09-15T22:52:26.770528+0000","last_unstale":"2024-09-15T22:52:30.042403+0000","last_undegraded":"2024-09-15T22:52:30.042403+0000","last_fullsized":"2024-09-15T22:52:30.042403+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042130+0000","last_change":"2024-09-15T22:52:27.791839+0000","last_active":"2024-09-15T22:52:30.042130+0000","last_peered":"2024-09-15T22:52:30.042130+0000","last_clean":"2024-09-15T22:52:30.042130+0000","last_became_active":"2024-09-15T22:52:27.791498+0000","last_became_peered":"2024-09-15T22:52:27.791498+0000","last_unstale":"2024-09-15T22:52:30.042130+0000","last_undegraded":"2024-09-15T22:52:30.042130+0000","last_fullsized":"2024-09-15T22:52:30.042130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:25.083930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1d","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042298+0000","last_change":"2024-09-15T22:52:26.773486+0000","last_active":"2024-09-15T22:52:30.042298+0000","last_peered":"2024-09-15T22:52:30.042298+0000","last_clean":"2024-09-15T22:52:30.042298+0000","last_became_active":"2024-09-15T22:52:26.772513+0000","last_became_peered":"2024-09-15T22:52:26.772513+0000","last_unstale":"2024-09-15T22:52:30.042298+0000","last_undegraded":"2024-09-15T22:52:30.042298+0000","last_fullsized":"2024-09-15T22:52:30.042298+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394382+0000","last_change":"2024-09-15T22:52:27.794635+0000","last_active":"2024-09-15T22:52:29.394382+0000","last_peered":"2024-09-15T22:52:29.394382+0000","last_clean":"2024-09-15T22:52:29.394382+0000","last_became_active":"2024-09-15T22:52:27.794107+0000","last_became_peered":"2024-09-15T22:52:27.794107+0000","last_unstale":"2024-09-15T22:52:29.394382+0000","last_undegraded":"2024-09-15T22:52:29.394382+0000","last_fullsized":"2024-09-15T22:52:29.394382+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.948512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1c","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774829+0000","last_change":"2024-09-15T22:52:26.778209+0000","last_active":"2024-09-15T22:52:28.774829+0000","last_peered":"2024-09-15T22:52:28.774829+0000","last_clean":"2024-09-15T22:52:28.774829+0000","last_became_active":"2024-09-15T22:52:26.777455+0000","last_became_peered":"2024-09-15T22:52:26.777455+0000","last_unstale":"2024-09-15T22:52:28.774829+0000","last_undegraded":"2024-09-15T22:52:28.774829+0000","last_fullsized":"2024-09-15T22:52:28.774829+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:16:41.156426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774557+0000","last_change":"2024-09-15T22:52:27.797062+0000","last_active":"2024-09-15T22:52:28.774557+0000","last_peered":"2024-09-15T22:52:28.774557+0000","last_clean":"2024-09-15T22:52:28.774557+0000","last_became_active":"2024-09-15T22:52:27.796745+0000","last_became_peered":"2024-09-15T22:52:27.796745+0000","last_unstale":"2024-09-15T22:52:28.774557+0000","last_undegraded":"2024-09-15T22:52:28.774557+0000","last_fullsized":"2024-09-15T22:52:28.774557+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:56.285322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775941+0000","last_change":"2024-09-15T22:52:26.787726+0000","last_active":"2024-09-15T22:52:28.775941+0000","last_peered":"2024-09-15T22:52:28.775941+0000","last_clean":"2024-09-15T22:52:28.775941+0000","last_became_active":"2024-09-15T22:52:26.787211+0000","last_became_peered":"2024-09-15T22:52:26.787211+0000","last_unstale":"2024-09-15T22:52:28.775941+0000","last_undegraded":"2024-09-15T22:52:28.775941+0000","last_fullsized":"2024-09-15T22:52:28.775941+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:55.278578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811510+0000","last_change":"2024-09-15T22:52:27.793838+0000","last_active":"2024-09-15T22:52:28.811510+0000","last_peered":"2024-09-15T22:52:28.811510+0000","last_clean":"2024-09-15T22:52:28.811510+0000","last_became_active":"2024-09-15T22:52:27.793337+0000","last_became_peered":"2024-09-15T22:52:27.793337+0000","last_unstale":"2024-09-15T22:52:28.811510+0000","last_undegraded":"2024-09-15T22:52:28.811510+0000","last_fullsized":"2024-09-15T22:52:28.811510+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:33.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774992+0000","last_change":"2024-09-15T22:52:26.774282+0000","last_active":"2024-09-15T22:52:28.774992+0000","last_peered":"2024-09-15T22:52:28.774992+0000","last_clean":"2024-09-15T22:52:28.774992+0000","last_became_active":"2024-09-15T22:52:26.773963+0000","last_became_peered":"2024-09-15T22:52:26.773963+0000","last_unstale":"2024-09-15T22:52:28.774992+0000","last_undegraded":"2024-09-15T22:52:28.774992+0000","last_fullsized":"2024-09-15T22:52:28.774992+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394596+0000","last_change":"2024-09-15T22:52:27.788659+0000","last_active":"2024-09-15T22:52:29.394596+0000","last_peered":"2024-09-15T22:52:29.394596+0000","last_clean":"2024-09-15T22:52:29.394596+0000","last_became_active":"2024-09-15T22:52:27.788368+0000","last_became_peered":"2024-09-15T22:52:27.788368+0000","last_unstale":"2024-09-15T22:52:29.394596+0000","last_undegraded":"2024-09-15T22:52:29.394596+0000","last_fullsized":"2024-09-15T22:52:29.394596+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.345714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.041935+0000","last_change":"2024-09-15T22:52:26.768480+0000","last_active":"2024-09-15T22:52:30.041935+0000","last_peered":"2024-09-15T22:52:30.041935+0000","last_clean":"2024-09-15T22:52:30.041935+0000","last_became_active":"2024-09-15T22:52:26.768185+0000","last_became_peered":"2024-09-15T22:52:26.768185+0000","last_unstale":"2024-09-15T22:52:30.041935+0000","last_undegraded":"2024-09-15T22:52:30.041935+0000","last_fullsized":"2024-09-15T22:52:30.041935+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:17:19.890589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811720+0000","last_change":"2024-09-15T22:52:27.794119+0000","last_active":"2024-09-15T22:52:28.811720+0000","last_peered":"2024-09-15T22:52:28.811720+0000","last_clean":"2024-09-15T22:52:28.811720+0000","last_became_active":"2024-09-15T22:52:27.793899+0000","last_became_peered":"2024-09-15T22:52:27.793899+0000","last_unstale":"2024-09-15T22:52:28.811720+0000","last_undegraded":"2024-09-15T22:52:28.811720+0000","last_fullsized":"2024-09-15T22:52:28.811720+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:33:02.841913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775965+0000","last_change":"2024-09-15T22:52:26.777737+0000","last_active":"2024-09-15T22:52:28.775965+0000","last_peered":"2024-09-15T22:52:28.775965+0000","last_clean":"2024-09-15T22:52:28.775965+0000","last_became_active":"2024-09-15T22:52:26.777440+0000","last_became_peered":"2024-09-15T22:52:26.777440+0000","last_unstale":"2024-09-15T22:52:28.775965+0000","last_undegraded":"2024-09-15T22:52:28.775965+0000","last_fullsized":"2024-09-15T22:52:28.775965+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:38:10.269274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774114+0000","last_change":"2024-09-15T22:52:27.794940+0000","last_active":"2024-09-15T22:52:28.774114+0000","last_peered":"2024-09-15T22:52:28.774114+0000","last_clean":"2024-09-15T22:52:28.774114+0000","last_became_active":"2024-09-15T22:52:27.794675+0000","last_became_peered":"2024-09-15T22:52:27.794675+0000","last_unstale":"2024-09-15T22:52:28.774114+0000","last_undegraded":"2024-09-15T22:52:28.774114+0000","last_fullsized":"2024-09-15T22:52:28.774114+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:18.799306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811726+0000","last_change":"2024-09-15T22:52:26.778968+0000","last_active":"2024-09-15T22:52:28.811726+0000","last_peered":"2024-09-15T22:52:28.811726+0000","last_clean":"2024-09-15T22:52:28.811726+0000","last_became_active":"2024-09-15T22:52:26.778702+0000","last_became_peered":"2024-09-15T22:52:26.778702+0000","last_unstale":"2024-09-15T22:52:28.811726+0000","last_undegraded":"2024-09-15T22:52:28.811726+0000","last_fullsized":"2024-09-15T22:52:28.811726+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:05.630852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774451+0000","last_change":"2024-09-15T22:52:27.788001+0000","last_active":"2024-09-15T22:52:28.774451+0000","last_peered":"2024-09-15T22:52:28.774451+0000","last_clean":"2024-09-15T22:52:28.774451+0000","last_became_active":"2024-09-15T22:52:27.787715+0000","last_became_peered":"2024-09-15T22:52:27.787715+0000","last_unstale":"2024-09-15T22:52:28.774451+0000","last_undegraded":"2024-09-15T22:52:28.774451+0000","last_fullsized":"2024-09-15T22:52:28.774451+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:41:09.081809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774588+0000","last_change":"2024-09-15T22:52:26.780780+0000","last_active":"2024-09-15T22:52:28.774588+0000","last_peered":"2024-09-15T22:52:28.774588+0000","last_clean":"2024-09-15T22:52:28.774588+0000","last_became_active":"2024-09-15T22:52:26.780462+0000","last_became_peered":"2024-09-15T22:52:26.780462+0000","last_unstale":"2024-09-15T22:52:28.774588+0000","last_undegraded":"2024-09-15T22:52:28.774588+0000","last_fullsized":"2024-09-15T22:52:28.774588+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775673+0000","last_change":"2024-09-15T22:52:27.793219+0000","last_active":"2024-09-15T22:52:28.775673+0000","last_peered":"2024-09-15T22:52:28.775673+0000","last_clean":"2024-09-15T22:52:28.775673+0000","last_became_active":"2024-09-15T22:52:27.792908+0000","last_became_peered":"2024-09-15T22:52:27.792908+0000","last_unstale":"2024-09-15T22:52:28.775673+0000","last_undegraded":"2024-09-15T22:52:28.775673+0000","last_fullsized":"2024-09-15T22:52:28.775673+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:42:07.948512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.15","version":"56'3","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811605+0000","last_change":"2024-09-15T22:52:26.782632+0000","last_active":"2024-09-15T22:52:28.811605+0000","last_peered":"2024-09-15T22:52:28.811605+0000","last_clean":"2024-09-15T22:52:28.811605+0000","last_became_active":"2024-09-15T22:52:26.782353+0000","last_became_peered":"2024-09-15T22:52:26.782353+0000","last_unstale":"2024-09-15T22:52:28.811605+0000","last_undegraded":"2024-09-15T22:52:28.811605+0000","last_fullsized":"2024-09-15T22:52:28.811605+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:17.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774844+0000","last_change":"2024-09-15T22:52:27.799501+0000","last_active":"2024-09-15T22:52:28.774844+0000","last_peered":"2024-09-15T22:52:28.774844+0000","last_clean":"2024-09-15T22:52:28.774844+0000","last_became_active":"2024-09-15T22:52:27.799215+0000","last_became_peered":"2024-09-15T22:52:27.799215+0000","last_unstale":"2024-09-15T22:52:28.774844+0000","last_undegraded":"2024-09-15T22:52:28.774844+0000","last_fullsized":"2024-09-15T22:52:28.774844+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:06.637596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.14","version":"56'6","reported_seq":20,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394761+0000","last_change":"2024-09-15T22:52:26.786171+0000","last_active":"2024-09-15T22:52:29.394761+0000","last_peered":"2024-09-15T22:52:29.394761+0000","last_clean":"2024-09-15T22:52:29.394761+0000","last_became_active":"2024-09-15T22:52:26.785571+0000","last_became_peered":"2024-09-15T22:52:26.785571+0000","last_unstale":"2024-09-15T22:52:29.394761+0000","last_undegraded":"2024-09-15T22:52:29.394761+0000","last_fullsized":"2024-09-15T22:52:29.394761+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:20.490638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774763+0000","last_change":"2024-09-15T22:52:27.785105+0000","last_active":"2024-09-15T22:52:28.774763+0000","last_peered":"2024-09-15T22:52:28.774763+0000","last_clean":"2024-09-15T22:52:28.774763+0000","last_became_active":"2024-09-15T22:52:27.784547+0000","last_became_peered":"2024-09-15T22:52:27.784547+0000","last_unstale":"2024-09-15T22:52:28.774763+0000","last_undegraded":"2024-09-15T22:52:28.774763+0000","last_fullsized":"2024-09-15T22:52:28.774763+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:57:41.315752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.13","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776059+0000","last_change":"2024-09-15T22:52:26.780713+0000","last_active":"2024-09-15T22:52:28.776059+0000","last_peered":"2024-09-15T22:52:28.776059+0000","last_clean":"2024-09-15T22:52:28.776059+0000","last_became_active":"2024-09-15T22:52:26.780398+0000","last_became_peered":"2024-09-15T22:52:26.780398+0000","last_unstale":"2024-09-15T22:52:28.776059+0000","last_undegraded":"2024-09-15T22:52:28.776059+0000","last_fullsized":"2024-09-15T22:52:28.776059+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:49.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775940+0000","last_change":"2024-09-15T22:52:27.793814+0000","last_active":"2024-09-15T22:52:28.775940+0000","last_peered":"2024-09-15T22:52:28.775940+0000","last_clean":"2024-09-15T22:52:28.775940+0000","last_became_active":"2024-09-15T22:52:27.792443+0000","last_became_peered":"2024-09-15T22:52:27.792443+0000","last_unstale":"2024-09-15T22:52:28.775940+0000","last_undegraded":"2024-09-15T22:52:28.775940+0000","last_fullsized":"2024-09-15T22:52:28.775940+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:55:58.345714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042046+0000","last_change":"2024-09-15T22:52:26.781376+0000","last_active":"2024-09-15T22:52:30.042046+0000","last_peered":"2024-09-15T22:52:30.042046+0000","last_clean":"2024-09-15T22:52:30.042046+0000","last_became_active":"2024-09-15T22:52:26.781061+0000","last_became_peered":"2024-09-15T22:52:26.781061+0000","last_unstale":"2024-09-15T22:52:30.042046+0000","last_undegraded":"2024-09-15T22:52:30.042046+0000","last_fullsized":"2024-09-15T22:52:30.042046+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:12:21.490593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394595+0000","last_change":"2024-09-15T22:52:27.786176+0000","last_active":"2024-09-15T22:52:29.394595+0000","last_peered":"2024-09-15T22:52:29.394595+0000","last_clean":"2024-09-15T22:52:29.394595+0000","last_became_active":"2024-09-15T22:52:27.785882+0000","last_became_peered":"2024-09-15T22:52:27.785882+0000","last_unstale":"2024-09-15T22:52:29.394595+0000","last_undegraded":"2024-09-15T22:52:29.394595+0000","last_fullsized":"2024-09-15T22:52:29.394595+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:29:18.207146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811388+0000","last_change":"2024-09-15T22:52:26.775790+0000","last_active":"2024-09-15T22:52:28.811388+0000","last_peered":"2024-09-15T22:52:28.811388+0000","last_clean":"2024-09-15T22:52:28.811388+0000","last_became_active":"2024-09-15T22:52:26.775518+0000","last_became_peered":"2024-09-15T22:52:26.775518+0000","last_unstale":"2024-09-15T22:52:28.811388+0000","last_undegraded":"2024-09-15T22:52:28.811388+0000","last_fullsized":"2024-09-15T22:52:28.811388+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:46:49.988120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776164+0000","last_change":"2024-09-15T22:52:27.802576+0000","last_active":"2024-09-15T22:52:28.776164+0000","last_peered":"2024-09-15T22:52:28.776164+0000","last_clean":"2024-09-15T22:52:28.776164+0000","last_became_active":"2024-09-15T22:52:27.801548+0000","last_became_peered":"2024-09-15T22:52:27.801548+0000","last_unstale":"2024-09-15T22:52:28.776164+0000","last_undegraded":"2024-09-15T22:52:28.776164+0000","last_fullsized":"2024-09-15T22:52:28.776164+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:47.744099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.10","version":"56'8","reported_seq":22,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394351+0000","last_change":"2024-09-15T22:52:26.779791+0000","last_active":"2024-09-15T22:52:29.394351+0000","last_peered":"2024-09-15T22:52:29.394351+0000","last_clean":"2024-09-15T22:52:29.394351+0000","last_became_active":"2024-09-15T22:52:26.779443+0000","last_became_peered":"2024-09-15T22:52:26.779443+0000","last_unstale":"2024-09-15T22:52:29.394351+0000","last_undegraded":"2024-09-15T22:52:29.394351+0000","last_fullsized":"2024-09-15T22:52:29.394351+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:39:27.465959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394247+0000","last_change":"2024-09-15T22:52:27.788071+0000","last_active":"2024-09-15T22:52:29.394247+0000","last_peered":"2024-09-15T22:52:29.394247+0000","last_clean":"2024-09-15T22:52:29.394247+0000","last_became_active":"2024-09-15T22:52:27.787743+0000","last_became_peered":"2024-09-15T22:52:27.787743+0000","last_unstale":"2024-09-15T22:52:29.394247+0000","last_undegraded":"2024-09-15T22:52:29.394247+0000","last_fullsized":"2024-09-15T22:52:29.394247+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:58:17.926378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.f","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.776376+0000","last_change":"2024-09-15T22:52:26.781735+0000","last_active":"2024-09-15T22:52:28.776376+0000","last_peered":"2024-09-15T22:52:28.776376+0000","last_clean":"2024-09-15T22:52:28.776376+0000","last_became_active":"2024-09-15T22:52:26.781416+0000","last_became_peered":"2024-09-15T22:52:26.781416+0000","last_unstale":"2024-09-15T22:52:28.776376+0000","last_undegraded":"2024-09-15T22:52:28.776376+0000","last_fullsized":"2024-09-15T22:52:28.776376+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:05.630852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042516+0000","last_change":"2024-09-15T22:52:27.807225+0000","last_active":"2024-09-15T22:52:30.042516+0000","last_peered":"2024-09-15T22:52:30.042516+0000","last_clean":"2024-09-15T22:52:30.042516+0000","last_became_active":"2024-09-15T22:52:27.805803+0000","last_became_peered":"2024-09-15T22:52:27.805803+0000","last_unstale":"2024-09-15T22:52:30.042516+0000","last_undegraded":"2024-09-15T22:52:30.042516+0000","last_fullsized":"2024-09-15T22:52:30.042516+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:49:33.934539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.e","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.043185+0000","last_change":"2024-09-15T22:52:26.770355+0000","last_active":"2024-09-15T22:52:30.043185+0000","last_peered":"2024-09-15T22:52:30.043185+0000","last_clean":"2024-09-15T22:52:30.043185+0000","last_became_active":"2024-09-15T22:52:26.770075+0000","last_became_peered":"2024-09-15T22:52:26.770075+0000","last_unstale":"2024-09-15T22:52:30.043185+0000","last_undegraded":"2024-09-15T22:52:30.043185+0000","last_fullsized":"2024-09-15T22:52:30.043185+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T00:18:52.896071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774925+0000","last_change":"2024-09-15T22:52:27.794887+0000","last_active":"2024-09-15T22:52:28.774925+0000","last_peered":"2024-09-15T22:52:28.774925+0000","last_clean":"2024-09-15T22:52:28.774925+0000","last_became_active":"2024-09-15T22:52:27.794581+0000","last_became_peered":"2024-09-15T22:52:27.794581+0000","last_unstale":"2024-09-15T22:52:28.774925+0000","last_undegraded":"2024-09-15T22:52:28.774925+0000","last_fullsized":"2024-09-15T22:52:28.774925+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:25.083930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.d","version":"56'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042182+0000","last_change":"2024-09-15T22:52:26.783446+0000","last_active":"2024-09-15T22:52:30.042182+0000","last_peered":"2024-09-15T22:52:30.042182+0000","last_clean":"2024-09-15T22:52:30.042182+0000","last_became_active":"2024-09-15T22:52:26.783152+0000","last_became_peered":"2024-09-15T22:52:26.783152+0000","last_unstale":"2024-09-15T22:52:30.042182+0000","last_undegraded":"2024-09-15T22:52:30.042182+0000","last_fullsized":"2024-09-15T22:52:30.042182+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:27:08.185195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042009+0000","last_change":"2024-09-15T22:52:27.804090+0000","last_active":"2024-09-15T22:52:30.042009+0000","last_peered":"2024-09-15T22:52:30.042009+0000","last_clean":"2024-09-15T22:52:30.042009+0000","last_became_active":"2024-09-15T22:52:27.803819+0000","last_became_peered":"2024-09-15T22:52:27.803819+0000","last_unstale":"2024-09-15T22:52:30.042009+0000","last_undegraded":"2024-09-15T22:52:30.042009+0000","last_fullsized":"2024-09-15T22:52:30.042009+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:55.424282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042204+0000","last_change":"2024-09-15T22:52:26.776288+0000","last_active":"2024-09-15T22:52:30.042204+0000","last_peered":"2024-09-15T22:52:30.042204+0000","last_clean":"2024-09-15T22:52:30.042204+0000","last_became_active":"2024-09-15T22:52:26.776017+0000","last_became_peered":"2024-09-15T22:52:26.776017+0000","last_unstale":"2024-09-15T22:52:30.042204+0000","last_undegraded":"2024-09-15T22:52:30.042204+0000","last_fullsized":"2024-09-15T22:52:30.042204+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:28:52.127358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774823+0000","last_change":"2024-09-15T22:52:27.792806+0000","last_active":"2024-09-15T22:52:28.774823+0000","last_peered":"2024-09-15T22:52:28.774823+0000","last_clean":"2024-09-15T22:52:28.774823+0000","last_became_active":"2024-09-15T22:52:27.792486+0000","last_became_peered":"2024-09-15T22:52:27.792486+0000","last_unstale":"2024-09-15T22:52:28.774823+0000","last_undegraded":"2024-09-15T22:52:28.774823+0000","last_fullsized":"2024-09-15T22:52:28.774823+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:07.890838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042122+0000","last_change":"2024-09-15T22:52:26.766560+0000","last_active":"2024-09-15T22:52:30.042122+0000","last_peered":"2024-09-15T22:52:30.042122+0000","last_clean":"2024-09-15T22:52:30.042122+0000","last_became_active":"2024-09-15T22:52:26.766149+0000","last_became_peered":"2024-09-15T22:52:26.766149+0000","last_unstale":"2024-09-15T22:52:30.042122+0000","last_undegraded":"2024-09-15T22:52:30.042122+0000","last_fullsized":"2024-09-15T22:52:30.042122+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042249+0000","last_change":"2024-09-15T22:52:27.792096+0000","last_active":"2024-09-15T22:52:30.042249+0000","last_peered":"2024-09-15T22:52:30.042249+0000","last_clean":"2024-09-15T22:52:30.042249+0000","last_became_active":"2024-09-15T22:52:27.789084+0000","last_became_peered":"2024-09-15T22:52:27.789084+0000","last_unstale":"2024-09-15T22:52:30.042249+0000","last_undegraded":"2024-09-15T22:52:30.042249+0000","last_fullsized":"2024-09-15T22:52:30.042249+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:13:01.318257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394121+0000","last_change":"2024-09-15T22:52:26.785913+0000","last_active":"2024-09-15T22:52:29.394121+0000","last_peered":"2024-09-15T22:52:29.394121+0000","last_clean":"2024-09-15T22:52:29.394121+0000","last_became_active":"2024-09-15T22:52:26.785607+0000","last_became_peered":"2024-09-15T22:52:26.785607+0000","last_unstale":"2024-09-15T22:52:29.394121+0000","last_undegraded":"2024-09-15T22:52:29.394121+0000","last_fullsized":"2024-09-15T22:52:29.394121+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T06:30:57.663343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775458+0000","last_change":"2024-09-15T22:52:27.792668+0000","last_active":"2024-09-15T22:52:28.775458+0000","last_peered":"2024-09-15T22:52:28.775458+0000","last_clean":"2024-09-15T22:52:28.775458+0000","last_became_active":"2024-09-15T22:52:27.792373+0000","last_became_peered":"2024-09-15T22:52:27.792373+0000","last_unstale":"2024-09-15T22:52:28.775458+0000","last_undegraded":"2024-09-15T22:52:28.775458+0000","last_fullsized":"2024-09-15T22:52:28.775458+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:05:09.063674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775262+0000","last_change":"2024-09-15T22:52:26.783189+0000","last_active":"2024-09-15T22:52:28.775262+0000","last_peered":"2024-09-15T22:52:28.775262+0000","last_clean":"2024-09-15T22:52:28.775262+0000","last_became_active":"2024-09-15T22:52:26.782869+0000","last_became_peered":"2024-09-15T22:52:26.782869+0000","last_unstale":"2024-09-15T22:52:28.775262+0000","last_undegraded":"2024-09-15T22:52:28.775262+0000","last_fullsized":"2024-09-15T22:52:28.775262+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:06:16.138827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042456+0000","last_change":"2024-09-15T22:52:27.795822+0000","last_active":"2024-09-15T22:52:30.042456+0000","last_peered":"2024-09-15T22:52:30.042456+0000","last_clean":"2024-09-15T22:52:30.042456+0000","last_became_active":"2024-09-15T22:52:27.795555+0000","last_became_peered":"2024-09-15T22:52:27.795555+0000","last_unstale":"2024-09-15T22:52:30.042456+0000","last_undegraded":"2024-09-15T22:52:30.042456+0000","last_fullsized":"2024-09-15T22:52:30.042456+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:08:45.377865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042517+0000","last_change":"2024-09-15T22:52:26.782756+0000","last_active":"2024-09-15T22:52:30.042517+0000","last_peered":"2024-09-15T22:52:30.042517+0000","last_clean":"2024-09-15T22:52:30.042517+0000","last_became_active":"2024-09-15T22:52:26.782480+0000","last_became_peered":"2024-09-15T22:52:26.782480+0000","last_unstale":"2024-09-15T22:52:30.042517+0000","last_undegraded":"2024-09-15T22:52:30.042517+0000","last_fullsized":"2024-09-15T22:52:30.042517+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:07:56.081977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774485+0000","last_change":"2024-09-15T22:52:27.784266+0000","last_active":"2024-09-15T22:52:28.774485+0000","last_peered":"2024-09-15T22:52:28.774485+0000","last_clean":"2024-09-15T22:52:28.774485+0000","last_became_active":"2024-09-15T22:52:27.783953+0000","last_became_peered":"2024-09-15T22:52:27.783953+0000","last_unstale":"2024-09-15T22:52:28.774485+0000","last_undegraded":"2024-09-15T22:52:28.774485+0000","last_fullsized":"2024-09-15T22:52:28.774485+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:58:48.069621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"56'2","reported_seq":16,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042267+0000","last_change":"2024-09-15T22:52:26.782664+0000","last_active":"2024-09-15T22:52:30.042267+0000","last_peered":"2024-09-15T22:52:30.042267+0000","last_clean":"2024-09-15T22:52:30.042267+0000","last_became_active":"2024-09-15T22:52:26.782410+0000","last_became_peered":"2024-09-15T22:52:26.782410+0000","last_unstale":"2024-09-15T22:52:30.042267+0000","last_undegraded":"2024-09-15T22:52:30.042267+0000","last_fullsized":"2024-09-15T22:52:30.042267+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:59:37.814422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042271+0000","last_change":"2024-09-15T22:52:27.790909+0000","last_active":"2024-09-15T22:52:30.042271+0000","last_peered":"2024-09-15T22:52:30.042271+0000","last_clean":"2024-09-15T22:52:30.042271+0000","last_became_active":"2024-09-15T22:52:27.790493+0000","last_became_peered":"2024-09-15T22:52:27.790493+0000","last_unstale":"2024-09-15T22:52:30.042271+0000","last_undegraded":"2024-09-15T22:52:30.042271+0000","last_fullsized":"2024-09-15T22:52:30.042271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:39:21.497383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811667+0000","last_change":"2024-09-15T22:52:26.784628+0000","last_active":"2024-09-15T22:52:28.811667+0000","last_peered":"2024-09-15T22:52:28.811667+0000","last_clean":"2024-09-15T22:52:28.811667+0000","last_became_active":"2024-09-15T22:52:26.784293+0000","last_became_peered":"2024-09-15T22:52:26.784293+0000","last_unstale":"2024-09-15T22:52:28.811667+0000","last_undegraded":"2024-09-15T22:52:28.811667+0000","last_fullsized":"2024-09-15T22:52:28.811667+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T02:45:55.278578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394287+0000","last_change":"2024-09-15T22:52:27.789808+0000","last_active":"2024-09-15T22:52:29.394287+0000","last_peered":"2024-09-15T22:52:29.394287+0000","last_clean":"2024-09-15T22:52:29.394287+0000","last_became_active":"2024-09-15T22:52:27.789518+0000","last_became_peered":"2024-09-15T22:52:27.789518+0000","last_unstale":"2024-09-15T22:52:29.394287+0000","last_undegraded":"2024-09-15T22:52:29.394287+0000","last_fullsized":"2024-09-15T22:52:29.394287+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:43:33.679516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775420+0000","last_change":"2024-09-15T22:52:26.779223+0000","last_active":"2024-09-15T22:52:28.775420+0000","last_peered":"2024-09-15T22:52:28.775420+0000","last_clean":"2024-09-15T22:52:28.775420+0000","last_became_active":"2024-09-15T22:52:26.778968+0000","last_became_peered":"2024-09-15T22:52:26.778968+0000","last_unstale":"2024-09-15T22:52:28.775420+0000","last_undegraded":"2024-09-15T22:52:28.775420+0000","last_fullsized":"2024-09-15T22:52:28.775420+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T10:24:17.792562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775327+0000","last_change":"2024-09-15T22:52:27.800877+0000","last_active":"2024-09-15T22:52:28.775327+0000","last_peered":"2024-09-15T22:52:28.775327+0000","last_clean":"2024-09-15T22:52:28.775327+0000","last_became_active":"2024-09-15T22:52:27.800619+0000","last_became_peered":"2024-09-15T22:52:27.800619+0000","last_unstale":"2024-09-15T22:52:28.775327+0000","last_undegraded":"2024-09-15T22:52:28.775327+0000","last_fullsized":"2024-09-15T22:52:28.775327+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:21:51.540645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394413+0000","last_change":"2024-09-15T22:52:26.781554+0000","last_active":"2024-09-15T22:52:29.394413+0000","last_peered":"2024-09-15T22:52:29.394413+0000","last_clean":"2024-09-15T22:52:29.394413+0000","last_became_active":"2024-09-15T22:52:26.779958+0000","last_became_peered":"2024-09-15T22:52:26.779958+0000","last_unstale":"2024-09-15T22:52:29.394413+0000","last_undegraded":"2024-09-15T22:52:29.394413+0000","last_fullsized":"2024-09-15T22:52:29.394413+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T08:34:56.090551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774289+0000","last_change":"2024-09-15T22:52:27.783986+0000","last_active":"2024-09-15T22:52:28.774289+0000","last_peered":"2024-09-15T22:52:28.774289+0000","last_clean":"2024-09-15T22:52:28.774289+0000","last_became_active":"2024-09-15T22:52:27.783510+0000","last_became_peered":"2024-09-15T22:52:27.783510+0000","last_unstale":"2024-09-15T22:52:28.774289+0000","last_undegraded":"2024-09-15T22:52:28.774289+0000","last_fullsized":"2024-09-15T22:52:28.774289+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T07:38:16.740099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394229+0000","last_change":"2024-09-15T22:52:26.768445+0000","last_active":"2024-09-15T22:52:29.394229+0000","last_peered":"2024-09-15T22:52:29.394229+0000","last_clean":"2024-09-15T22:52:29.394229+0000","last_became_active":"2024-09-15T22:52:26.768104+0000","last_became_peered":"2024-09-15T22:52:26.768104+0000","last_unstale":"2024-09-15T22:52:29.394229+0000","last_undegraded":"2024-09-15T22:52:29.394229+0000","last_fullsized":"2024-09-15T22:52:29.394229+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:40:54.417538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.775395+0000","last_change":"2024-09-15T22:52:27.797942+0000","last_active":"2024-09-15T22:52:28.775395+0000","last_peered":"2024-09-15T22:52:28.775395+0000","last_clean":"2024-09-15T22:52:28.775395+0000","last_became_active":"2024-09-15T22:52:27.797498+0000","last_became_peered":"2024-09-15T22:52:27.797498+0000","last_unstale":"2024-09-15T22:52:28.775395+0000","last_undegraded":"2024-09-15T22:52:28.775395+0000","last_fullsized":"2024-09-15T22:52:28.775395+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T09:09:42.740480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774181+0000","last_change":"2024-09-15T22:52:26.775042+0000","last_active":"2024-09-15T22:52:28.774181+0000","last_peered":"2024-09-15T22:52:28.774181+0000","last_clean":"2024-09-15T22:52:28.774181+0000","last_became_active":"2024-09-15T22:52:26.772282+0000","last_became_peered":"2024-09-15T22:52:26.772282+0000","last_unstale":"2024-09-15T22:52:28.774181+0000","last_undegraded":"2024-09-15T22:52:28.774181+0000","last_fullsized":"2024-09-15T22:52:28.774181+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T05:57:59.871454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:29.394746+0000","last_change":"2024-09-15T22:52:27.787993+0000","last_active":"2024-09-15T22:52:29.394746+0000","last_peered":"2024-09-15T22:52:29.394746+0000","last_clean":"2024-09-15T22:52:29.394746+0000","last_became_active":"2024-09-15T22:52:27.787665+0000","last_became_peered":"2024-09-15T22:52:27.787665+0000","last_unstale":"2024-09-15T22:52:29.394746+0000","last_undegraded":"2024-09-15T22:52:29.394746+0000","last_fullsized":"2024-09-15T22:52:29.394746+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T03:22:47.744099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.774541+0000","last_change":"2024-09-15T22:52:26.773395+0000","last_active":"2024-09-15T22:52:28.774541+0000","last_peered":"2024-09-15T22:52:28.774541+0000","last_clean":"2024-09-15T22:52:28.774541+0000","last_became_active":"2024-09-15T22:52:26.773067+0000","last_became_peered":"2024-09-15T22:52:26.773067+0000","last_unstale":"2024-09-15T22:52:28.774541+0000","last_undegraded":"2024-09-15T22:52:28.774541+0000","last_fullsized":"2024-09-15T22:52:28.774541+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:00:03.865092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:30.042076+0000","last_change":"2024-09-15T22:52:27.795540+0000","last_active":"2024-09-15T22:52:30.042076+0000","last_peered":"2024-09-15T22:52:30.042076+0000","last_clean":"2024-09-15T22:52:30.042076+0000","last_became_active":"2024-09-15T22:52:27.795271+0000","last_became_peered":"2024-09-15T22:52:27.795271+0000","last_unstale":"2024-09-15T22:52:30.042076+0000","last_undegraded":"2024-09-15T22:52:30.042076+0000","last_fullsized":"2024-09-15T22:52:30.042076+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:26.748369+0000","last_clean_scrub_stamp":"2024-09-15T22:52:26.748369+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-16T23:20:06.637596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.6","version":"57'1","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.810687+0000","last_change":"2024-09-15T22:52:26.781397+0000","last_active":"2024-09-15T22:52:28.810687+0000","last_peered":"2024-09-15T22:52:28.810687+0000","last_clean":"2024-09-15T22:52:28.810687+0000","last_became_active":"2024-09-15T22:52:26.780880+0000","last_became_peered":"2024-09-15T22:52:26.780880+0000","last_unstale":"2024-09-15T22:52:28.810687+0000","last_undegraded":"2024-09-15T22:52:28.810687+0000","last_fullsized":"2024-09-15T22:52:28.810687+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:52:25.741625+0000","last_clean_scrub_stamp":"2024-09-15T22:52:25.741625+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:25:24.077185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":236,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-15T22:52:28.811152+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:52:28.811152+0000","last_peered":"2024-09-15T22:52:28.811152+0000","last_clean":"2024-09-15T22:52:28.811152+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:52:28.811152+0000","last_undegraded":"2024-09-15T22:52:28.811152+0000","last_fullsized":"2024-09-15T22:52:28.811152+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542176,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28284,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343556,"statfs":{"total":96636764160,"available":96607801344,"internally_reserved":0,"allocated":1277952,"data_stored":896460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542175,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":684032,"data_stored":306620,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542176,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27696,"kb_used_data":660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344144,"statfs":{"total":96636764160,"available":96608403456,"internally_reserved":0,"allocated":675840,"data_stored":305968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542175,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":679936,"data_stored":306550,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542176,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":692224,"data_stored":307602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542177,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":688128,"data_stored":307580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542176,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27700,"kb_used_data":668,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344140,"statfs":{"total":96636764160,"available":96608399360,"internally_reserved":0,"allocated":684032,"data_stored":306128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32440,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339400,"statfs":{"total":96636764160,"available":96603545600,"internally_reserved":0,"allocated":1277952,"data_stored":896392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:52:32.310 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:52:32.310 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-15T22:52:32.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.495+0000 7f4d3b000640 1 Processor -- start 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.495+0000 7f4d3b000640 1 -- start start 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d3b000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d34070a20 0x7f4d340b5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d3415ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d3b000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3406dde0 con 0x7f4d34070e00 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d3b000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f4d340b6fb0 con 0x7f4d34070a20 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d3b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d340b63a0 con 0x7f4d3415e850 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d34070a20 0x7f4d340b5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d2b400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f4d34070e00 0x7f4d3409b4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46066/0 (socket says 172.21.15.31:46066) 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f4d34070a20 0x7f4d340b5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50380/0 (socket says 172.21.15.31:50380) 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d2b400640 1 -- 172.21.15.31:0/4233431226 learned_addr learned my addr 172.21.15.31:0/4233431226 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:32.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d39000640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d3415ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 -- 172.21.15.31:0/4233431226 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 msgr2=0x7f4d3415ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d3415ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 -- 172.21.15.31:0/4233431226 >> v1:172.21.15.31:6789/0 conn(0x7f4d34070e00 legacy=0x7f4d3409b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 -- 172.21.15.31:0/4233431226 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d340b6680 con 0x7f4d34070a20 2024-09-15T22:52:32.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d39000640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d3415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.499+0000 7f4d33e00640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d340b5d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4d240097c0 tx=0x7f4d2401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72aee45525673d73 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33400640 1 -- 172.21.15.31:0/4233431226 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240a7070 con 0x7f4d34070a20 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33400640 1 -- 172.21.15.31:0/4233431226 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d240b0070 con 0x7f4d34070a20 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33400640 1 -- 172.21.15.31:0/4233431226 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240ab890 con 0x7f4d34070a20 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- 172.21.15.31:0/4233431226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 msgr2=0x7f4d340b5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d340b5d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4d240097c0 tx=0x7f4d2401c470 comp rx=0 tx=0).stop 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- 172.21.15.31:0/4233431226 shutdown_connections 2024-09-15T22:52:32.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d3415ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- 172.21.15.31:0/4233431226 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d340b5d50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- 172.21.15.31:0/4233431226 >> 172.21.15.31:0/4233431226 conn(0x7f4d340b3f40 msgr2=0x7f4d340b4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- 172.21.15.31:0/4233431226 shutdown_connections 2024-09-15T22:52:32.506 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- 172.21.15.31:0/4233431226 wait complete. 2024-09-15T22:52:32.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 Processor -- start 2024-09-15T22:52:32.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- start start 2024-09-15T22:52:32.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d34070e00 0x7f4d340cde20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d34160c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34071390 con 0x7f4d34070a20 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f4d34071210 con 0x7f4d34070e00 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d3b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f4d3416b0e0 con 0x7f4d3415e850 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50388/0 (socket says 172.21.15.31:50388) 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d33e00640 1 -- 172.21.15.31:0/3199371046 learned_addr learned my addr 172.21.15.31:0/3199371046 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d39000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d34160c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.503+0000 7f4d2b400640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d34070e00 0x7f4d340cde20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 -- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 msgr2=0x7f4d34160c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d34160c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 -- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d34070e00 msgr2=0x7f4d340cde20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d34070e00 0x7f4d340cde20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 -- 172.21.15.31:0/3199371046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d340b1110 con 0x7f4d34070a20 2024-09-15T22:52:32.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d33e00640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4d2401a0a0 tx=0x7f4d2401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240bf610 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d240bf7d0 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3414dc80 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d240bfbc0 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d3414e200 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d340b5d50 con 0x7f4d34070a20 2024-09-15T22:52:32.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f4d240bd020 con 0x7f4d34070a20 2024-09-15T22:52:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 0x7f4d10069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f4d24120b00 con 0x7f4d34070a20 2024-09-15T22:52:32.512 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.507+0000 7f4d2b400640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 0x7f4d10069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.513 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.511+0000 7f4d2b400640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 0x7f4d10069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d34158010 tx=0x7f4d1c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.516 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.515+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f4d340b1110 con 0x7f4d34070a20 2024-09-15T22:52:32.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.735+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f4d340b1b90 con 0x7f4d34070a20 2024-09-15T22:52:32.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.739+0000 7f4d30c00640 1 -- 172.21.15.31:0/3199371046 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) ==== 190+0+147 (secure 0 0 0) 0x7f4d24016090 con 0x7f4d34070a20 2024-09-15T22:52:32.742 INFO:teuthology.orchestra.run.smithi031.stdout:[client.0] 2024-09-15T22:52:32.743 INFO:teuthology.orchestra.run.smithi031.stdout: key = AQBsZOdmMvcVLBAADVLMqzq9PfTojTDiQTOkdg== 2024-09-15T22:52:32.743 INFO:teuthology.orchestra.run.smithi031.stdout: caps mds = "allow" 2024-09-15T22:52:32.743 INFO:teuthology.orchestra.run.smithi031.stdout: caps mon = "allow r" 2024-09-15T22:52:32.743 INFO:teuthology.orchestra.run.smithi031.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-15T22:52:32.743 INFO:teuthology.orchestra.run.smithi031.stderr:updated caps for client.0 2024-09-15T22:52:32.743 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-15T22:52:32.739+0000 7fe0f1200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 msgr2=0x7f4d10069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 0x7f4d10069db0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4d34158010 tx=0x7f4d1c009040 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 msgr2=0x7f4d3414ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f4d2401a0a0 tx=0x7f4d2401acb0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 shutdown_connections 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f4d100678f0 0x7f4d10069db0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f4d3415e850 0x7f4d34160c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f4d34070e00 0x7f4d340cde20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 --2- 172.21.15.31:0/3199371046 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f4d34070a20 0x7f4d3414ea00 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 >> 172.21.15.31:0/3199371046 conn(0x7f4d340b3f40 msgr2=0x7f4d3406dfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:32.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 shutdown_connections 2024-09-15T22:52:32.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.743+0000 7f4d3b000640 1 -- 172.21.15.31:0/3199371046 wait complete. 2024-09-15T22:52:32.765 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:32.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 Processor -- start 2024-09-15T22:52:32.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 -- start start 2024-09-15T22:52:32.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4c80b1890 0x7fe4c815f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4c80b1c70 con 0x7fe4c815ffb0 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe4c8160420 con 0x7fe4c80b1890 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.903+0000 7fe4cd000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c809af80 con 0x7fe4c806d990 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4c80b1890 0x7fe4c815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe4c80b1890 0x7fe4c815f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50402/0 (socket says 172.21.15.31:50402) 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 -- 172.21.15.31:0/457379501 learned_addr learned my addr 172.21.15.31:0/457379501 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c6800640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 -- 172.21.15.31:0/457379501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 msgr2=0x7fe4c809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c809aa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 -- 172.21.15.31:0/457379501 >> v1:172.21.15.102:6789/0 conn(0x7fe4c815ffb0 legacy=0x7fe4c806d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 -- 172.21.15.31:0/457379501 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c809b1e0 con 0x7fe4c80b1890 2024-09-15T22:52:32.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5e00640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815f810 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80098a0 tx=0x7fe4b801c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b724b044b6f15bc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5400640 1 -- 172.21.15.31:0/457379501 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80aa670 con 0x7fe4c80b1890 2024-09-15T22:52:32.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5400640 1 -- 172.21.15.31:0/457379501 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b80af070 con 0x7fe4c80b1890 2024-09-15T22:52:32.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.907+0000 7fe4c5400640 1 -- 172.21.15.31:0/457379501 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b80aaa30 con 0x7fe4c80b1890 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- 172.21.15.31:0/457379501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 msgr2=0x7fe4c815f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815f810 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80098a0 tx=0x7fe4b801c510 comp rx=0 tx=0).stop 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- 172.21.15.31:0/457379501 shutdown_connections 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c809aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- 172.21.15.31:0/457379501 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815f810 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- 172.21.15.31:0/457379501 >> 172.21.15.31:0/457379501 conn(0x7fe4c80d23b0 msgr2=0x7fe4c80d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- 172.21.15.31:0/457379501 shutdown_connections 2024-09-15T22:52:32.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- 172.21.15.31:0/457379501 wait complete. 2024-09-15T22:52:32.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 Processor -- start 2024-09-15T22:52:32.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- start start 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c80b6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c815ffb0 0x7fe4c80714c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c815e830 con 0x7fe4c80b1890 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c80d0670 con 0x7fe4c815ffb0 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4cd000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c815e9b0 con 0x7fe4c806d990 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50412/0 (socket says 172.21.15.31:50412) 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 -- 172.21.15.31:0/3141560705 learned_addr learned my addr 172.21.15.31:0/3141560705 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4c5e00640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c80b6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4c6800640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c815ffb0 0x7fe4c80714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 -- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 msgr2=0x7fe4c80b6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c80b6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 -- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c815ffb0 msgr2=0x7fe4c80714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c815ffb0 0x7fe4c80714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:32.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.911+0000 7fe4bd400640 1 -- 172.21.15.31:0/3141560705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c815cb40 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bd400640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c420 tx=0x7fe4b000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b00052d0 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4b0005470 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b0007260 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c80b5c10 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c80b64b0 con 0x7fe4c80b1890 2024-09-15T22:52:32.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c809aa40 con 0x7fe4c80b1890 2024-09-15T22:52:32.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe4b0007400 con 0x7fe4c80b1890 2024-09-15T22:52:32.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:32.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fe4b0085350 con 0x7fe4c80b1890 2024-09-15T22:52:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.915+0000 7fe4c5e00640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:32.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.919+0000 7fe4c5e00640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 0x7fe4a4069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ae000 tx=0x7fe4b80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:32.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:32.919+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe4c80b1c70 con 0x7fe4c80b1890 2024-09-15T22:52:33.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4c80d2120 con 0x7fe4c80b1890 2024-09-15T22:52:33.122 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4bea00640 1 -- 172.21.15.31:0/3141560705 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5217 (secure 0 0 0) 0x7fe4b0055610 con 0x7fe4c80b1890 2024-09-15T22:52:33.122 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:33.122 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"btime":"2024-09-15T22:52:30:802133+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3847880962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3847880962},{"type":"v1","addr":"172.21.15.102:6836","nonce":3847880962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/52513834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":52513834},{"type":"v1","addr":"172.21.15.102:6837","nonce":52513834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/411861553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":411861553},{"type":"v1","addr":"172.21.15.31:6833","nonce":411861553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:30.196577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/678504006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":678504006},{"type":"v1","addr":"172.21.15.31:6835","nonce":678504006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-15T22:52:33.123 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 33 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 msgr2=0x7fe4a4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 0x7fe4a4069d80 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe4b80ae000 tx=0x7fe4b80a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 msgr2=0x7fe4c815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe4b000c420 tx=0x7fe4b000c8e0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 shutdown_connections 2024-09-15T22:52:33.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe4a40678c0 0x7fe4a4069d80 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe4c815ffb0 0x7fe4c80714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe4c80b1890 0x7fe4c815c600 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 --2- 172.21.15.31:0/3141560705 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe4c806d990 0x7fe4c80b6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 >> 172.21.15.31:0/3141560705 conn(0x7fe4c80d23b0 msgr2=0x7fe4c8161760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 shutdown_connections 2024-09-15T22:52:33.125 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.119+0000 7fe4cd000640 1 -- 172.21.15.31:0/3141560705 wait complete. 2024-09-15T22:52:33.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:52:27.162874+0000', 'modified': '2024-09-15T22:52:30.196577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/678504006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 678504006}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 678504006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-09-15T22:52:33.546 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:52:33.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:52:33.690 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 Processor -- start 2024-09-15T22:52:33.691 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 -- start start 2024-09-15T22:52:33.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f6013fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0f6006e160 0x7f0f6006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f601407b0 con 0x7f0f60072160 2024-09-15T22:52:33.693 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0f6013f640 con 0x7f0f6006e160 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f66800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f601413c0 con 0x7f0f6013fa40 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f5f400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0f60072160 0x7f0f60072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:46074/0 (socket says 172.21.15.31:46074) 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f5f400640 1 -- 172.21.15.31:0/972312169 learned_addr learned my addr 172.21.15.31:0/972312169 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f56a00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f6013fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/972312169 >> v2:172.21.15.102:3300/0 conn(0x7f0f6006e160 0x7f0f6006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469233750 0 0) 0x7f0f601407b0 con 0x7f0f60072160 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.687+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f44003530 con 0x7f0f60072160 2024-09-15T22:52:33.694 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2963003657 0 0) 0x7f0f44003530 con 0x7f0f60072160 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 msgr2=0x7f0f6013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f6013fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 >> v2:172.21.15.102:3300/0 conn(0x7f0f6006e160 msgr2=0x7f0f6006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 --2- 172.21.15.31:0/972312169 >> v2:172.21.15.102:3300/0 conn(0x7f0f6006e160 0x7f0f6006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f60140a90 con 0x7f0f60072160 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f0f50001680 con 0x7f0f60072160 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 >> v1:172.21.15.31:6789/0 conn(0x7f0f60072160 legacy=0x7f0f60072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f440039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f44004d50 0x7f0f440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6013f640 con 0x7f0f44003f90 2024-09-15T22:52:33.695 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601413c0 con 0x7f0f44004d50 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f4400fe90 con 0x7f0f6013fa40 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5f400640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f440039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f44004d50 0x7f0f440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 -- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 msgr2=0x7f0f440039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f6013fa40 0x7f0f440039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 -- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f44004d50 msgr2=0x7f0f440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f44004d50 0x7f0f440051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.696 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 -- 172.21.15.31:0/972312169 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f44003530 con 0x7f0f44003f90 2024-09-15T22:52:33.697 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.691+0000 7f0f56a00640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f44004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009ab0 tx=0x7f0f4801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7bac2602d7e8fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480096b0 con 0x7f0f44003f90 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f480a6430 con 0x7f0f44003f90 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5ea00640 1 -- 172.21.15.31:0/972312169 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f480a6820 con 0x7f0f44003f90 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- 172.21.15.31:0/972312169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 msgr2=0x7f0f44004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 --2- 172.21.15.31:0/972312169 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f44004810 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f0f48009ab0 tx=0x7f0f4801ca50 comp rx=0 tx=0).stop 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5fe00640 1 -- 172.21.15.31:0/972312169 reap_dead start 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- 172.21.15.31:0/972312169 shutdown_connections 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- 172.21.15.31:0/972312169 >> 172.21.15.31:0/972312169 conn(0x7f0f60067e00 msgr2=0x7f0f6006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- 172.21.15.31:0/972312169 shutdown_connections 2024-09-15T22:52:33.698 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- 172.21.15.31:0/972312169 wait complete. 2024-09-15T22:52:33.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 Processor -- start 2024-09-15T22:52:33.699 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- start start 2024-09-15T22:52:33.700 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f60162790 0x7f0f601380a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6013ad50 0x7f0f6013b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6006ef20 con 0x7f0f44003f90 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6006eda0 con 0x7f0f6013ad50 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f66800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f6006f0a0 con 0x7f0f60162790 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50442/0 (socket says 172.21.15.31:50442) 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.695+0000 7f0f5f400640 1 -- 172.21.15.31:0/1951047757 learned_addr learned my addr 172.21.15.31:0/1951047757 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 -- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f60162790 msgr2=0x7f0f601380a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f60162790 0x7f0f601380a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 -- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6013ad50 msgr2=0x7f0f6013b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.701 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6013ad50 0x7f0f6013b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 -- 172.21.15.31:0/1951047757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f60143bd0 con 0x7f0f44003f90 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0f50001060 tx=0x7f0f500077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 -- 172.21.15.31:0/1951047757 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50007e30 con 0x7f0f44003f90 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 -- 172.21.15.31:0/1951047757 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50018070 con 0x7f0f44003f90 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f60143eb0 con 0x7f0f44003f90 2024-09-15T22:52:33.702 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 -- 172.21.15.31:0/1951047757 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000fb50 con 0x7f0f44003f90 2024-09-15T22:52:33.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f60158430 con 0x7f0f44003f90 2024-09-15T22:52:33.703 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 -- 172.21.15.31:0/1951047757 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0f5000fcf0 con 0x7f0f44003f90 2024-09-15T22:52:33.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 0x7f0f3c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f57e00640 1 -- 172.21.15.31:0/1951047757 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0f50085f10 con 0x7f0f44003f90 2024-09-15T22:52:33.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.699+0000 7f0f56a00640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 0x7f0f3c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.704 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 Processor -- start 2024-09-15T22:52:33.705 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- start start 2024-09-15T22:52:33.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f56a00640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 0x7f0f3c069db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f480ad000 tx=0x7f0f480a9040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.706 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a54d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a55290 0x559520a55670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x55952093cb60 con 0x559520a9eb20 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5595208a3c70 con 0x559520a55290 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x559520849ed0 con 0x559520a9f440 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50456/0 (socket says 172.21.15.31:50456) 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 -- 172.21.15.31:0/1101521251 learned_addr learned my addr 172.21.15.31:0/1101521251 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f56a00640 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a54d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a55290 0x559520a55670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 -- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 msgr2=0x559520a54d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a54d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 -- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a55290 msgr2=0x559520a55670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a55290 0x559520a55670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 -- 172.21.15.31:0/1101521251 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952085be50 con 0x559520a9eb20 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f5f400640 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0f50084180 tx=0x7f0f500524f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5166ec9734cf46 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f4fe00640 1 -- 172.21.15.31:0/1101521251 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5005ed00 con 0x559520a9eb20 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f4fe00640 1 -- 172.21.15.31:0/1101521251 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50054420 con 0x559520a9eb20 2024-09-15T22:52:33.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f4fe00640 1 -- 172.21.15.31:0/1101521251 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f50052790 con 0x559520a9eb20 2024-09-15T22:52:33.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- 172.21.15.31:0/1101521251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 msgr2=0x559520a9ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f0f50084180 tx=0x7f0f500524f0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- 172.21.15.31:0/1101521251 shutdown_connections 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a55290 0x559520a55670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a54d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 --2- 172.21.15.31:0/1101521251 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520a9ef00 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- 172.21.15.31:0/1101521251 >> 172.21.15.31:0/1101521251 conn(0x559520a5b600 msgr2=0x559520a53630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- 172.21.15.31:0/1101521251 shutdown_connections 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- 172.21.15.31:0/1101521251 wait complete. 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.703+0000 7f0f69c87000 1 -- start start 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 Processor -- start 2024-09-15T22:52:33.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520a59e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a5fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x559520905b00 con 0x559520a5a390 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55952087e360 con 0x559520a9eb20 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x55952087b2d0 con 0x559520a9f440 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 10 client.0 _ll_register_callbacks cb 0x559520a40820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50462/0 (socket says 172.21.15.31:50462) 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 -- 172.21.15.31:0/2170946518 learned_addr learned my addr 172.21.15.31:0/2170946518 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f56a00640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a5fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5f400640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520a59e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 -- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 msgr2=0x559520a5fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a5fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 -- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 msgr2=0x559520a59e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520a59e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 -- 172.21.15.31:0/2170946518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55952084a120 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0f600b3590 tx=0x7f0f58014e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e906451b916ac3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012d60 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0f5801e420 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f50054420 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0f5801e620 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 10 client.5454 fetch_fsmap learned FSMap version 33 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x559520843450 con 0x559520a5a390 2024-09-15T22:52:33.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f50054420 con 0x559520a5a390 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 33) ==== 3502+0+0 (secure 0 0 0) 0x7f0f5802b080 con 0x559520a5a390 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 10 client.5454 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 10 client.5454 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 20 client.5454 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520aad280 0x559520aaf670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 4 client.5454 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 --> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55952083dc00 con 0x559520aad280 2024-09-15T22:52:33.715 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.707+0000 7f0f5f400640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520aad280 0x559520aaf670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f5f400640 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520aad280 0x559520aaf670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a815d4e942457ff4 server_cookie=5d8710c7a6a29859 in_seq=0 out_seq=0 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f4cc00640 10 client.5454 ms_handle_connect on v2:172.21.15.31:6834/678504006 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f4cc00640 1 -- 172.21.15.31:0/2170946518 <== mds.0 v2:172.21.15.31:6834/678504006 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55952083dc00 con 0x559520aad280 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f4cc00640 10 client.5454 handle_command_reply: tid=0 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 client.5454 shutdown 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 msgr2=0x559520a60230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0f600b3590 tx=0x7f0f58014e70 comp rx=0 tx=0).stop 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 shutdown_connections 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520aad280 0x559520aaf670 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a5a390 0x559520a60230 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a9f440 0x559520a5fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 --2- 172.21.15.31:0/2170946518 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520a59e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 >> 172.21.15.31:0/2170946518 conn(0x559520a55290 msgr2=0x559520a53d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f4cc00640 0 client.5454 ms_handle_reset on v2:172.21.15.31:6834/678504006 2024-09-15T22:52:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 shutdown_connections 2024-09-15T22:52:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 1 -- 172.21.15.31:0/2170946518 wait complete. 2024-09-15T22:52:33.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.711+0000 7f0f69c87000 20 client.5454 trim_cache size 0 max 16384 2024-09-15T22:52:33.732 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.727+0000 7f0f69c87000 1 Processor -- start 2024-09-15T22:52:33.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- start start 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 0x559520a9dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a5a390 0x559520a9e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0f601ff340 con 0x559520a9eb20 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0f60159c40 con 0x559520a5a390 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0f601fecf0 con 0x559520a55290 2024-09-15T22:52:33.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50464/0 (socket says 172.21.15.31:50464) 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 -- 172.21.15.31:0/3233437738 learned_addr learned my addr 172.21.15.31:0/3233437738 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f56a00640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a5a390 0x559520a9e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5f400640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 0x559520a9dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 -- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 msgr2=0x559520a9dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 0x559520a9dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 -- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a5a390 msgr2=0x559520a9e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a5a390 0x559520a9e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 -- 172.21.15.31:0/3233437738 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952082afd0 con 0x559520a9eb20 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5f400640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 0x559520a9dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:33.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007080 tx=0x7f0f58019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a724b6421b6b05 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f4f400640 1 -- 172.21.15.31:0/3233437738 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58012b60 con 0x559520a9eb20 2024-09-15T22:52:33.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f4f400640 1 -- 172.21.15.31:0/3233437738 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f58012d00 con 0x559520a9eb20 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f4f400640 1 -- 172.21.15.31:0/3233437738 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f58003be0 con 0x559520a9eb20 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- 172.21.15.31:0/3233437738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 msgr2=0x559520aaf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0f58007080 tx=0x7f0f58019000 comp rx=0 tx=0).stop 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- 172.21.15.31:0/3233437738 shutdown_connections 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a9eb20 0x559520aaf290 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a5a390 0x559520a9e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3233437738 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a55290 0x559520a9dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- 172.21.15.31:0/3233437738 >> 172.21.15.31:0/3233437738 conn(0x559520aaa040 msgr2=0x559520a59650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- 172.21.15.31:0/3233437738 shutdown_connections 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- 172.21.15.31:0/3233437738 wait complete. 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 -- start start 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.731+0000 7f0f69c87000 1 Processor -- start 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a5a390 0x559520acd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520acdea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5595208a2f80 con 0x559520a55290 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x55952085bca0 con 0x559520a9eb20 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5595208a82a0 con 0x559520a5a390 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 10 client.0 _ll_register_callbacks cb 0x7f0f58009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50472/0 (socket says 172.21.15.31:50472) 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 -- 172.21.15.31:0/3810123174 learned_addr learned my addr 172.21.15.31:0/3810123174 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f56a00640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a5a390 0x559520acd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5fe00640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520acdea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 -- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a5a390 msgr2=0x559520acd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a5a390 0x559520acd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 -- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 msgr2=0x559520acdea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520acdea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 -- 172.21.15.31:0/3810123174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559520926750 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f5f400640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0f50052580 tx=0x7f0f50059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36bbf20c7f31188e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5005ed00 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f0f50054420 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f58012d00 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f0f5005a160 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 10 client.5460 fetch_fsmap learned FSMap version 33 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) -- 0x559520831a30 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f58012d00 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 33) ==== 3502+0+0 (secure 0 0 0) 0x7f0f50052790 con 0x559520a55290 2024-09-15T22:52:33.742 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 10 client.5460 fetch_fsmap finished waiting for FSMap version 33 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 10 client.5460 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 20 client.5460 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520a9f440 0x559520ace3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 4 client.5460 mds_command: new command op to 5328 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 --> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] -- command(tid 0: {"prefix": "status"}) -- 0x5595208b13a0 con 0x559520a9f440 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f56a00640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520a9f440 0x559520ace3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f56a00640 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520a9f440 0x559520ace3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a76c217abe21d6 server_cookie=8dd67533bdf9986b in_seq=0 out_seq=0 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 10 client.5460 ms_handle_connect on v2:172.21.15.31:6834/678504006 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 1 -- 172.21.15.31:0/3810123174 <== mds.0 v2:172.21.15.31:6834/678504006 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5595208b13a0 con 0x559520a9f440 2024-09-15T22:52:33.743 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 10 client.5460 handle_command_reply: tid=0 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 client.5460 shutdown 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 msgr2=0x559520ab2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0f50052580 tx=0x7f0f50059000 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 shutdown_connections 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:6834/678504006,v1:172.21.15.31:6835/678504006] conn(0x559520a9f440 0x559520ace3e0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x559520a9eb20 0x559520acdea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x559520a5a390 0x559520acd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f4cc00640 0 client.5460 ms_handle_reset on v2:172.21.15.31:6834/678504006 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 --2- 172.21.15.31:0/3810123174 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x559520a55290 0x559520ab2120 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 >> 172.21.15.31:0/3810123174 conn(0x559520aaa040 msgr2=0x559520a9ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 shutdown_connections 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 1 -- 172.21.15.31:0/3810123174 wait complete. 2024-09-15T22:52:33.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.735+0000 7f0f69c87000 20 client.5460 trim_cache size 0 max 16384 2024-09-15T22:52:33.745 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:52:33.745 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:52:33.745 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:52:33.745 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5328, 2024-09-15T22:52:33.745 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.9431233179999996, 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 33, 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 57, 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 57, 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 11.850674872000001 2024-09-15T22:52:33.746 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 msgr2=0x7f0f3c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 0x7f0f3c069db0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0f480ad000 tx=0x7f0f480a9040 comp rx=0 tx=0).stop 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 msgr2=0x7f0f60143480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f0f50001060 tx=0x7f0f500077a0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 shutdown_connections 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0f3c0678f0 0x7f0f3c069db0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0f6013ad50 0x7f0f6013b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0f60162790 0x7f0f601380a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 --2- 172.21.15.31:0/1951047757 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0f44003f90 0x7f0f60143480 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 >> 172.21.15.31:0/1951047757 conn(0x7f0f60067e00 msgr2=0x7f0f600b4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 shutdown_connections 2024-09-15T22:52:33.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.739+0000 7f0f66800640 1 -- 172.21.15.31:0/1951047757 wait complete. 2024-09-15T22:52:33.760 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-15T22:52:33.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 Processor -- start 2024-09-15T22:52:33.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 -- start start 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb780b6d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7806c3d0 0x7fdb780aeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb780ae0e0 con 0x7fdb78070830 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fdb78148190 con 0x7fdb7806c3d0 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdb78070ff0 con 0x7fdb78147db0 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7806c3d0 0x7fdb780aeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fdb7806c3d0 0x7fdb780aeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50486/0 (socket says 172.21.15.31:50486) 2024-09-15T22:52:33.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 -- 172.21.15.31:0/414357514 learned_addr learned my addr 172.21.15.31:0/414357514 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb76a00640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb780b6d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 -- 172.21.15.31:0/414357514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 msgr2=0x7fdb780b6d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb780b6d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 -- 172.21.15.31:0/414357514 >> v1:172.21.15.102:6789/0 conn(0x7fdb78070830 legacy=0x7fdb7806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.899+0000 7fdb77400640 1 -- 172.21.15.31:0/414357514 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb780ae3c0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77400640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb780aeea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009e50 tx=0x7fdb7001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60baff99a70528b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb76000640 1 -- 172.21.15.31:0/414357514 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb700a5830 con 0x7fdb7806c3d0 2024-09-15T22:52:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb76000640 1 -- 172.21.15.31:0/414357514 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb700a59d0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb76000640 1 -- 172.21.15.31:0/414357514 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb700a5da0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- 172.21.15.31:0/414357514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 msgr2=0x7fdb780aeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb780aeea0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fdb70009e50 tx=0x7fdb7001c970 comp rx=0 tx=0).stop 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- 172.21.15.31:0/414357514 shutdown_connections 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb780aeea0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 --2- 172.21.15.31:0/414357514 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb780b6d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- 172.21.15.31:0/414357514 >> 172.21.15.31:0/414357514 conn(0x7fdb7809aa40 msgr2=0x7fdb780b6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- 172.21.15.31:0/414357514 shutdown_connections 2024-09-15T22:52:33.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- 172.21.15.31:0/414357514 wait complete. 2024-09-15T22:52:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 Processor -- start 2024-09-15T22:52:33.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.903+0000 7fdb77e00640 1 -- start start 2024-09-15T22:52:33.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb78070830 0x7fdb781401b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb78145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdb780afd70 con 0x7fdb7806c3d0 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdb780afbf0 con 0x7fdb78070830 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdb780afef0 con 0x7fdb78147db0 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:50492/0 (socket says 172.21.15.31:50492) 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 -- 172.21.15.31:0/197303025 learned_addr learned my addr 172.21.15.31:0/197303025 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77400640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb78145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb6fe00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb78070830 0x7fdb781401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 -- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 msgr2=0x7fdb78145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb78145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 -- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb78070830 msgr2=0x7fdb781401b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:33.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb78070830 0x7fdb781401b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:33.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 -- 172.21.15.31:0/197303025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb78140f60 con 0x7fdb7806c3d0 2024-09-15T22:52:33.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77400640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb78145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:33.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb76a00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800d5f0 tx=0x7fdb6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680125f0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb68019070 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb680129d0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb78141240 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb78141800 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb780aeea0 con 0x7fdb7806c3d0 2024-09-15T22:52:33.912 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.907+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fdb68012b70 con 0x7fdb7806c3d0 2024-09-15T22:52:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.911+0000 7fdb6ea00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 0x7fdb54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.911+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7fdb68086260 con 0x7fdb7806c3d0 2024-09-15T22:52:33.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.911+0000 7fdb6fe00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 0x7fdb54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:33.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.911+0000 7fdb6fe00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 0x7fdb54069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb781fa700 tx=0x7fdb60009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:33.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:33.915+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fdb68056ca0 con 0x7fdb7806c3d0 2024-09-15T22:52:34.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fdb7813e310 con 0x7fdb7806c3d0 2024-09-15T22:52:34.118 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb6ea00640 1 -- 172.21.15.31:0/197303025 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) ==== 53+0+73 (secure 0 0 0) 0x7fdb680565a0 con 0x7fdb7806c3d0 2024-09-15T22:52:34.118 INFO:teuthology.orchestra.run.smithi031.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-15T22:52:34.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 msgr2=0x7fdb54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:34.120 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 0x7fdb54069d80 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdb781fa700 tx=0x7fdb60009040 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 msgr2=0x7fdb7815d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fdb6800d5f0 tx=0x7fdb6800dab0 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 shutdown_connections 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fdb540678c0 0x7fdb54069d80 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdb78147db0 0x7fdb78145040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdb78070830 0x7fdb781401b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 --2- 172.21.15.31:0/197303025 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fdb7806c3d0 0x7fdb7815d8f0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 >> 172.21.15.31:0/197303025 conn(0x7fdb7809aa40 msgr2=0x7fdb7815fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 shutdown_connections 2024-09-15T22:52:34.121 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34.115+0000 7fdb77e00640 1 -- 172.21.15.31:0/197303025 wait complete. 2024-09-15T22:52:34.139 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-15T22:52:34.139 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-15T22:52:34.139 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi031.front.sepia.ceph.com 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-15T22:52:34.140 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:52:34.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.140 DEBUG:teuthology.orchestra.run.smithi031:> ip addr 2024-09-15T22:52:34.149 INFO:teuthology.orchestra.run.smithi031.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-15T22:52:34.149 INFO:teuthology.orchestra.run.smithi031.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-15T22:52:34.149 INFO:teuthology.orchestra.run.smithi031.stdout: inet 127.0.0.1/8 scope host lo 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 ::1/128 scope host 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f0 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0c:c4:7a:6b:f6:cd brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp7s0f1 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:ba brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f0 2024-09-15T22:52:34.150 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.21.15.31/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft 42318sec preferred_lft 42318sec 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::ae1f:6bff:fea5:caba/64 scope link 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether ac:1f:6b:a5:ca:bb brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: altname enp1s0f1 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 02:42:d8:cd:ab:cc brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout:9: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-09-15T22:52:34.151 INFO:teuthology.orchestra.run.smithi031.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout:10: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout:11: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-09-15T22:52:34.152 INFO:teuthology.orchestra.run.smithi031.stdout: valid_lft forever preferred_lft forever 2024-09-15T22:52:34.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.153 DEBUG:teuthology.orchestra.run.smithi031:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-15T22:52:34.214 INFO:teuthology.orchestra.run.smithi031.stdout:1 2024-09-15T22:52:34.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.216 DEBUG:teuthology.orchestra.run.smithi031:> route 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:Kernel IP routing table 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-09-15T22:52:34.274 INFO:teuthology.orchestra.run.smithi031.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-15T22:52:34.274 DEBUG:teuthology.orchestra.run.smithi031:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-15T22:52:34.274 DEBUG:teuthology.orchestra.run.smithi031:> set -e 2024-09-15T22:52:34.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-15T22:52:34.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-15T22:52:34.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-15T22:52:34.275 DEBUG:teuthology.orchestra.run.smithi031:> ') 2024-09-15T22:52:34.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-15T22:52:34.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:34.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.412 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:52:34.421 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:52:34.421 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:52:34.422 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:52:34.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.422 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link set brx.0 up 2024-09-15T22:52:34.488 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:52:34.488 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:34.540 INFO:teuthology.orchestra.run.smithi031.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-15T22:52:34.540 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-15T22:52:34.540 DEBUG:teuthology.orchestra.run.smithi031:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:34.596 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-15T22:52:34.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:52:34.693 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:52:34.693 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:52:34.693 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:52:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:52:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:52:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:52:34.708 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:52:34.709 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:52:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-15T22:52:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-15T22:52:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:invalid new device string format 2024-09-15T22:52:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:3300,172.21.15.102:3300,172.21.15.102:3301" 2024-09-15T22:52:34.719 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-15T22:52:34.720 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: resolved to: "172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790" 2024-09-15T22:52:34.720 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.31:6789,172.21.15.102:6789,172.21.15.102:6790:/ 2024-09-15T22:52:34.720 INFO:teuthology.orchestra.run.smithi031.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=e1487968-efb4-47ad-8070-6e7082115957" will pass to kernel 2024-09-15T22:52:34.724 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-15T22:52:34.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:34.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:34.744 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-15T22:52:34.838 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-15T22:52:34.845 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:34.851 INFO:teuthology.orchestra.run.smithi031.stdout:client5039 2024-09-15T22:52:34.852 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:34.852 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:34.862 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:52:34.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-15T22:52:34.948 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:52:34.949 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.950 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.951 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-15T22:52:34.952 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:52:34.953 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:52:34.954 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.955 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:52:34.956 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:34.957 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-15T22:52:34.958 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-09-15T22:52:34.959 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi031.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-09-15T22:52:34.960 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-15T22:52:34.961 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-15T22:52:34.962 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-15T22:52:34.963 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-15T22:52:34.964 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.965 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-15T22:52:34.966 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:34.967 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:52:34.968 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:52:34.969 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-15T22:52:34.970 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:52:34.971 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:52:34.972 INFO:teuthology.orchestra.run.smithi102.stdout: osd_deep_scrub_large_omap_object_key_threshold = 1 2024-09-15T22:52:34.974 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-15T22:52:34.974 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-15T22:52:34.974 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:52:34.974 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:34.975 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-15T22:52:34.975 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-15T22:52:34.975 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:52:34.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:34.975 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-15T22:52:34.975 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-15T22:52:34.975 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:52:34.975 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:34.976 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-15T22:52:34.976 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-15T22:52:34.976 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:52:34.976 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:52:34.989 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:52:34.989 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-15T22:52:34.990 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:52:34.990 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-15T22:52:35.033 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:52:35.033 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-15T22:52:35.034 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:52:35.034 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-15T22:52:35.039 INFO:tasks.ceph.mds.b:Started 2024-09-15T22:52:35.039 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:35.040 INFO:tasks.ceph.mds.d:Started 2024-09-15T22:52:35.040 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:35.079 INFO:tasks.ceph.mds.a:Started 2024-09-15T22:52:35.080 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:35.081 INFO:tasks.ceph.mds.c:Started 2024-09-15T22:52:35.081 DEBUG:teuthology.parallel:result is None 2024-09-15T22:52:35.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:35.123 INFO:tasks.ceph.mds.b.smithi102.stdout:starting mds.b at 2024-09-15T22:52:35.124 INFO:tasks.ceph.mds.d.smithi102.stdout:starting mds.d at 2024-09-15T22:52:35.167 INFO:tasks.ceph.mds.c.smithi031.stdout:starting mds.c at 2024-09-15T22:52:35.167 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:52:35.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 Processor -- start 2024-09-15T22:52:35.229 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 -- start start 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59c8159ef0 0x7f59c80aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c815d420 0x7f59c80d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 0x7f59c80d0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f59c80afb10 con 0x7f59c8159ef0 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f59c80af830 con 0x7f59c80cf7f0 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59cd400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59c815c940 con 0x7f59c815d420 2024-09-15T22:52:35.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59c8159ef0 0x7f59c80aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f59c8159ef0 0x7f59c80aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44560/0 (socket says 172.21.15.31:44560) 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 -- 172.21.15.31:0/1044746507 learned_addr learned my addr 172.21.15.31:0/1044746507 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c7200640 1 --2- 172.21.15.31:0/1044746507 >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 0x7f59c80d0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59bde00640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c815d420 0x7f59c80d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 -- 172.21.15.31:0/1044746507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c815d420 msgr2=0x7f59c80d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c815d420 0x7f59c80d00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 -- 172.21.15.31:0/1044746507 >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 msgr2=0x7f59c80d0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 --2- 172.21.15.31:0/1044746507 >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 0x7f59c80d0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c6800640 1 -- 172.21.15.31:0/1044746507 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c815cc20 con 0x7f59c8159ef0 2024-09-15T22:52:35.232 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.227+0000 7f59c7200640 1 --2- 172.21.15.31:0/1044746507 >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 0x7f59c80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:35.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59c6800640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c8159ef0 0x7f59c80aef00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59c80d1210 tx=0x7f59b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba721bbe49341f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59c5e00640 1 -- 172.21.15.31:0/1044746507 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80aa430 con 0x7f59c8159ef0 2024-09-15T22:52:35.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59c5e00640 1 -- 172.21.15.31:0/1044746507 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59b80af070 con 0x7f59c8159ef0 2024-09-15T22:52:35.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59c5e00640 1 -- 172.21.15.31:0/1044746507 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59b80aa7f0 con 0x7f59c8159ef0 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 -- 172.21.15.31:0/1044746507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c8159ef0 msgr2=0x7f59c80aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c8159ef0 0x7f59c80aef00 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f59c80d1210 tx=0x7f59b801c4f0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 -- 172.21.15.31:0/1044746507 shutdown_connections 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 --2- 172.21.15.31:0/1044746507 >> v2:172.21.15.102:3300/0 conn(0x7f59c80cf7f0 0x7f59c80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c815d420 0x7f59c80d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 --2- 172.21.15.31:0/1044746507 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c8159ef0 0x7f59c80aef00 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 -- 172.21.15.31:0/1044746507 >> 172.21.15.31:0/1044746507 conn(0x7f59c80b20a0 msgr2=0x7f59c80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 -- 172.21.15.31:0/1044746507 shutdown_connections 2024-09-15T22:52:35.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.231+0000 7f59cd400640 1 -- 172.21.15.31:0/1044746507 wait complete. 2024-09-15T22:52:35.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 Processor -- start 2024-09-15T22:52:35.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- start start 2024-09-15T22:52:35.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c80cf7f0 0x7f59c8146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8159ef0 0x7f59c81f6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f59c8160930 con 0x7f59c815d420 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f59c81607b0 con 0x7f59c8159ef0 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f59c8160ab0 con 0x7f59c80cf7f0 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44570/0 (socket says 172.21.15.31:44570) 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 -- 172.21.15.31:0/2600605606 learned_addr learned my addr 172.21.15.31:0/2600605606 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59bde00640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8159ef0 0x7f59c81f6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c6800640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c80cf7f0 0x7f59c8146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 -- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c80cf7f0 msgr2=0x7f59c8146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c80cf7f0 0x7f59c8146320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 -- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8159ef0 msgr2=0x7f59c81f6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8159ef0 0x7f59c81f6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.239 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 -- 172.21.15.31:0/2600605606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c8154da0 con 0x7f59c815d420 2024-09-15T22:52:35.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59c7200640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009fa0 tx=0x7f59c000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c001a070 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59c0003bc0 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c0004030 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c8155080 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c8155640 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.235+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c80aef00 con 0x7f59c815d420 2024-09-15T22:52:35.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.239+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f59c001d070 con 0x7f59c815d420 2024-09-15T22:52:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.239+0000 7f59bf400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 0x7f59a4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.239+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 6101+0+0 (secure 0 0 0) 0x7f59c00860b0 con 0x7f59c815d420 2024-09-15T22:52:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.239+0000 7f59c6800640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 0x7f59a4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:35.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.239+0000 7f59c6800640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 0x7f59a4069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59b80ae000 tx=0x7f59b80a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:35.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.243+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f59c0010070 con 0x7f59c815d420 2024-09-15T22:52:35.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.439+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59c80b4330 con 0x7f59c815d420 2024-09-15T22:52:35.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.439+0000 7f59bf400640 1 -- 172.21.15.31:0/2600605606 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+5217 (secure 0 0 0) 0x7f59c0056400 con 0x7f59c815d420 2024-09-15T22:52:35.444 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:35.444 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":33,"btime":"2024-09-15T22:52:30:802133+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4946,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/3847880962","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":3847880962},{"type":"v1","addr":"172.21.15.102:6836","nonce":3847880962}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5316,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/52513834","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":52513834},{"type":"v1","addr":"172.21.15.102:6837","nonce":52513834}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5319,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6833/411861553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":411861553},{"type":"v1","addr":"172.21.15.31:6833","nonce":411861553}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:30.196577+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5328},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5328":{"gid":5328,"name":"a","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.31:6835/678504006","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6834","nonce":678504006},{"type":"v1","addr":"172.21.15.31:6835","nonce":678504006}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5328,"qdb_cluster":[5328]},"id":3}]} 2024-09-15T22:52:35.444 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 33 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 msgr2=0x7f59a4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 0x7f59a4069db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f59b80ae000 tx=0x7f59b80a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 msgr2=0x7f59c8156c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f59c0009fa0 tx=0x7f59c000d560 comp rx=0 tx=0).stop 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 shutdown_connections 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f59a40678f0 0x7f59a4069db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f59c815d420 0x7f59c8156c90 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f59c8159ef0 0x7f59c81f6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 --2- 172.21.15.31:0/2600605606 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f59c80cf7f0 0x7f59c8146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 >> 172.21.15.31:0/2600605606 conn(0x7f59c80b20a0 msgr2=0x7f59c80b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 shutdown_connections 2024-09-15T22:52:35.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:35.443+0000 7f59cd400640 1 -- 172.21.15.31:0/2600605606 wait complete. 2024-09-15T22:52:35.837 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-15T22:52:35.835+0000 7f89b1400640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:52:35.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:52:27.162874+0000', 'modified': '2024-09-15T22:52:30.196577+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5328}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5328': {'gid': 5328, 'name': 'a', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.31:6835/678504006', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6834', 'nonce': 678504006}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 678504006}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5328, 'qdb_cluster': [5328]} 2024-09-15T22:52:35.868 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:52:35.868 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:52:36.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 Processor -- start 2024-09-15T22:52:36.011 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 -- start start 2024-09-15T22:52:36.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 0x7fcaf00d0d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcaf009aa40 0x7fcaf009aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf0072160 con 0x7fcaf015f870 2024-09-15T22:52:36.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf009b3f0 con 0x7fcaf009aa40 2024-09-15T22:52:36.012 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaf5200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf009b780 con 0x7fcaf015fc50 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.007+0000 7fcaee800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcaf009aa40 0x7fcaf009aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcaf009aa40 0x7fcaf009aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44572/0 (socket says 172.21.15.31:44572) 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 -- 172.21.15.31:0/1951097155 learned_addr learned my addr 172.21.15.31:0/1951097155 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaed400640 1 --2- 172.21.15.31:0/1951097155 >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 0x7fcaf00d0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 -- 172.21.15.31:0/1951097155 >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 msgr2=0x7fcaf00d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.013 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 --2- 172.21.15.31:0/1951097155 >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 0x7fcaf00d0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 -- 172.21.15.31:0/1951097155 >> v1:172.21.15.102:6789/0 conn(0x7fcaf015f870 legacy=0x7fcaf00ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 -- 172.21.15.31:0/1951097155 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf009b9d0 con 0x7fcaf009aa40 2024-09-15T22:52:36.014 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaed400640 1 --2- 172.21.15.31:0/1951097155 >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 0x7fcaf00d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:36.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaee800640 1 --2- 172.21.15.31:0/1951097155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf009aa40 0x7fcaf009aeb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00735d0 tx=0x7fcae801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9528231aa79319b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaeca00640 1 -- 172.21.15.31:0/1951097155 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b0070 con 0x7fcaf009aa40 2024-09-15T22:52:36.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaeca00640 1 -- 172.21.15.31:0/1951097155 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80ab600 con 0x7fcaf009aa40 2024-09-15T22:52:36.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.011+0000 7fcaeca00640 1 -- 172.21.15.31:0/1951097155 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80ab9d0 con 0x7fcaf009aa40 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- 172.21.15.31:0/1951097155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf009aa40 msgr2=0x7fcaf009aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- 172.21.15.31:0/1951097155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf009aa40 0x7fcaf009aeb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00735d0 tx=0x7fcae801c490 comp rx=0 tx=0).stop 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- 172.21.15.31:0/1951097155 shutdown_connections 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- 172.21.15.31:0/1951097155 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf009aa40 0x7fcaf009aeb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- 172.21.15.31:0/1951097155 >> v2:172.21.15.102:3300/0 conn(0x7fcaf015fc50 0x7fcaf00d0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- 172.21.15.31:0/1951097155 >> 172.21.15.31:0/1951097155 conn(0x7fcaf00d23a0 msgr2=0x7fcaf00d27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- 172.21.15.31:0/1951097155 shutdown_connections 2024-09-15T22:52:36.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- 172.21.15.31:0/1951097155 wait complete. 2024-09-15T22:52:36.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 Processor -- start 2024-09-15T22:52:36.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- start start 2024-09-15T22:52:36.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcaf009aa40 0x7fcaf00b5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcaf015fc50 0x7fcaf00c7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0071f20 con 0x7fcaf015f870 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0071da0 con 0x7fcaf015fc50 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaf5200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf0160d70 con 0x7fcaf009aa40 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44584/0 (socket says 172.21.15.31:44584) 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 -- 172.21.15.31:0/2369765081 learned_addr learned my addr 172.21.15.31:0/2369765081 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaede00640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcaf009aa40 0x7fcaf00b5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaee800640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcaf015fc50 0x7fcaf00c7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 -- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcaf009aa40 msgr2=0x7fcaf00b5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcaf009aa40 0x7fcaf00b5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 -- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcaf015fc50 msgr2=0x7fcaf00c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcaf015fc50 0x7fcaf00c7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 -- 172.21.15.31:0/2369765081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf00b58e0 con 0x7fcaf015f870 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.015+0000 7fcaed400640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d830 tx=0x7fcadc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcae6000640 1 -- 172.21.15.31:0/2369765081 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00b6c0 con 0x7fcaf015f870 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcae6000640 1 -- 172.21.15.31:0/2369765081 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcadc019070 con 0x7fcaf015f870 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf00c6160 con 0x7fcaf015f870 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcae6000640 1 -- 172.21.15.31:0/2369765081 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc00baa0 con 0x7fcaf015f870 2024-09-15T22:52:36.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf00c6720 con 0x7fcaf015f870 2024-09-15T22:52:36.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcae6000640 1 -- 172.21.15.31:0/2369765081 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcadc01e460 con 0x7fcaf015f870 2024-09-15T22:52:36.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.019+0000 7fcae6000640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 0x7fcad0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcae6000640 1 -- 172.21.15.31:0/2369765081 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fcadc0863d0 con 0x7fcaf015f870 2024-09-15T22:52:36.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 Processor -- start 2024-09-15T22:52:36.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaede00640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 0x7fcad0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- start start 2024-09-15T22:52:36.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaede00640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 0x7fcad0069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00cc200 tx=0x7fcae0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b4842f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b46e0b60 con 0x5603b47f9290 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5603b4647c70 con 0x5603b4842b20 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5603b45eded0 con 0x5603b4843440 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44598/0 (socket says 172.21.15.31:44598) 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 -- 172.21.15.31:0/94356957 learned_addr learned my addr 172.21.15.31:0/94356957 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaede00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b4842f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaed400640 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 -- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 msgr2=0x5603b47f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 -- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 msgr2=0x5603b4842f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b4842f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 -- 172.21.15.31:0/94356957 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b45ffe50 con 0x5603b47f9290 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaee800640 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ae040 tx=0x7fcae80a6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c00bb71982c35b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcadaa00640 1 -- 172.21.15.31:0/94356957 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80b0040 con 0x5603b47f9290 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcadaa00640 1 -- 172.21.15.31:0/94356957 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80bc070 con 0x5603b47f9290 2024-09-15T22:52:36.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcadaa00640 1 -- 172.21.15.31:0/94356957 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae80abb50 con 0x5603b47f9290 2024-09-15T22:52:36.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- 172.21.15.31:0/94356957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 msgr2=0x5603b47f9670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fcae80ae040 tx=0x7fcae80a6000 comp rx=0 tx=0).stop 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- 172.21.15.31:0/94356957 shutdown_connections 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b47f9290 0x5603b47f9670 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 --2- 172.21.15.31:0/94356957 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b4842f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- 172.21.15.31:0/94356957 >> 172.21.15.31:0/94356957 conn(0x5603b47ff600 msgr2=0x5603b47f7630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- 172.21.15.31:0/94356957 shutdown_connections 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- 172.21.15.31:0/94356957 wait complete. 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 -- start start 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.023+0000 7fcaf855b000 1 Processor -- start 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b48040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b46a9b00 con 0x5603b4842b20 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5603b4622360 con 0x5603b4803cf0 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5603b461f2d0 con 0x5603b4843440 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 10 client.0 _ll_register_callbacks cb 0x5603b47e4820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44610/0 (socket says 172.21.15.31:44610) 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 -- 172.21.15.31:0/3449053397 learned_addr learned my addr 172.21.15.31:0/3449053397 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaed400640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaee800640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b48040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 -- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 msgr2=0x5603b47fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 -- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 msgr2=0x5603b48040d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b48040d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 -- 172.21.15.31:0/3449053397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b45ee120 con 0x5603b4842b20 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaee800640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b48040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaede00640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcae0014a00 tx=0x7fcae0001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6fa12203b935c4f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0025020 con 0x5603b4842b20 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fcae0013b40 con 0x5603b4842b20 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae80bc070 con 0x5603b4842b20 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcae002f050 con 0x5603b4842b20 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 10 client.5502 fetch_fsmap learned FSMap version 36 2024-09-15T22:52:36.033 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5603b45e7450 con 0x5603b4842b20 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80bc070 con 0x5603b4842b20 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7fcae0032020 con 0x5603b4842b20 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 10 client.5502 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 10 client.5502 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 20 client.5502 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4851280 0x5603b4853670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 4 client.5502 mds_command: new command op to 5484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:36.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 --> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603b45e1c00 con 0x5603b4851280 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaed400640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4851280 0x5603b4853670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcaed400640 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4851280 0x5603b4853670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54e3c0d195824ebb server_cookie=90230c021948ddf8 in_seq=0 out_seq=0 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.027+0000 7fcacf400640 10 client.5502 ms_handle_connect on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcacf400640 1 -- 172.21.15.31:0/3449053397 <== mds.0 v2:172.21.15.31:6833/2507393641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5603b45e1c00 con 0x5603b4851280 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcacf400640 10 client.5502 handle_command_reply: tid=0 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 client.5502 shutdown 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 msgr2=0x5603b47fdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcae0014a00 tx=0x7fcae0001260 comp rx=0 tx=0).stop 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 shutdown_connections 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4851280 0x5603b4853670 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b48040d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b47fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3449053397 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b47fdc70 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcacf400640 0 client.5502 ms_handle_reset on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:36.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 >> 172.21.15.31:0/3449053397 conn(0x5603b47f9290 msgr2=0x5603b47f7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 shutdown_connections 2024-09-15T22:52:36.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 1 -- 172.21.15.31:0/3449053397 wait complete. 2024-09-15T22:52:36.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.031+0000 7fcaf855b000 20 client.5502 trim_cache size 0 max 16384 2024-09-15T22:52:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.047+0000 7fcaf855b000 1 Processor -- start 2024-09-15T22:52:36.052 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.047+0000 7fcaf855b000 1 -- start start 2024-09-15T22:52:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b48420a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b4853670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf0203100 con 0x5603b4803cf0 2024-09-15T22:52:36.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf00afcb0 con 0x5603b4842b20 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf0202ab0 con 0x5603b4843440 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44626/0 (socket says 172.21.15.31:44626) 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 -- 172.21.15.31:0/2461677970 learned_addr learned my addr 172.21.15.31:0/2461677970 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaee800640 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b4853670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaed400640 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b48420a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 -- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 msgr2=0x5603b4853670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b4853670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 -- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 msgr2=0x5603b48420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b48420a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 -- 172.21.15.31:0/2461677970 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603b45cefd0 con 0x5603b4803cf0 2024-09-15T22:52:36.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaede00640 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcae000f660 tx=0x7fcae0021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81a244e782563d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcada000640 1 -- 172.21.15.31:0/2461677970 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae0025040 con 0x5603b4803cf0 2024-09-15T22:52:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcada000640 1 -- 172.21.15.31:0/2461677970 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0037030 con 0x5603b4803cf0 2024-09-15T22:52:36.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcada000640 1 -- 172.21.15.31:0/2461677970 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcae002a4c0 con 0x5603b4803cf0 2024-09-15T22:52:36.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- 172.21.15.31:0/2461677970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 msgr2=0x5603b4841b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcae000f660 tx=0x7fcae0021000 comp rx=0 tx=0).stop 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- 172.21.15.31:0/2461677970 shutdown_connections 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b4853670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4842b20 0x5603b48420a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 --2- 172.21.15.31:0/2461677970 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4803cf0 0x5603b4841b60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- 172.21.15.31:0/2461677970 >> 172.21.15.31:0/2461677970 conn(0x5603b47f9290 msgr2=0x5603b47fd8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- 172.21.15.31:0/2461677970 shutdown_connections 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- 172.21.15.31:0/2461677970 wait complete. 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 -- start start 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.051+0000 7fcaf855b000 1 Processor -- start 2024-09-15T22:52:36.061 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b4856aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b48b5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5603b4646f80 con 0x5603b4842b20 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5603b45ffca0 con 0x5603b4803cf0 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5603b464c2a0 con 0x5603b4843440 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 10 client.0 _ll_register_callbacks cb 0x7fcae0001b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaede00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b4856aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44640/0 (socket says 172.21.15.31:44640) 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 -- 172.21.15.31:0/3918759332 learned_addr learned my addr 172.21.15.31:0/3918759332 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaee800640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b48b5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.062 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 -- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 msgr2=0x5603b48b5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b48b5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 -- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 msgr2=0x5603b4856aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b4856aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 -- 172.21.15.31:0/3918759332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603b46ca750 con 0x5603b4842b20 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaed400640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcadc007fd0 tx=0x7fcadc086040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67c281a086c5203 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcadc081070 con 0x5603b4842b20 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fcadc052d40 con 0x5603b4842b20 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcae0037030 con 0x5603b4842b20 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fcadc084340 con 0x5603b4842b20 2024-09-15T22:52:36.063 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 10 client.5508 fetch_fsmap learned FSMap version 36 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=2+}) -- 0x5603b45d5a30 con 0x5603b4842b20 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae0037030 con 0x5603b4842b20 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 36) ==== 3494+0+0 (secure 0 0 0) 0x7fcadc084020 con 0x5603b4842b20 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 10 client.5508 fetch_fsmap finished waiting for FSMap version 36 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 10 client.5508 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 20 client.5508 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4856fe0 0x5603b4871960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 4 client.5508 mds_command: new command op to 5484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 --> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] -- command(tid 0: {"prefix": "status"}) -- 0x5603b46553a0 con 0x5603b4856fe0 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaede00640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4856fe0 0x5603b4871960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaede00640 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4856fe0 0x5603b4871960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c1859f215117612 server_cookie=4ea0806a5c1cf589 in_seq=0 out_seq=0 2024-09-15T22:52:36.064 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 10 client.5508 ms_handle_connect on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 1 -- 172.21.15.31:0/3918759332 <== mds.0 v2:172.21.15.31:6833/2507393641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+522 (crc 0 0 0) 0x5603b46553a0 con 0x5603b4856fe0 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 10 client.5508 handle_command_reply: tid=0 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 client.5508 shutdown 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 msgr2=0x5603b48b4fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcadc007fd0 tx=0x7fcadc086040 comp rx=0 tx=0).stop 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 shutdown_connections 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x5603b4856fe0 0x5603b4871960 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x5603b4843440 0x5603b48b5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x5603b4842b20 0x5603b48b4fe0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 --2- 172.21.15.31:0/3918759332 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x5603b4803cf0 0x5603b4856aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcacf400640 0 client.5508 ms_handle_reset on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:36.065 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 >> 172.21.15.31:0/3918759332 conn(0x5603b47f9290 msgr2=0x5603b4840b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 shutdown_connections 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 1 -- 172.21.15.31:0/3918759332 wait complete. 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.055+0000 7fcaf855b000 20 client.5508 trim_cache size 0 max 16384 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5484, 2024-09-15T22:52:36.066 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:reconnect", 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:replay", 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "replay_status": { 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_read_pos": 4195503, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_write_pos": 4195503, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "journal_expire_pos": 4194304, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "num_events": 3, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "num_segments": 2 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 0.20995380399999999, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 36, 2024-09-15T22:52:36.067 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 61, 2024-09-15T22:52:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 0, 2024-09-15T22:52:36.068 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 0.887642182 2024-09-15T22:52:36.068 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 msgr2=0x7fcad0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 0x7fcad0069d80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcaf00cc200 tx=0x7fcae0009040 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 msgr2=0x7fcaf0159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fcadc00d830 tx=0x7fcadc00dcf0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 shutdown_connections 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcad00678c0 0x7fcad0069d80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcaf015fc50 0x7fcaf00c7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcaf015f870 0x7fcaf0159450 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 --2- 172.21.15.31:0/2369765081 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcaf009aa40 0x7fcaf00b5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 >> 172.21.15.31:0/2369765081 conn(0x7fcaf00d23a0 msgr2=0x7fcaf00cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:36.069 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 shutdown_connections 2024-09-15T22:52:36.070 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:36.059+0000 7fcaf5200640 1 -- 172.21.15.31:0/2369765081 wait complete. 2024-09-15T22:52:37.081 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:37.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 Processor -- start 2024-09-15T22:52:37.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 -- start start 2024-09-15T22:52:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a40d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0a40d01f0 0x7fe0a40cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.235 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0a4071440 con 0x7fe0a409aca0 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe0a40711f0 con 0x7fe0a40d01f0 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a9200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a40d0620 con 0x7fe0a409b080 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a1e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fe0a409aca0 0x7fe0a40d0a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55798/0 (socket says 172.21.15.31:55798) 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a1e00640 1 -- 172.21.15.31:0/2518535477 learned_addr learned my addr 172.21.15.31:0/2518535477 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a2800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe0a40d01f0 0x7fe0a40cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.236 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a1400640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a40d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a2800640 1 -- 172.21.15.31:0/2518535477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 msgr2=0x7fe0a40d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:37.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a2800640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a40d2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a2800640 1 -- 172.21.15.31:0/2518535477 >> v1:172.21.15.31:6789/0 conn(0x7fe0a409aca0 legacy=0x7fe0a40d0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a2800640 1 -- 172.21.15.31:0/2518535477 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4071720 con 0x7fe0a40d01f0 2024-09-15T22:52:37.237 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.231+0000 7fe0a0a00640 1 -- 172.21.15.31:0/2518535477 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1311792710 0 0) 0x7fe0a4071440 con 0x7fe0a409aca0 2024-09-15T22:52:37.238 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a2800640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40cd850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097c0 tx=0x7fe09c01c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a079079c5530f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a0a00640 1 -- 172.21.15.31:0/2518535477 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0b2070 con 0x7fe0a40d01f0 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a0a00640 1 -- 172.21.15.31:0/2518535477 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09c0ad680 con 0x7fe0a40d01f0 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a0a00640 1 -- 172.21.15.31:0/2518535477 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09c0ada50 con 0x7fe0a40d01f0 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 -- 172.21.15.31:0/2518535477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a40d01f0 msgr2=0x7fe0a40cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40cd850 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe09c0097c0 tx=0x7fe09c01c380 comp rx=0 tx=0).stop 2024-09-15T22:52:37.240 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 -- 172.21.15.31:0/2518535477 shutdown_connections 2024-09-15T22:52:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40cd850 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 --2- 172.21.15.31:0/2518535477 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a40d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 -- 172.21.15.31:0/2518535477 >> 172.21.15.31:0/2518535477 conn(0x7fe0a40d2410 msgr2=0x7fe0a40d2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 -- 172.21.15.31:0/2518535477 shutdown_connections 2024-09-15T22:52:37.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.235+0000 7fe0a9200640 1 -- 172.21.15.31:0/2518535477 wait complete. 2024-09-15T22:52:37.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 Processor -- start 2024-09-15T22:52:37.242 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- start start 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a4152700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40b7830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40709f0 con 0x7fe0a409aca0 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe0a40ce1a0 con 0x7fe0a40d01f0 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe0a4070b70 con 0x7fe0a409b080 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44662/0 (socket says 172.21.15.31:44662) 2024-09-15T22:52:37.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 -- 172.21.15.31:0/3037231849 learned_addr learned my addr 172.21.15.31:0/3037231849 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1400640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a4152700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a2800640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40b7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 -- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 msgr2=0x7fe0a4152700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a4152700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 -- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a40d01f0 msgr2=0x7fe0a40b7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40b7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 -- 172.21.15.31:0/3037231849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0a4152c40 con 0x7fe0a409aca0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a1e00640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c890 tx=0x7fe09400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094018070 con 0x7fe0a409aca0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe09400a640 con 0x7fe0a409aca0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09400aa30 con 0x7fe0a409aca0 2024-09-15T22:52:37.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0a40c9980 con 0x7fe0a409aca0 2024-09-15T22:52:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.239+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0a40c9f40 con 0x7fe0a409aca0 2024-09-15T22:52:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0a4070fd0 con 0x7fe0a409aca0 2024-09-15T22:52:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe09401b070 con 0x7fe0a409aca0 2024-09-15T22:52:37.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe09a000640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 0x7fe084069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fe0940855d0 con 0x7fe0a409aca0 2024-09-15T22:52:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe0a1400640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 0x7fe084069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:37.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.243+0000 7fe0a1400640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 0x7fe084069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40cb240 tx=0x7fe090008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:37.250 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.247+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe094055e90 con 0x7fe0a409aca0 2024-09-15T22:52:37.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0a406d840 con 0x7fe0a409aca0 2024-09-15T22:52:37.450 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe09a000640 1 -- 172.21.15.31:0/3037231849 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) ==== 94+0+5223 (secure 0 0 0) 0x7fe094055790 con 0x7fe0a409aca0 2024-09-15T22:52:37.450 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:37.450 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":37,"btime":"2024-09-15T22:52:36:848482+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":37,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:35.860334+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:reconnect","state_seq":2,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-15T22:52:37.450 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 37 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 msgr2=0x7fe084069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 0x7fe084069d80 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe0a40cb240 tx=0x7fe090008040 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 msgr2=0x7fe0a40caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c890 tx=0x7fe09400cd50 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 shutdown_connections 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe0840678c0 0x7fe084069d80 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe0a40d01f0 0x7fe0a40b7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe0a409b080 0x7fe0a4152700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 --2- 172.21.15.31:0/3037231849 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe0a409aca0 0x7fe0a40caa20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:37.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 >> 172.21.15.31:0/3037231849 conn(0x7fe0a40d2410 msgr2=0x7fe0a4166ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:37.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 shutdown_connections 2024-09-15T22:52:37.453 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:37.447+0000 7fe0a9200640 1 -- 172.21.15.31:0/3037231849 wait complete. 2024-09-15T22:52:37.874 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 37, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:52:27.162874+0000', 'modified': '2024-09-15T22:52:35.860334+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5484': {'gid': 5484, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:reconnect', 'state_seq': 2, 'addr': '172.21.15.31:6835/2507393641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 2507393641}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2507393641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T22:52:37.874 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5484:up:reconnect 2024-09-15T22:52:38.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:39.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.019+0000 7f1699400640 1 Processor -- start 2024-09-15T22:52:39.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 -- start start 2024-09-15T22:52:39.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f169415e7b0 0x7f169415f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f169415fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f169406bbf0 con 0x7f16941602d0 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f169406c800 con 0x7f169415e7b0 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1699400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f169406bed0 con 0x7f1694067a70 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1692800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f169415e7b0 0x7f169415f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1693200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f16941602d0 0x7f169406cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55804/0 (socket says 172.21.15.31:55804) 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1693200640 1 -- 172.21.15.31:0/1905279006 learned_addr learned my addr 172.21.15.31:0/1905279006 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1689e00640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f169415fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1692800640 1 -- 172.21.15.31:0/1905279006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 msgr2=0x7f169415fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1692800640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f169415fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1692800640 1 -- 172.21.15.31:0/1905279006 >> v1:172.21.15.31:6789/0 conn(0x7f16941602d0 legacy=0x7f169406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.023+0000 7f1692800640 1 -- 172.21.15.31:0/1905279006 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f169406c1b0 con 0x7f169415e7b0 2024-09-15T22:52:39.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1692800640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f169415f670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f16840097c0 tx=0x7f168401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a88a43ad7a40e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1691e00640 1 -- 172.21.15.31:0/1905279006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16840b0070 con 0x7f169415e7b0 2024-09-15T22:52:39.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1691e00640 1 -- 172.21.15.31:0/1905279006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16840ab600 con 0x7f169415e7b0 2024-09-15T22:52:39.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1691e00640 1 -- 172.21.15.31:0/1905279006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16840ab9d0 con 0x7f169415e7b0 2024-09-15T22:52:39.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- 172.21.15.31:0/1905279006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 msgr2=0x7f169415f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f169415f670 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f16840097c0 tx=0x7f168401c410 comp rx=0 tx=0).stop 2024-09-15T22:52:39.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- 172.21.15.31:0/1905279006 shutdown_connections 2024-09-15T22:52:39.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f169415fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 --2- 172.21.15.31:0/1905279006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f169415f670 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- 172.21.15.31:0/1905279006 >> 172.21.15.31:0/1905279006 conn(0x7f16940cd680 msgr2=0x7f16940cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- 172.21.15.31:0/1905279006 shutdown_connections 2024-09-15T22:52:39.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- 172.21.15.31:0/1905279006 wait complete. 2024-09-15T22:52:39.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 Processor -- start 2024-09-15T22:52:39.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.027+0000 7f1699400640 1 -- start start 2024-09-15T22:52:39.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f16941520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 0x7f16941500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f169416b210 con 0x7f169415e7b0 2024-09-15T22:52:39.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f169406d5b0 con 0x7f16941602d0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f169416b390 con 0x7f1694067a70 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44686/0 (socket says 172.21.15.31:44686) 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 -- 172.21.15.31:0/858166137 learned_addr learned my addr 172.21.15.31:0/858166137 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1692800640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f16941520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1693200640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 0x7f16941500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 -- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 msgr2=0x7f16941520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f16941520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 -- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 msgr2=0x7f16941500f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 0x7f16941500f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 -- 172.21.15.31:0/858166137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941fbc70 con 0x7f169415e7b0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1693200640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 0x7f16941500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1689e00640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d7d0 tx=0x7f167c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c004020 con 0x7f169415e7b0 2024-09-15T22:52:39.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f167c0041c0 con 0x7f169415e7b0 2024-09-15T22:52:39.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f167c0043b0 con 0x7f169415e7b0 2024-09-15T22:52:39.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941fb3d0 con 0x7f169415e7b0 2024-09-15T22:52:39.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941fb990 con 0x7f169415e7b0 2024-09-15T22:52:39.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f169415fd90 con 0x7f169415e7b0 2024-09-15T22:52:39.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.031+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f167c01b020 con 0x7f169415e7b0 2024-09-15T22:52:39.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.035+0000 7f168b400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 0x7f1670069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:39.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.035+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f167c085cb0 con 0x7f169415e7b0 2024-09-15T22:52:39.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.035+0000 7f1692800640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 0x7f1670069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:39.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.035+0000 7f1692800640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 0x7f1670069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f16840ad000 tx=0x7f16840a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:39.042 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.039+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f167c056610 con 0x7f169415e7b0 2024-09-15T22:52:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f16940b6130 con 0x7f169415e7b0 2024-09-15T22:52:39.241 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f168b400640 1 -- 172.21.15.31:0/858166137 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5226 (secure 0 0 0) 0x7f167c055f10 con 0x7f169415e7b0 2024-09-15T22:52:39.242 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:39.242 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":39,"btime":"2024-09-15T22:52:38:855665+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:37.858052+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:clientreplay","state_seq":4,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":3}]} 2024-09-15T22:52:39.242 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 39 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 msgr2=0x7f1670069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 0x7f1670069d80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f16840ad000 tx=0x7f16840a6000 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 msgr2=0x7f16941fad10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f167c00d7d0 tx=0x7f167c00dc90 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 shutdown_connections 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16700678c0 0x7f1670069d80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16941602d0 0x7f16941500f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f169415e7b0 0x7f16941fad10 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 --2- 172.21.15.31:0/858166137 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f1694067a70 0x7f16941520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 >> 172.21.15.31:0/858166137 conn(0x7f16940cd680 msgr2=0x7f169406cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:39.244 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 shutdown_connections 2024-09-15T22:52:39.245 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:39.239+0000 7f1699400640 1 -- 172.21.15.31:0/858166137 wait complete. 2024-09-15T22:52:39.665 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:52:27.162874+0000', 'modified': '2024-09-15T22:52:37.858052+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5484': {'gid': 5484, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:clientreplay', 'state_seq': 4, 'addr': '172.21.15.31:6835/2507393641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 2507393641}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2507393641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-09-15T22:52:39.665 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_5484:up:clientreplay 2024-09-15T22:52:40.666 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.815+0000 7f5e3ca00640 1 Processor -- start 2024-09-15T22:52:40.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.815+0000 7f5e3ca00640 1 -- start start 2024-09-15T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.815+0000 7f5e3ca00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 0x7f5e380b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e3ca00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e3ca00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e380cfe60 con 0x7f5e380b49d0 2024-09-15T22:52:40.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e3ca00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5e380d0100 con 0x7f5e38073750 2024-09-15T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e3ca00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380d03e0 con 0x7f5e3815c1d0 2024-09-15T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e35e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 0x7f5e380b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:57902/0 (socket says 172.21.15.31:57902) 2024-09-15T22:52:40.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 -- 172.21.15.31:0/131500570 learned_addr learned my addr 172.21.15.31:0/131500570 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 -- 172.21.15.31:0/131500570 >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 msgr2=0x7f5e380b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 --2- 172.21.15.31:0/131500570 >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 0x7f5e380b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 -- 172.21.15.31:0/131500570 >> v1:172.21.15.102:6789/0 conn(0x7f5e380b49d0 legacy=0x7f5e3815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e36800640 1 -- 172.21.15.31:0/131500570 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e380d06c0 con 0x7f5e3815c1d0 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e34a00640 1 -- 172.21.15.31:0/131500570 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287400845 0 0) 0x7f5e380cfe60 con 0x7f5e380b49d0 2024-09-15T22:52:40.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.819+0000 7f5e35e00640 1 --2- 172.21.15.31:0/131500570 >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 0x7f5e380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e36800640 1 --2- 172.21.15.31:0/131500570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d150 tx=0x7f5e3001ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4949fc610b89e8d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:40.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e34a00640 1 -- 172.21.15.31:0/131500570 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000b2d0 con 0x7f5e3815c1d0 2024-09-15T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e34a00640 1 -- 172.21.15.31:0/131500570 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e3000b470 con 0x7f5e3815c1d0 2024-09-15T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e34a00640 1 -- 172.21.15.31:0/131500570 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e300a7b20 con 0x7f5e3815c1d0 2024-09-15T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- 172.21.15.31:0/131500570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 msgr2=0x7f5e380adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:40.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/131500570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000d150 tx=0x7f5e3001ec30 comp rx=0 tx=0).stop 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- 172.21.15.31:0/131500570 shutdown_connections 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/131500570 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e3815c1d0 0x7f5e380adde0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/131500570 >> v2:172.21.15.102:3300/0 conn(0x7f5e38073750 0x7f5e380b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- 172.21.15.31:0/131500570 >> 172.21.15.31:0/131500570 conn(0x7f5e380b20a0 msgr2=0x7f5e380b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- 172.21.15.31:0/131500570 shutdown_connections 2024-09-15T22:52:40.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- 172.21.15.31:0/131500570 wait complete. 2024-09-15T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 Processor -- start 2024-09-15T22:52:40.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- start start 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 0x7f5e38152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e3815c1d0 0x7f5e3814afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380aecb0 con 0x7f5e380b49d0 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e380aeb30 con 0x7f5e3815c1d0 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.823+0000 7f5e3ca00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e380aee30 con 0x7f5e38073750 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 0x7f5e38152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44690/0 (socket says 172.21.15.31:44690) 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 0x7f5e38152980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:57910/0 (socket says 172.21.15.31:57910) 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 -- 172.21.15.31:0/2260161850 learned_addr learned my addr 172.21.15.31:0/2260161850 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e36800640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e3815c1d0 0x7f5e3814afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 -- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 msgr2=0x7f5e38152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 0x7f5e38152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 -- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e3815c1d0 msgr2=0x7f5e3814afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e3815c1d0 0x7f5e3814afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 -- 172.21.15.31:0/2260161850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e3814bba0 con 0x7f5e380b49d0 2024-09-15T22:52:40.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e35400640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c550 tx=0x7f5e2400ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e240052d0 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e24005470 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e24012870 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e3814db40 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e3814cb30 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e3814ee10 con 0x7f5e380b49d0 2024-09-15T22:52:40.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.827+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e24012a10 con 0x7f5e380b49d0 2024-09-15T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.831+0000 7f5e2e000640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 0x7f5e18069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:40.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.831+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f5e24085a20 con 0x7f5e380b49d0 2024-09-15T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.831+0000 7f5e35e00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 0x7f5e18069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:40.833 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.831+0000 7f5e35e00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 0x7f5e18069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e380b1a90 tx=0x7f5e28009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:40.837 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:40.835+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e3814bba0 con 0x7f5e380b49d0 2024-09-15T22:52:40.851 INFO:tasks.ceph.mds.a.smithi031.stderr:2024-09-15T22:52:40.847+0000 7f9d84600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:52:41.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.031+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e3815bce0 con 0x7f5e380b49d0 2024-09-15T22:52:41.035 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.031+0000 7f5e2e000640 1 -- 172.21.15.31:0/2260161850 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f5e24055ca0 con 0x7f5e380b49d0 2024-09-15T22:52:41.035 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:41.036 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:41.036 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:41.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 msgr2=0x7f5e18069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 0x7f5e18069d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5e380b1a90 tx=0x7f5e28009190 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 msgr2=0x7f5e3815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f5e2400c550 tx=0x7f5e2400ca10 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 shutdown_connections 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e180678c0 0x7f5e18069d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e3815c1d0 0x7f5e3814afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e380b49d0 0x7f5e3815f750 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 --2- 172.21.15.31:0/2260161850 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e38073750 0x7f5e38152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 >> 172.21.15.31:0/2260161850 conn(0x7f5e380b20a0 msgr2=0x7f5e3806bbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 shutdown_connections 2024-09-15T22:52:41.038 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.035+0000 7f5e3ca00640 1 -- 172.21.15.31:0/2260161850 wait complete. 2024-09-15T22:52:41.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-15T22:52:27.162874+0000', 'modified': '2024-09-15T22:52:39.862882+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 61, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5484}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5484': {'gid': 5484, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.31:6835/2507393641', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6833', 'nonce': 2507393641}, {'type': 'v1', 'addr': '172.21.15.31:6835', 'nonce': 2507393641}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [8], 'metadata_pool': 7, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5484, 'qdb_cluster': [5484]} 2024-09-15T22:52:41.460 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-15T22:52:41.461 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-15T22:52:41.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.603+0000 7f2095200640 1 Processor -- start 2024-09-15T22:52:41.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.603+0000 7f2095200640 1 -- start start 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2095200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f209006ee70 0x7f209006c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2095200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2090147860 0x7f20900cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2095200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209006cc90 con 0x7f20900b03c0 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2095200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f209006d530 con 0x7f2090147860 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2095200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f209006cf70 con 0x7f209006ee70 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2090147860 0x7f20900cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.609 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2090147860 0x7f20900cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44698/0 (socket says 172.21.15.31:44698) 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 -- 172.21.15.31:0/3853589499 learned_addr learned my addr 172.21.15.31:0/3853589499 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f2085400640 1 --2- 172.21.15.31:0/3853589499 >> v2:172.21.15.102:3300/0 conn(0x7f209006ee70 0x7f209006c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 -- 172.21.15.31:0/3853589499 >> v2:172.21.15.102:3300/0 conn(0x7f209006ee70 msgr2=0x7f209006c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 --2- 172.21.15.31:0/3853589499 >> v2:172.21.15.102:3300/0 conn(0x7f209006ee70 0x7f209006c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 -- 172.21.15.31:0/3853589499 >> v1:172.21.15.102:6789/0 conn(0x7f20900b03c0 legacy=0x7f209006e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 -- 172.21.15.31:0/3853589499 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209006d250 con 0x7f2090147860 2024-09-15T22:52:41.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.607+0000 7f208e800640 1 --2- 172.21.15.31:0/3853589499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20900cf0d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f209006fb20 tx=0x7f208801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4664627cb76b7c4a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208d400640 1 -- 172.21.15.31:0/3853589499 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880a5810 con 0x7f2090147860 2024-09-15T22:52:41.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208d400640 1 -- 172.21.15.31:0/3853589499 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20880a59b0 con 0x7f2090147860 2024-09-15T22:52:41.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208d400640 1 -- 172.21.15.31:0/3853589499 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880a5d80 con 0x7f2090147860 2024-09-15T22:52:41.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- 172.21.15.31:0/3853589499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 msgr2=0x7f20900cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- 172.21.15.31:0/3853589499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20900cf0d0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f209006fb20 tx=0x7f208801c930 comp rx=0 tx=0).stop 2024-09-15T22:52:41.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- 172.21.15.31:0/3853589499 shutdown_connections 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- 172.21.15.31:0/3853589499 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20900cf0d0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- 172.21.15.31:0/3853589499 >> v2:172.21.15.102:3300/0 conn(0x7f209006ee70 0x7f209006c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- 172.21.15.31:0/3853589499 >> 172.21.15.31:0/3853589499 conn(0x7f20900cd680 msgr2=0x7f20900cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- 172.21.15.31:0/3853589499 shutdown_connections 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- 172.21.15.31:0/3853589499 wait complete. 2024-09-15T22:52:41.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 Processor -- start 2024-09-15T22:52:41.615 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- start start 2024-09-15T22:52:41.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209006ee70 0x7f209015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 0x7f209013fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f20900d01b0 con 0x7f2090147860 2024-09-15T22:52:41.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f20900d0030 con 0x7f20900b03c0 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f2095200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f20900d0330 con 0x7f209006ee70 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44710/0 (socket says 172.21.15.31:44710) 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.611+0000 7f208e800640 1 -- 172.21.15.31:0/1942342118 learned_addr learned my addr 172.21.15.31:0/1942342118 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2085400640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 0x7f209013fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208de00640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209006ee70 0x7f209015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 -- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209006ee70 msgr2=0x7f209015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209006ee70 0x7f209015e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 -- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 msgr2=0x7f209013fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 0x7f209013fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 -- 172.21.15.31:0/1942342118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2090140940 con 0x7f2090147860 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2085400640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 0x7f209013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f208e800640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20880af040 tx=0x7f20880196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 -- 172.21.15.31:0/1942342118 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880bc020 con 0x7f2090147860 2024-09-15T22:52:41.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 -- 172.21.15.31:0/1942342118 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20880b8690 con 0x7f2090147860 2024-09-15T22:52:41.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 -- 172.21.15.31:0/1942342118 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880b8a80 con 0x7f2090147860 2024-09-15T22:52:41.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2090140c20 con 0x7f2090147860 2024-09-15T22:52:41.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20901411e0 con 0x7f2090147860 2024-09-15T22:52:41.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 -- 172.21.15.31:0/1942342118 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f20880bf020 con 0x7f2090147860 2024-09-15T22:52:41.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.615+0000 7f2086a00640 1 -- 172.21.15.31:0/1942342118 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f2088120db0 con 0x7f2090147860 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208de00640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 Processor -- start 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- start start 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208de00640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 0x7f206c069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2080001650 tx=0x7f2080009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 0x560770aad670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x560770994b60 con 0x560770af7440 2024-09-15T22:52:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5607708fbc70 con 0x560770af6b20 2024-09-15T22:52:41.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5607708a1ed0 con 0x560770aad290 2024-09-15T22:52:41.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44724/0 (socket says 172.21.15.31:44724) 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 -- 172.21.15.31:0/575169920 learned_addr learned my addr 172.21.15.31:0/575169920 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208de00640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208e800640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 0x560770aad670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 -- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 msgr2=0x560770aad670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 0x560770aad670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 -- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 msgr2=0x560770af6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 -- 172.21.15.31:0/575169920 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607708b3e50 con 0x560770af7440 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208de00640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f208e800640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 0x560770aad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:41.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f2085400640 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f207800b8d0 tx=0x7f207800bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcc849c38fd8ebb server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f207ea00640 1 -- 172.21.15.31:0/575169920 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2078018020 con 0x560770af7440 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f207ea00640 1 -- 172.21.15.31:0/575169920 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207800f9c0 con 0x560770af7440 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f207ea00640 1 -- 172.21.15.31:0/575169920 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f207800fd70 con 0x560770af7440 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- 172.21.15.31:0/575169920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 msgr2=0x560770aacd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f207800b8d0 tx=0x7f207800bd90 comp rx=0 tx=0).stop 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- 172.21.15.31:0/575169920 shutdown_connections 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770aad290 0x560770aad670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770aacd50 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 --2- 172.21.15.31:0/575169920 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- 172.21.15.31:0/575169920 >> 172.21.15.31:0/575169920 conn(0x560770ab3600 msgr2=0x560770aab630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- 172.21.15.31:0/575169920 shutdown_connections 2024-09-15T22:52:41.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- 172.21.15.31:0/575169920 wait complete. 2024-09-15T22:52:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.619+0000 7f20986a5000 1 -- start start 2024-09-15T22:52:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 Processor -- start 2024-09-15T22:52:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770ab7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770ab8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x56077095db00 con 0x560770af6b20 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5607708d6360 con 0x560770af7440 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5607708d32d0 con 0x560770ab2390 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 10 client.0 _ll_register_callbacks cb 0x560770a98820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44728/0 (socket says 172.21.15.31:44728) 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 -- 172.21.15.31:0/4070817888 learned_addr learned my addr 172.21.15.31:0/4070817888 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 -- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 msgr2=0x560770ab8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208e800640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770ab8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770ab8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 -- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 msgr2=0x560770ab7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2085400640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770ab7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770ab7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 -- 172.21.15.31:0/4070817888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607708a2120 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2085400640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770ab7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f208de00640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2080003930 tx=0x7f2080000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a31b370b930b8052 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2080027060 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f2080010040 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f207800f9c0 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f208000ecc0 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 10 client.5541 fetch_fsmap learned FSMap version 40 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x56077089b450 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f207800f9c0 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f2080013420 con 0x560770af6b20 2024-09-15T22:52:41.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 10 client.5541 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 10 client.5541 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 20 client.5541 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b05280 0x560770b07670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 4 client.5541 mds_command: new command op to 5484 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 --> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560770895c00 con 0x560770b05280 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2085400640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b05280 0x560770b07670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2073400640 10 client.5541 ms_handle_connect on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:41.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.623+0000 7f2085400640 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b05280 0x560770b07670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e30cd6a1339f571 server_cookie=754e75eb8f075925 in_seq=0 out_seq=0 2024-09-15T22:52:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f2073400640 1 -- 172.21.15.31:0/4070817888 <== mds.0 v2:172.21.15.31:6833/2507393641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560770895c00 con 0x560770b05280 2024-09-15T22:52:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f2073400640 10 client.5541 handle_command_reply: tid=0 2024-09-15T22:52:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 client.5541 shutdown 2024-09-15T22:52:41.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 msgr2=0x560770ab1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f2080003930 tx=0x7f2080000bd0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 shutdown_connections 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b05280 0x560770b07670 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770ab8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770ab7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f2073400640 0 client.5541 ms_handle_reset on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 --2- 172.21.15.31:0/4070817888 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af6b20 0x560770ab1e50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 >> 172.21.15.31:0/4070817888 conn(0x560770aad290 msgr2=0x560770aabd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 shutdown_connections 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 1 -- 172.21.15.31:0/4070817888 wait complete. 2024-09-15T22:52:41.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.627+0000 7f20986a5000 20 client.5541 trim_cache size 0 max 16384 2024-09-15T22:52:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.643+0000 7f20986a5000 1 Processor -- start 2024-09-15T22:52:41.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- start start 2024-09-15T22:52:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770af5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2090202f80 con 0x560770af7440 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f209012d200 con 0x560770af6b20 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2090202930 con 0x560770ab2390 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44736/0 (socket says 172.21.15.31:44736) 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 -- 172.21.15.31:0/1797708808 learned_addr learned my addr 172.21.15.31:0/1797708808 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f2085400640 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208de00640 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770af5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.652 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 -- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 msgr2=0x560770af5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770af5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 -- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 msgr2=0x560770af6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 -- 172.21.15.31:0/1797708808 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560770882fd0 con 0x560770af7440 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f208e800640 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f20880f0c70 tx=0x7f2088009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c73faf532f2383dc server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f207e000640 1 -- 172.21.15.31:0/1797708808 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880f0f70 con 0x560770af7440 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f207e000640 1 -- 172.21.15.31:0/1797708808 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20880f5320 con 0x560770af7440 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f207e000640 1 -- 172.21.15.31:0/1797708808 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20880f9b50 con 0x560770af7440 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- 172.21.15.31:0/1797708808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 msgr2=0x560770b07670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f20880f0c70 tx=0x7f2088009040 comp rx=0 tx=0).stop 2024-09-15T22:52:41.653 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- 172.21.15.31:0/1797708808 shutdown_connections 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770af7440 0x560770b07670 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af6b20 0x560770af6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 --2- 172.21.15.31:0/1797708808 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770ab2390 0x560770af5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- 172.21.15.31:0/1797708808 >> 172.21.15.31:0/1797708808 conn(0x560770aad290 msgr2=0x560770ab1650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- 172.21.15.31:0/1797708808 shutdown_connections 2024-09-15T22:52:41.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- 172.21.15.31:0/1797708808 wait complete. 2024-09-15T22:52:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 -- start start 2024-09-15T22:52:41.657 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.647+0000 7f20986a5000 1 Processor -- start 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770af6b20 0x560770b25960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770b25ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x5607708faf80 con 0x560770ab2390 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x5607708b3ca0 con 0x560770af7440 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x5607709002a0 con 0x560770af6b20 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 10 client.0 _ll_register_callbacks cb 0x7f20800013b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44746/0 (socket says 172.21.15.31:44746) 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 -- 172.21.15.31:0/1225093217 learned_addr learned my addr 172.21.15.31:0/1225093217 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208e800640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770b25ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.658 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2085400640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770af6b20 0x560770b25960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 -- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770af6b20 msgr2=0x560770b25960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770af6b20 0x560770b25960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 -- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 msgr2=0x560770b25ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770b25ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 -- 172.21.15.31:0/1225093217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56077097e750 con 0x560770ab2390 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208e800640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770b25ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f208de00640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2080013680 tx=0x7f2080005000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a39e735f60e36a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 10 client.0 ms_handle_connect on v2:172.21.15.31:3300/0 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208000ee60 con 0x560770ab2390 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mon.0 v2:172.21.15.31:3300/0 2 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f208001e070 con 0x560770ab2390 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20880f5320 con 0x560770ab2390 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2080013b80 con 0x560770ab2390 2024-09-15T22:52:41.659 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 10 client.5547 fetch_fsmap learned FSMap version 40 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) -- 0x560770889a30 con 0x560770ab2390 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mon.0 v2:172.21.15.31:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20880f5320 con 0x560770ab2390 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mon.0 v2:172.21.15.31:3300/0 5 ==== fsmap(e 40) ==== 3502+0+0 (secure 0 0 0) 0x7f2080022480 con 0x560770ab2390 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 10 client.5547 fetch_fsmap finished waiting for FSMap version 40 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 10 client.5547 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 20 client.5547 populate_metadata read hostname 'smithi031' 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b263e0 0x560770b69c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 4 client.5547 mds_command: new command op to 5484 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 --> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] -- command(tid 0: {"prefix": "status"}) -- 0x5607709093a0 con 0x560770b263e0 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2085400640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b263e0 0x560770b69c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 10 client.5547 ms_handle_connect on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2085400640 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b263e0 0x560770b69c40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4ab7df25b08faa5 server_cookie=f13243b1f12f70ff in_seq=0 out_seq=0 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 1 -- 172.21.15.31:0/1225093217 <== mds.0 v2:172.21.15.31:6833/2507393641 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5607709093a0 con 0x560770b263e0 2024-09-15T22:52:41.660 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 10 client.5547 handle_command_reply: tid=0 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 client.5547 shutdown 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 msgr2=0x560770b0a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f2080013680 tx=0x7f2080005000 comp rx=0 tx=0).stop 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 shutdown_connections 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:6833/2507393641,v1:172.21.15.31:6835/2507393641] conn(0x560770b263e0 0x560770b69c40 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x560770af7440 0x560770b25ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x560770af6b20 0x560770b25960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.661 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 --2- 172.21.15.31:0/1225093217 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x560770ab2390 0x560770b0a590 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 >> 172.21.15.31:0/1225093217 conn(0x560770aad290 msgr2=0x560770af4cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f2073400640 0 client.5547 ms_handle_reset on v2:172.21.15.31:6833/2507393641 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 shutdown_connections 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 1 -- 172.21.15.31:0/1225093217 wait complete. 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.651+0000 7f20986a5000 20 client.5547 trim_cache size 0 max 16384 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "cluster_fsid": "e1487968-efb4-47ad-8070-6e7082115957", 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "whoami": 0, 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "id": 5484, 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "want_state": "up:active", 2024-09-15T22:52:41.662 INFO:teuthology.orchestra.run.smithi031.stdout: "state": "up:active", 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "fs_name": "cephfs", 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "rank_uptime": 5.8061729040000003, 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "mdsmap_epoch": 40, 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch": 61, 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "osdmap_epoch_barrier": 61, 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout: "uptime": 6.4838617039999997 2024-09-15T22:52:41.663 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 msgr2=0x7f206c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 0x7f206c069d80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2080001650 tx=0x7f2080009040 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 msgr2=0x7f20901606c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f20880af040 tx=0x7f20880196d0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 shutdown_connections 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f206c0678c0 0x7f206c069d80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2090147860 0x7f20901606c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f20900b03c0 0x7f209013fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 --2- 172.21.15.31:0/1942342118 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209006ee70 0x7f209015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.664 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 >> 172.21.15.31:0/1942342118 conn(0x7f20900cd680 msgr2=0x7f2090162910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 shutdown_connections 2024-09-15T22:52:41.665 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.655+0000 7f2095200640 1 -- 172.21.15.31:0/1942342118 wait complete. 2024-09-15T22:52:41.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:41.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 Processor -- start 2024-09-15T22:52:41.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 -- start start 2024-09-15T22:52:41.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2f1415ff70 0x7f2f141603e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f140ceb70 0x7f2f140cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1409bb10 con 0x7f2f1415c530 2024-09-15T22:52:41.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2f14160920 con 0x7f2f140ceb70 2024-09-15T22:52:41.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1c600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2f140b3760 con 0x7f2f1415ff70 2024-09-15T22:52:41.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1a600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f140ceb70 0x7f2f140cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1a600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2f140ceb70 0x7f2f140cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44752/0 (socket says 172.21.15.31:44752) 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f1a600640 1 -- 172.21.15.31:0/2123202640 learned_addr learned my addr 172.21.15.31:0/2123202640 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.815+0000 7f2f19200640 1 --2- 172.21.15.31:0/2123202640 >> v2:172.21.15.102:3300/0 conn(0x7f2f1415ff70 0x7f2f141603e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1a600640 1 -- 172.21.15.31:0/2123202640 >> v2:172.21.15.102:3300/0 conn(0x7f2f1415ff70 msgr2=0x7f2f141603e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1a600640 1 --2- 172.21.15.31:0/2123202640 >> v2:172.21.15.102:3300/0 conn(0x7f2f1415ff70 0x7f2f141603e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1a600640 1 -- 172.21.15.31:0/2123202640 >> v1:172.21.15.102:6789/0 conn(0x7f2f1415c530 legacy=0x7f2f140d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1a600640 1 -- 172.21.15.31:0/2123202640 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1409b830 con 0x7f2f140ceb70 2024-09-15T22:52:41.823 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1a600640 1 --2- 172.21.15.31:0/2123202640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f140ceb70 0x7f2f140cefa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f14069260 tx=0x7f2f0c01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e19a3a4e226e7e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f13e00640 1 -- 172.21.15.31:0/2123202640 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a5760 con 0x7f2f140ceb70 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f13e00640 1 -- 172.21.15.31:0/2123202640 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0c0a5900 con 0x7f2f140ceb70 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f13e00640 1 -- 172.21.15.31:0/2123202640 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0c0a5cd0 con 0x7f2f140ceb70 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 -- 172.21.15.31:0/2123202640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f140ceb70 msgr2=0x7f2f140cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2123202640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f140ceb70 0x7f2f140cefa0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f2f14069260 tx=0x7f2f0c01c910 comp rx=0 tx=0).stop 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 -- 172.21.15.31:0/2123202640 shutdown_connections 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2123202640 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f140ceb70 0x7f2f140cefa0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2123202640 >> v2:172.21.15.102:3300/0 conn(0x7f2f1415ff70 0x7f2f141603e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 -- 172.21.15.31:0/2123202640 >> 172.21.15.31:0/2123202640 conn(0x7f2f140b3fe0 msgr2=0x7f2f140b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:41.824 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 -- 172.21.15.31:0/2123202640 shutdown_connections 2024-09-15T22:52:41.825 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.819+0000 7f2f1c600640 1 -- 172.21.15.31:0/2123202640 wait complete. 2024-09-15T22:52:41.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 Processor -- start 2024-09-15T22:52:41.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 -- start start 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f140ceb70 0x7f2f1415b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1415ff70 0x7f2f140b6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1415dc10 con 0x7f2f1415c530 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1415da90 con 0x7f2f140ceb70 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2f140d04e0 con 0x7f2f1415ff70 2024-09-15T22:52:41.827 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44758/0 (socket says 172.21.15.31:44758) 2024-09-15T22:52:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 -- 172.21.15.31:0/2944918417 learned_addr learned my addr 172.21.15.31:0/2944918417 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f140ceb70 0x7f2f1415b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.828 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1a600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1415ff70 0x7f2f140b6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 -- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1415ff70 msgr2=0x7f2f140b6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1415ff70 0x7f2f140b6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 -- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f140ceb70 msgr2=0x7f2f1415b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f140ceb70 0x7f2f1415b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 -- 172.21.15.31:0/2944918417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1415adc0 con 0x7f2f1415c530 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f19200640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e870 tx=0x7f2f0000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f00017070 con 0x7f2f1415c530 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f0000c940 con 0x7f2f1415c530 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f0000cd10 con 0x7f2f1415c530 2024-09-15T22:52:41.829 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.823+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f140b7470 con 0x7f2f1415c530 2024-09-15T22:52:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f141522a0 con 0x7f2f1415c530 2024-09-15T22:52:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f140cefa0 con 0x7f2f1415c530 2024-09-15T22:52:41.830 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2f0001a070 con 0x7f2f1415c530 2024-09-15T22:52:41.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f11600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 0x7f2ef4069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:41.831 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f2f00085d20 con 0x7f2f1415c530 2024-09-15T22:52:41.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.827+0000 7f2f19c00640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 0x7f2ef4069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:41.832 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.831+0000 7f2f19c00640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 0x7f2ef4069db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007fd0 tx=0x7f2f08009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:41.836 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:41.831+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2f00055fd0 con 0x7f2f1415c530 2024-09-15T22:52:42.036 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.031+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2f1409bd00 con 0x7f2f1415c530 2024-09-15T22:52:42.037 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f11600640 1 -- 172.21.15.31:0/2944918417 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f2f0005a2d0 con 0x7f2f1415c530 2024-09-15T22:52:42.037 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:42.038 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:42.038 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:42.039 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 msgr2=0x7f2ef4069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 0x7f2ef4069db0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2f08007fd0 tx=0x7f2f08009040 comp rx=0 tx=0).stop 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 msgr2=0x7f2f1415a880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f2f0000e870 tx=0x7f2f0000ed30 comp rx=0 tx=0).stop 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 shutdown_connections 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2ef40678f0 0x7f2ef4069db0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2f1415ff70 0x7f2f140b6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:42.040 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2f1415c530 0x7f2f1415a880 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 --2- 172.21.15.31:0/2944918417 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2f140ceb70 0x7f2f1415b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 >> 172.21.15.31:0/2944918417 conn(0x7f2f140b3fe0 msgr2=0x7f2f14154ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 shutdown_connections 2024-09-15T22:52:42.041 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:42.035+0000 7f2f1c600640 1 -- 172.21.15.31:0/2944918417 wait complete. 2024-09-15T22:52:42.059 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:42.222 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":22,"msgr_send_messages":24,"msgr_recv_bytes":12846,"msgr_send_bytes":55313,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.010953691,"msgr_running_send_time":0.001183730,"msgr_running_recv_time":0.004721042,"msgr_running_fast_dispatch_time":0.000431632,"msgr_send_messages_queue_lat":{"avgcount":22,"sum":0.003813812,"avgtime":0.000173355},"msgr_handle_ack_lat":{"avgcount":7,"sum":0.000003415,"avgtime":0.000000487},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":34,"msgr_send_messages":26,"msgr_recv_bytes":111208,"msgr_send_bytes":9271,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.009761497,"msgr_running_send_time":0.001220699,"msgr_running_recv_time":0.010205171,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.011327398,"avgtime":0.000435669},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107232,"msgr_send_encrypted_bytes":5984},"AsyncMessenger::Worker-2":{"msgr_recv_messages":24,"msgr_send_messages":28,"msgr_recv_bytes":13742,"msgr_send_bytes":68843,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006374173,"msgr_running_send_time":0.001240768,"msgr_running_recv_time":0.004114750,"msgr_running_fast_dispatch_time":0.000543782,"msgr_send_messages_queue_lat":{"avgcount":26,"sum":0.003602536,"avgtime":0.000138559},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":59216},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":46,"sum":0.003518615,"avgtime":0.000076491}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":2,"reply":0,"reply_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":10,"inodes_top":7,"inodes_bottom":3,"inodes_pin_tail":0,"inodes_pinned":10,"inodes_expired":0,"inodes_with_caps":1,"caps":1,"subtrees":2,"traverse":1,"traverse_hit":1,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":0,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":0},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":2,"evex":0,"evtrm":0,"ev":5,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4196434,"rdpos":4195244,"jlat":{"avgcount":2,"sum":0.004447368,"avgtime":0.002223684},"replayed":3},"mds_mem":{"ino":13,"ino+":13,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":10,"dn+":10,"dn-":0,"cap":1,"cap+":1,"cap-":0,"rss":41264,"heap":248116},"mds_server":{"dispatch_client_request":1,"dispatch_server_request":0,"handle_client_request":2,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":0,"average_load":0,"avg_session_uptime":906,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237141,"buffer_anon_items":65,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52528,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":46,"op_send_bytes":1469,"op_resend":0,"op_reply":46,"op_latency":{"avgcount":46,"sum":0.079999197,"avgtime":0.001739112},"op_inflight":0,"oplen_avg":{"avgcount":46,"sum":92},"op":46,"op_r":36,"op_w":10,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":2,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":1,"omap_rd":48,"omap_del":0},"oft":{"omap_total_objs":0,"omap_total_kv_pairs":0,"omap_total_updates":0,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":76,"get_sum":128457,"get_or_fail_fail":0,"get_or_fail_success":76,"take":0,"take_sum":0,"put":76,"put_sum":128457,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":2404,"put":46,"put_sum":2404,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":46,"take_sum":46,"put":46,"put_sum":46,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":2,"get_sum":931,"get_or_fail_fail":0,"get_or_fail_success":2,"take":0,"take_sum":0,"put":2,"put_sum":931,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:42.223 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 7, "avgtime": 4.87e-07, "sum": 3.415e-06 }, "msgr_recv_bytes": 12846, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 22, "msgr_running_fast_dispatch_time": 0.000431632, "msgr_running_recv_time": 0.004721042, "msgr_running_send_time": 0.00118373, "msgr_running_total_time": 0.010953691, "msgr_send_bytes": 55313, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 24, "msgr_send_messages_queue_lat": { "avgcount": 22, "avgtime": 0.000173355, "sum": 0.003813812 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111208, "msgr_recv_encrypted_bytes": 107232, "msgr_recv_messages": 34, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010205171, "msgr_running_send_time": 0.001220699, "msgr_running_total_time": 0.009761497, "msgr_send_bytes": 9271, "msgr_send_encrypted_bytes": 5984, "msgr_send_messages": 26, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.000435669, "sum": 0.011327398 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13742, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 24, "msgr_running_fast_dispatch_time": 0.000543782, "msgr_running_recv_time": 0.00411475, "msgr_running_send_time": 0.001240768, "msgr_running_total_time": 0.006374173, "msgr_send_bytes": 68843, "msgr_send_encrypted_bytes": 59216, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 26, "avgtime": 0.000138559, "sum": 0.003602536 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 46, "avgtime": 7.6491e-05, "sum": 0.003518615 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 1, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 10, "inodes_bottom": 3, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 10, "inodes_top": 7, "inodes_with_caps": 1, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 0, "q": 0, "reply": 0, "reply_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "request": 2, "root_rbytes": 0, "root_rfiles": 0, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 1, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 1, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 5, "evadd": 2, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 2, "avgtime": 0.002223684, "sum": 0.004447368 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4196434 }, "mds_mem": { "cap": 1, "cap+": 1, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 10, "dn+": 10, "dn-": 0, "heap": 248116, "ino": 13, "ino+": 13, "ino-": 0, "rss": 41264 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 1, "dispatch_server_request": 0, "handle_client_request": 2, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 0, "avg_session_uptime": 906, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 0 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237141, "buffer_anon_items": 65, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52528, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 0, "omap_rd": 48, "omap_wr": 1, "op": 46, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 46, "avgtime": 0.001739112, "sum": 0.079999197 }, "op_pg": 0, "op_r": 36, "op_reply": 46, "op_resend": 0, "op_rmw": 0, "op_send": 46, "op_send_bytes": 1469, "op_w": 10, "oplen_avg": { "avgcount": 46, "sum": 92 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 2, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 0, "omap_total_objs": 0, "omap_total_removes": 0, "omap_total_updates": 0 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 76, "get_or_fail_fail": 0, "get_or_fail_success": 76, "get_started": 0, "get_sum": 128457, "max": 104857600, "put": 76, "put_sum": 128457, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 46, "put_sum": 2404, "take": 46, "take_sum": 2404, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 46, "put_sum": 46, "take": 46, "take_sum": 46, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 2, "get_or_fail_fail": 0, "get_or_fail_success": 2, "get_started": 0, "get_sum": 931, "max": 3758096384, "put": 2, "put_sum": 931, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:42.223 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_0:0 2024-09-15T22:52:42.224 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:42.224 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:42.233 DEBUG:teuthology.orchestra.run.smithi031:> stdin-killer -- python3 -c ' 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> import fcntl 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> import os 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> import sys 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> import time 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> fcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK) 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> with open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", '"'"'w'"'"') as f: 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> f.write("content") 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> f.flush() 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> while True: 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> print("open_background: keeping file open", file=sys.stderr) 2024-09-15T22:52:42.234 DEBUG:teuthology.orchestra.run.smithi031:> try: 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> if os.read(0, 4096) == b"": 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> break 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> except BlockingIOError: 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> pass 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> time.sleep(2) 2024-09-15T22:52:42.235 DEBUG:teuthology.orchestra.run.smithi031:> ' 2024-09-15T22:52:42.283 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-09-15T22:52:42.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:52:42.291 INFO:teuthology.orchestra.run.smithi031.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0/omap_counter_test_file': No such file or directory 2024-09-15T22:52:42.352 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:43.292 DEBUG:teuthology.orchestra.run.smithi031:> stat --printf=%s /home/ubuntu/cephtest/mnt.0/omap_counter_test_file 2024-09-15T22:52:43.302 INFO:teuthology.orchestra.run.smithi031.stdout:7 2024-09-15T22:52:43.303 INFO:tasks.cephfs.mount:File omap_counter_test_file became visible with size 7 from 0 after 1s 2024-09-15T22:52:43.303 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:43.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 Processor -- start 2024-09-15T22:52:43.497 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 -- start start 2024-09-15T22:52:43.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 0x7fa850071e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:43.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa850071030 con 0x7fa85009b730 2024-09-15T22:52:43.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa85009ac50 con 0x7fa8500d0af0 2024-09-15T22:52:43.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa857200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa85009af30 con 0x7fa85015fb60 2024-09-15T22:52:43.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84f400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa85009b730 0x7fa8500d03e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55814/0 (socket says 172.21.15.31:55814) 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84f400640 1 -- 172.21.15.31:0/3413011537 learned_addr learned my addr 172.21.15.31:0/3413011537 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3413011537 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 0x7fa850071e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882928484 0 0) 0x7fa850071030 con 0x7fa85009b730 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa834003530 con 0x7fa85009b730 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155128741 0 0) 0x7fa85009ac50 con 0x7fa8500d0af0 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa850071030 con 0x7fa8500d0af0 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84fe00640 1 -- 172.21.15.31:0/3413011537 >> v1:172.21.15.102:6789/0 conn(0x7fa8500d0af0 legacy=0x7fa8500ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84fe00640 1 -- 172.21.15.31:0/3413011537 >> v1:172.21.15.31:6789/0 conn(0x7fa85009b730 legacy=0x7fa8500d03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.500 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.495+0000 7fa84fe00640 1 -- 172.21.15.31:0/3413011537 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85009b210 con 0x7fa85015fb60 2024-09-15T22:52:43.502 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3413011537 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 0x7fa850071e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097f0 tx=0x7fa84001c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fef5e4a9071aad29 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400ab5f0 con 0x7fa85015fb60 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8400b0070 con 0x7fa85015fb60 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa84ea00640 1 -- 172.21.15.31:0/3413011537 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8400ab9b0 con 0x7fa85015fb60 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 -- 172.21.15.31:0/3413011537 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 msgr2=0x7fa850071e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 --2- 172.21.15.31:0/3413011537 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 0x7fa850071e80 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa8400097f0 tx=0x7fa84001c4e0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 -- 172.21.15.31:0/3413011537 shutdown_connections 2024-09-15T22:52:43.503 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 --2- 172.21.15.31:0/3413011537 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85015fb60 0x7fa850071e80 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 -- 172.21.15.31:0/3413011537 >> 172.21.15.31:0/3413011537 conn(0x7fa8500d2370 msgr2=0x7fa8500d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:43.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 -- 172.21.15.31:0/3413011537 shutdown_connections 2024-09-15T22:52:43.504 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.499+0000 7fa857200640 1 -- 172.21.15.31:0/3413011537 wait complete. 2024-09-15T22:52:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 Processor -- start 2024-09-15T22:52:43.505 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- start start 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 0x7fa8501564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa85015fb60 0x7fa8500b0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa850071720 con 0x7fa8500d0af0 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa8500715a0 con 0x7fa85015fb60 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa85009bb10 con 0x7fa85009b730 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:43.507 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44772/0 (socket says 172.21.15.31:44772) 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 -- 172.21.15.31:0/3728398267 learned_addr learned my addr 172.21.15.31:0/3728398267 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 0x7fa8501564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa855200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa85015fb60 0x7fa8500b0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 -- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 msgr2=0x7fa8501564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 0x7fa8501564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 -- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa85015fb60 msgr2=0x7fa8500b0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa85015fb60 0x7fa8500b0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 -- 172.21.15.31:0/3728398267 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa850164560 con 0x7fa8500d0af0 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 0x7fa8501564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:43.508 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa84f400640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa83c005890 tx=0x7fa83c00c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:43.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c017070 con 0x7fa8500d0af0 2024-09-15T22:52:43.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa83c005cf0 con 0x7fa8500d0af0 2024-09-15T22:52:43.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8500b7f80 con 0x7fa8500d0af0 2024-09-15T22:52:43.509 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa83c0072b0 con 0x7fa8500d0af0 2024-09-15T22:52:43.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8500cc4b0 con 0x7fa8500d0af0 2024-09-15T22:52:43.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.503+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8500cc6b0 con 0x7fa8500d0af0 2024-09-15T22:52:43.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.507+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa83c01a070 con 0x7fa8500d0af0 2024-09-15T22:52:43.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.507+0000 7fa847e00640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 0x7fa830069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:43.510 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.507+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fa83c085330 con 0x7fa8500d0af0 2024-09-15T22:52:43.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.507+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 0x7fa830069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:43.511 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.507+0000 7fa84fe00640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 0x7fa830069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8400af000 tx=0x7fa8400b6040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:43.515 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.511+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa83c055bf0 con 0x7fa8500d0af0 2024-09-15T22:52:43.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa85009ac50 con 0x7fa8500d0af0 2024-09-15T22:52:43.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa847e00640 1 -- 172.21.15.31:0/3728398267 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7fa83c0554f0 con 0x7fa8500d0af0 2024-09-15T22:52:43.714 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:43.714 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:43.714 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 msgr2=0x7fa830069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 0x7fa830069d80 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8400af000 tx=0x7fa8400b6040 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 msgr2=0x7fa8501559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa83c005890 tx=0x7fa83c00c960 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 shutdown_connections 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa8300678c0 0x7fa830069d80 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa85015fb60 0x7fa8500b0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa8500d0af0 0x7fa8501559c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 --2- 172.21.15.31:0/3728398267 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa85009b730 0x7fa8501564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:43.716 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 >> 172.21.15.31:0/3728398267 conn(0x7fa8500d2370 msgr2=0x7fa8500b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 shutdown_connections 2024-09-15T22:52:43.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:43.711+0000 7fa857200640 1 -- 172.21.15.31:0/3728398267 wait complete. 2024-09-15T22:52:43.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:43.900 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":29,"msgr_send_messages":29,"msgr_recv_bytes":15292,"msgr_send_bytes":58299,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.011884284,"msgr_running_send_time":0.001626397,"msgr_running_recv_time":0.004991606,"msgr_running_fast_dispatch_time":0.000633928,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.004066316,"avgtime":0.000150604},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000003912,"avgtime":0.000000489},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":35,"msgr_send_messages":27,"msgr_recv_bytes":111480,"msgr_send_bytes":9911,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.009959431,"msgr_running_send_time":0.001366601,"msgr_running_recv_time":0.010260362,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.011433613,"avgtime":0.000423467},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107504,"msgr_send_encrypted_bytes":6624},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":29,"msgr_recv_bytes":13988,"msgr_send_bytes":70889,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006472747,"msgr_running_send_time":0.001286993,"msgr_running_recv_time":0.004135186,"msgr_running_fast_dispatch_time":0.000566604,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.003633216,"avgtime":0.000134563},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":59216},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":50,"sum":0.003864313,"avgtime":0.000077286}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198162,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.006152654,"avgtime":0.002050884},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41964,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":906,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237141,"buffer_anon_items":65,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52528,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3733,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.091999077,"avgtime":0.001803903},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":85,"get_sum":130607,"get_or_fail_fail":0,"get_or_fail_success":85,"take":0,"take_sum":0,"put":85,"put_sum":130607,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4668,"put":51,"put_sum":4668,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2659,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2659,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:43.902 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 4.89e-07, "sum": 3.912e-06 }, "msgr_recv_bytes": 15292, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 29, "msgr_running_fast_dispatch_time": 0.000633928, "msgr_running_recv_time": 0.004991606, "msgr_running_send_time": 0.001626397, "msgr_running_total_time": 0.011884284, "msgr_send_bytes": 58299, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000150604, "sum": 0.004066316 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111480, "msgr_recv_encrypted_bytes": 107504, "msgr_recv_messages": 35, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010260362, "msgr_running_send_time": 0.001366601, "msgr_running_total_time": 0.009959431, "msgr_send_bytes": 9911, "msgr_send_encrypted_bytes": 6624, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000423467, "sum": 0.011433613 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13988, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000566604, "msgr_running_recv_time": 0.004135186, "msgr_running_send_time": 0.001286993, "msgr_running_total_time": 0.006472747, "msgr_send_bytes": 70889, "msgr_send_encrypted_bytes": 59216, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000134563, "sum": 0.003633216 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 50, "avgtime": 7.7286e-05, "sum": 0.003864313 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002050884, "sum": 0.006152654 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198162 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41964 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 906, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237141, "buffer_anon_items": 65, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52528, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.001803903, "sum": 0.091999077 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3733, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 85, "get_or_fail_fail": 0, "get_or_fail_success": 85, "get_started": 0, "get_sum": 130607, "max": 104857600, "put": 85, "put_sum": 130607, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4668, "take": 51, "take_sum": 4668, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2659, "max": 3758096384, "put": 3, "put_sum": 2659, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:43.902 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-15T22:52:43.902 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.039+0000 7f54b5c00640 1 Processor -- start 2024-09-15T22:52:44.044 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.039+0000 7f54b5c00640 1 -- start start 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54b5c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54b00b4ba0 0x7f54b015bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54b5c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b00cfe60 con 0x7f54b0073750 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54b5c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54b00d0100 con 0x7f54b015c000 2024-09-15T22:52:44.045 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54b5c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f54b00d03e0 con 0x7f54b00b4ba0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54a6000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f54b00b4ba0 0x7f54b015bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54aea00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f54b0073750 0x7f54b00b4490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:55820/0 (socket says 172.21.15.31:55820) 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54aea00640 1 -- 172.21.15.31:0/4139829634 learned_addr learned my addr 172.21.15.31:0/4139829634 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:44.046 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54a6000640 1 -- 172.21.15.31:0/4139829634 >> v1:172.21.15.102:6789/0 conn(0x7f54b015c000 legacy=0x7f54b00adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54a6000640 1 -- 172.21.15.31:0/4139829634 >> v1:172.21.15.31:6789/0 conn(0x7f54b0073750 legacy=0x7f54b00b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54a6000640 1 -- 172.21.15.31:0/4139829634 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b00d06c0 con 0x7f54b00b4ba0 2024-09-15T22:52:44.047 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.043+0000 7f54ae000640 1 -- 172.21.15.31:0/4139829634 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001322803 0 0) 0x7f54b00cfe60 con 0x7f54b0073750 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54a6000640 1 --2- 172.21.15.31:0/4139829634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b00b4ba0 0x7f54b015bac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f54980097c0 tx=0x7f549801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66835e3e5b34a951 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54ae000640 1 -- 172.21.15.31:0/4139829634 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980ab600 con 0x7f54b00b4ba0 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54ae000640 1 -- 172.21.15.31:0/4139829634 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54980b0070 con 0x7f54b00b4ba0 2024-09-15T22:52:44.049 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54ae000640 1 -- 172.21.15.31:0/4139829634 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54980ab9c0 con 0x7f54b00b4ba0 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- 172.21.15.31:0/4139829634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b00b4ba0 msgr2=0x7f54b015bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 --2- 172.21.15.31:0/4139829634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b00b4ba0 0x7f54b015bac0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f54980097c0 tx=0x7f549801c3e0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- 172.21.15.31:0/4139829634 shutdown_connections 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 --2- 172.21.15.31:0/4139829634 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b00b4ba0 0x7f54b015bac0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- 172.21.15.31:0/4139829634 >> 172.21.15.31:0/4139829634 conn(0x7f54b00b20a0 msgr2=0x7f54b00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.050 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- 172.21.15.31:0/4139829634 shutdown_connections 2024-09-15T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- 172.21.15.31:0/4139829634 wait complete. 2024-09-15T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 Processor -- start 2024-09-15T22:52:44.051 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 -- start start 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.047+0000 7f54b5c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54b00b4ba0 0x7f54b015c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54b015c000 0x7f54b015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f54b015c590 con 0x7f54b0073750 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f54b015c410 con 0x7f54b015c000 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f54b0168e80 con 0x7f54b00b4ba0 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:44778/0 (socket says 172.21.15.31:44778) 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 -- 172.21.15.31:0/2355868274 learned_addr learned my addr 172.21.15.31:0/2355868274 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54af400640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54b015c000 0x7f54b015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.053 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54a6000640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54b00b4ba0 0x7f54b015c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 -- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54b00b4ba0 msgr2=0x7f54b015c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.054 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54b00b4ba0 0x7f54b015c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 -- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54b015c000 msgr2=0x7f54b015a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54b015c000 0x7f54b015a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 -- 172.21.15.31:0/2355868274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54b014b670 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54aea00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c4a0 tx=0x7f54a000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0018070 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54a00074e0 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54a0004a30 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54b015d450 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54b015da10 con 0x7f54b0073750 2024-09-15T22:52:44.055 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b015bac0 con 0x7f54b0073750 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.051+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f54a0004bd0 con 0x7f54b0073750 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.055+0000 7f54a7400640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 0x7f548c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:44.056 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.055+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f54a00851e0 con 0x7f54b0073750 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.055+0000 7f54a6000640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 0x7f548c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:44.057 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.055+0000 7f54a6000640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 0x7f548c069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f54980af000 tx=0x7f54980a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:44.060 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.059+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f54a0055450 con 0x7f54b0073750 2024-09-15T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.259+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54b0152370 con 0x7f54b0073750 2024-09-15T22:52:44.262 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.259+0000 7f54a7400640 1 -- 172.21.15.31:0/2355868274 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f54a0059750 con 0x7f54b0073750 2024-09-15T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:44.263 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 msgr2=0x7f548c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 0x7f548c069d80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f54980af000 tx=0x7f54980a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:44.265 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 msgr2=0x7f54b014b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f54a000c4a0 tx=0x7f54a000c960 comp rx=0 tx=0).stop 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 shutdown_connections 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f548c0678c0 0x7f548c069d80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f54b015c000 0x7f54b015a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f54b00b4ba0 0x7f54b015c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 --2- 172.21.15.31:0/2355868274 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f54b0073750 0x7f54b014b130 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 >> 172.21.15.31:0/2355868274 conn(0x7f54b00b20a0 msgr2=0x7f54b006e970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 shutdown_connections 2024-09-15T22:52:44.266 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44.263+0000 7f54b5c00640 1 -- 172.21.15.31:0/2355868274 wait complete. 2024-09-15T22:52:44.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:44.352 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:44.446 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":29,"msgr_send_messages":29,"msgr_recv_bytes":15292,"msgr_send_bytes":58299,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.011884284,"msgr_running_send_time":0.001626397,"msgr_running_recv_time":0.004991606,"msgr_running_fast_dispatch_time":0.000633928,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.004066316,"avgtime":0.000150604},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000003912,"avgtime":0.000000489},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":35,"msgr_send_messages":27,"msgr_recv_bytes":111480,"msgr_send_bytes":9911,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.009959431,"msgr_running_send_time":0.001366601,"msgr_running_recv_time":0.010260362,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.011433613,"avgtime":0.000423467},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107504,"msgr_send_encrypted_bytes":6624},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":29,"msgr_recv_bytes":13988,"msgr_send_bytes":70889,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006472747,"msgr_running_send_time":0.001286993,"msgr_running_recv_time":0.004135186,"msgr_running_fast_dispatch_time":0.000566604,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.003633216,"avgtime":0.000134563},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":59216},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":50,"sum":0.003864313,"avgtime":0.000077286}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198162,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.006152654,"avgtime":0.002050884},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":41964,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":906,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237141,"buffer_anon_items":65,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":52528,"mds_co_items":189,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3733,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.091999077,"avgtime":0.001803903},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":85,"get_sum":130607,"get_or_fail_fail":0,"get_or_fail_success":85,"take":0,"take_sum":0,"put":85,"put_sum":130607,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4668,"put":51,"put_sum":4668,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2659,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2659,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:44.448 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 4.89e-07, "sum": 3.912e-06 }, "msgr_recv_bytes": 15292, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 29, "msgr_running_fast_dispatch_time": 0.000633928, "msgr_running_recv_time": 0.004991606, "msgr_running_send_time": 0.001626397, "msgr_running_total_time": 0.011884284, "msgr_send_bytes": 58299, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000150604, "sum": 0.004066316 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111480, "msgr_recv_encrypted_bytes": 107504, "msgr_recv_messages": 35, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010260362, "msgr_running_send_time": 0.001366601, "msgr_running_total_time": 0.009959431, "msgr_send_bytes": 9911, "msgr_send_encrypted_bytes": 6624, "msgr_send_messages": 27, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000423467, "sum": 0.011433613 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13988, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000566604, "msgr_running_recv_time": 0.004135186, "msgr_running_send_time": 0.001286993, "msgr_running_total_time": 0.006472747, "msgr_send_bytes": 70889, "msgr_send_encrypted_bytes": 59216, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000134563, "sum": 0.003633216 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 50, "avgtime": 7.7286e-05, "sum": 0.003864313 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002050884, "sum": 0.006152654 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198162 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 41964 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 906, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237141, "buffer_anon_items": 65, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 52528, "mds_co_items": 189, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.001803903, "sum": 0.091999077 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3733, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 85, "get_or_fail_fail": 0, "get_or_fail_success": 85, "get_started": 0, "get_sum": 130607, "max": 104857600, "put": 85, "put_sum": 130607, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4668, "take": 51, "take_sum": 4668, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2659, "max": 3758096384, "put": 3, "put_sum": 2659, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:44.448 INFO:tasks.cephfs.test_openfiletable:omap_total_updates_1:2 2024-09-15T22:52:44.448 DEBUG:tasks.cephfs.mount:terminating RemoteProcess(client=, args=['stdin-killer', '--', 'python3', '-c', '\nimport fcntl\nimport os\nimport sys\nimport time\n\nfcntl.fcntl(sys.stdin, fcntl.F_SETFL, fcntl.fcntl(sys.stdin, fcntl.F_GETFL) | os.O_NONBLOCK)\n\nwith open("/home/ubuntu/cephtest/mnt.0/omap_counter_test_file", \'w\') as f:\n f.write("content")\n f.flush()\n while True:\n print("open_background: keeping file open", file=sys.stderr)\n try:\n if os.read(0, 4096) == b"":\n break\n except BlockingIOError:\n pass\n time.sleep(2)\n'], check_status=True, hostname='smithi031') 2024-09-15T22:52:44.449 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:44 stdin-killer INFO: expiration expected; waiting 5 seconds for command to complete 2024-09-15T22:52:44.661 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:52:44.664 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:52:46.355 INFO:teuthology.orchestra.run.smithi031.stderr:open_background: keeping file open 2024-09-15T22:52:46.359 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-15T22:52:46.369 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:46.519 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.515+0000 7f0c5d000640 1 Processor -- start 2024-09-15T22:52:46.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.515+0000 7f0c5d000640 1 -- start start 2024-09-15T22:52:46.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c5d000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f0c58073750 0x7f0c580b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:46.520 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c5d000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c580cfe60 con 0x7f0c5815c1d0 2024-09-15T22:52:46.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c5d000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c580d0100 con 0x7f0c580b49d0 2024-09-15T22:52:46.521 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c5d000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f0c580d03e0 con 0x7f0c58073750 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c56800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0c5815c1d0 0x7f0c580adde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59606/0 (socket says 172.21.15.31:59606) 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c56800640 1 -- 172.21.15.31:0/3184095983 learned_addr learned my addr 172.21.15.31:0/3184095983 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55e00640 1 --2- 172.21.15.31:0/3184095983 >> v2:172.21.15.102:3300/0 conn(0x7f0c58073750 0x7f0c580b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910114431 0 0) 0x7f0c580cfe60 con 0x7f0c5815c1d0 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c3c003530 con 0x7f0c5815c1d0 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367965751 0 0) 0x7f0c580d0100 con 0x7f0c580b49d0 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c580cfe60 con 0x7f0c580b49d0 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55e00640 1 -- 172.21.15.31:0/3184095983 >> v1:172.21.15.102:6789/0 conn(0x7f0c580b49d0 legacy=0x7f0c5815bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55e00640 1 -- 172.21.15.31:0/3184095983 >> v1:172.21.15.31:6789/0 conn(0x7f0c5815c1d0 legacy=0x7f0c580adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.522 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.519+0000 7f0c55e00640 1 -- 172.21.15.31:0/3184095983 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c580d06c0 con 0x7f0c58073750 2024-09-15T22:52:46.524 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c55e00640 1 --2- 172.21.15.31:0/3184095983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c580b4490 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097c0 tx=0x7f0c4801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52f1a34620675fe9 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:46.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480b0070 con 0x7f0c58073750 2024-09-15T22:52:46.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c480ab600 con 0x7f0c58073750 2024-09-15T22:52:46.525 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c55400640 1 -- 172.21.15.31:0/3184095983 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c480ab9d0 con 0x7f0c58073750 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- 172.21.15.31:0/3184095983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 msgr2=0x7f0c580b4490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 --2- 172.21.15.31:0/3184095983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c580b4490 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0c480097c0 tx=0x7f0c4801c4a0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- 172.21.15.31:0/3184095983 shutdown_connections 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 --2- 172.21.15.31:0/3184095983 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c580b4490 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- 172.21.15.31:0/3184095983 >> 172.21.15.31:0/3184095983 conn(0x7f0c580b20a0 msgr2=0x7f0c580b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- 172.21.15.31:0/3184095983 shutdown_connections 2024-09-15T22:52:46.526 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- 172.21.15.31:0/3184095983 wait complete. 2024-09-15T22:52:46.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 Processor -- start 2024-09-15T22:52:46.527 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.523+0000 7f0c5d000640 1 -- start start 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c58145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c5815c1d0 0x7f0c5815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580b3450 con 0x7f0c580b49d0 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0c580b32d0 con 0x7f0c58073750 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0c580b35d0 con 0x7f0c5815c1d0 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57410/0 (socket says 172.21.15.31:57410) 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 -- 172.21.15.31:0/240957885 learned_addr learned my addr 172.21.15.31:0/240957885 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:46.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c55e00640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c58145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c56800640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c5815c1d0 0x7f0c5815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 -- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c5815c1d0 msgr2=0x7f0c5815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c5815c1d0 0x7f0c5815a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 -- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 msgr2=0x7f0c58145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c58145ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 -- 172.21.15.31:0/240957885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c58154350 con 0x7f0c580b49d0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4d400640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000c4c0 tx=0x7f0c4000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c400052d0 con 0x7f0c580b49d0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c40005470 con 0x7f0c580b49d0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c40012870 con 0x7f0c580b49d0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c58155510 con 0x7f0c580b49d0 2024-09-15T22:52:46.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c58155ad0 con 0x7f0c580b49d0 2024-09-15T22:52:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c581552d0 con 0x7f0c580b49d0 2024-09-15T22:52:46.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.527+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0c40012a10 con 0x7f0c580b49d0 2024-09-15T22:52:46.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.531+0000 7f0c4ea00640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 0x7f0c34069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:46.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.531+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f0c40085bc0 con 0x7f0c580b49d0 2024-09-15T22:52:46.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.531+0000 7f0c55e00640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 0x7f0c34069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:46.533 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.531+0000 7f0c55e00640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 0x7f0c34069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ad000 tx=0x7f0c480a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:46.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.535+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0c40056480 con 0x7f0c580b49d0 2024-09-15T22:52:46.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.731+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0c58072d40 con 0x7f0c580b49d0 2024-09-15T22:52:46.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.731+0000 7f0c4ea00640 1 -- 172.21.15.31:0/240957885 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f0c40055d80 con 0x7f0c580b49d0 2024-09-15T22:52:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:46.736 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:46.736 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 msgr2=0x7f0c34069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 0x7f0c34069d80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0c480ad000 tx=0x7f0c480a6000 comp rx=0 tx=0).stop 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 msgr2=0x7f0c58153e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f0c4000c4c0 tx=0x7f0c4000c980 comp rx=0 tx=0).stop 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 shutdown_connections 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0c340678c0 0x7f0c34069d80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.738 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0c5815c1d0 0x7f0c5815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0c580b49d0 0x7f0c58153e10 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 --2- 172.21.15.31:0/240957885 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0c58073750 0x7f0c58145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:46.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 >> 172.21.15.31:0/240957885 conn(0x7f0c580b20a0 msgr2=0x7f0c5806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:46.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 shutdown_connections 2024-09-15T22:52:46.739 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:46.735+0000 7f0c5d000640 1 -- 172.21.15.31:0/240957885 wait complete. 2024-09-15T22:52:46.757 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:46.921 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":32,"msgr_send_messages":29,"msgr_recv_bytes":16498,"msgr_send_bytes":58299,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.012597379,"msgr_running_send_time":0.001931191,"msgr_running_recv_time":0.005197715,"msgr_running_fast_dispatch_time":0.000826781,"msgr_send_messages_queue_lat":{"avgcount":27,"sum":0.004066316,"avgtime":0.000150604},"msgr_handle_ack_lat":{"avgcount":8,"sum":0.000003912,"avgtime":0.000000489},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":36,"msgr_send_messages":28,"msgr_recv_bytes":111752,"msgr_send_bytes":10551,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.010075630,"msgr_running_send_time":0.001445530,"msgr_running_recv_time":0.010306687,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.011491591,"avgtime":0.000410413},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":107776,"msgr_send_encrypted_bytes":7264},"AsyncMessenger::Worker-2":{"msgr_recv_messages":25,"msgr_send_messages":30,"msgr_recv_bytes":13988,"msgr_send_bytes":72697,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006532085,"msgr_running_send_time":0.001335605,"msgr_running_recv_time":0.004135186,"msgr_running_fast_dispatch_time":0.000566604,"msgr_send_messages_queue_lat":{"avgcount":28,"sum":0.003670459,"avgtime":0.000131087},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":61024},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":50,"sum":0.003864313,"avgtime":0.000077286}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":0,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":0,"handle_client_caps_dirty":0,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":3,"evex":0,"evtrm":0,"ev":6,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4198162,"rdpos":4195244,"jlat":{"avgcount":3,"sum":0.006152654,"avgtime":0.002050884},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42220,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":0,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":911,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237703,"buffer_anon_items":70,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55847,"mds_co_items":229,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":51,"op_send_bytes":3733,"op_resend":0,"op_reply":51,"op_latency":{"avgcount":51,"sum":0.091999077,"avgtime":0.001803903},"op_inflight":0,"oplen_avg":{"avgcount":51,"sum":104},"op":51,"op_r":36,"op_w":15,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":3,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":9,"omap_rd":48,"omap_del":3},"oft":{"omap_total_objs":2,"omap_total_kv_pairs":2,"omap_total_updates":2,"omap_total_removes":0},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":89,"get_sum":131721,"get_or_fail_fail":0,"get_or_fail_success":89,"take":0,"take_sum":0,"put":89,"put_sum":131721,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":4668,"put":51,"put_sum":4668,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":51,"take_sum":51,"put":51,"put_sum":51,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":3,"get_sum":2659,"get_or_fail_fail":0,"get_or_fail_success":3,"take":0,"take_sum":0,"put":3,"put_sum":2659,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:46.922 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 8, "avgtime": 4.89e-07, "sum": 3.912e-06 }, "msgr_recv_bytes": 16498, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 32, "msgr_running_fast_dispatch_time": 0.000826781, "msgr_running_recv_time": 0.005197715, "msgr_running_send_time": 0.001931191, "msgr_running_total_time": 0.012597379, "msgr_send_bytes": 58299, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 27, "avgtime": 0.000150604, "sum": 0.004066316 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 111752, "msgr_recv_encrypted_bytes": 107776, "msgr_recv_messages": 36, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010306687, "msgr_running_send_time": 0.00144553, "msgr_running_total_time": 0.01007563, "msgr_send_bytes": 10551, "msgr_send_encrypted_bytes": 7264, "msgr_send_messages": 28, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.000410413, "sum": 0.011491591 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 13988, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 25, "msgr_running_fast_dispatch_time": 0.000566604, "msgr_running_recv_time": 0.004135186, "msgr_running_send_time": 0.001335605, "msgr_running_total_time": 0.006532085, "msgr_send_bytes": 72697, "msgr_send_encrypted_bytes": 61024, "msgr_send_messages": 30, "msgr_send_messages_queue_lat": { "avgcount": 28, "avgtime": 0.000131087, "sum": 0.003670459 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 50, "avgtime": 7.7286e-05, "sum": 0.003864313 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 0, "handle_client_caps_dirty": 0, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 0, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 6, "evadd": 3, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 3, "avgtime": 0.002050884, "sum": 0.006152654 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4198162 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42220 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 0, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 911, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237703, "buffer_anon_items": 70, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 55847, "mds_co_items": 229, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 3, "omap_rd": 48, "omap_wr": 9, "op": 51, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 51, "avgtime": 0.001803903, "sum": 0.091999077 }, "op_pg": 0, "op_r": 36, "op_reply": 51, "op_resend": 0, "op_rmw": 0, "op_send": 51, "op_send_bytes": 3733, "op_w": 15, "oplen_avg": { "avgcount": 51, "sum": 104 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 3, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 2, "omap_total_objs": 2, "omap_total_removes": 0, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 89, "get_or_fail_fail": 0, "get_or_fail_success": 89, "get_started": 0, "get_sum": 131721, "max": 104857600, "put": 89, "put_sum": 131721, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 51, "put_sum": 4668, "take": 51, "take_sum": 4668, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 51, "put_sum": 51, "take": 51, "take_sum": 51, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 3, "get_or_fail_fail": 0, "get_or_fail_success": 3, "get_started": 0, "get_sum": 2659, "max": 3758096384, "put": 3, "put_sum": 2659, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:46.922 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=120 retry_count=0)... 2024-09-15T22:52:51.924 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:52.073 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 Processor -- start 2024-09-15T22:52:52.074 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 -- start start 2024-09-15T22:52:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a3c073750 0x7f3a3c0b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 0x7f3a3c0adde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3c0cfe60 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3c0d0100 con 0x7f3a3c073750 2024-09-15T22:52:52.075 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a44800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c0d03e0 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a41400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f3a3c0b49d0 0x7f3a3c15bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59622/0 (socket says 172.21.15.31:59622) 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a41400640 1 -- 172.21.15.31:0/4111739631 learned_addr learned my addr 172.21.15.31:0/4111739631 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a42800640 1 --2- 172.21.15.31:0/4111739631 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 0x7f3a3c0adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a41e00640 1 --2- 172.21.15.31:0/4111739631 >> v2:172.21.15.102:3300/0 conn(0x7f3a3c073750 0x7f3a3c0b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750896785 0 0) 0x7f3a3c0cfe60 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.076 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a24003530 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a42800640 1 -- 172.21.15.31:0/4111739631 >> v2:172.21.15.102:3300/0 conn(0x7f3a3c073750 msgr2=0x7f3a3c0b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:52.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a42800640 1 --2- 172.21.15.31:0/4111739631 >> v2:172.21.15.102:3300/0 conn(0x7f3a3c073750 0x7f3a3c0b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a42800640 1 -- 172.21.15.31:0/4111739631 >> v1:172.21.15.31:6789/0 conn(0x7f3a3c0b49d0 legacy=0x7f3a3c15bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2143189168 0 0) 0x7f3a24003530 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.077 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.071+0000 7f3a42800640 1 -- 172.21.15.31:0/4111739631 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c0d06c0 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a42800640 1 --2- 172.21.15.31:0/4111739631 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 0x7f3a3c0adde0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009d90 tx=0x7f3a3801c890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3cd3f8ba0dc1a28 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a380ac070 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a380a64a0 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a40a00640 1 -- 172.21.15.31:0/4111739631 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0016a0 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 -- 172.21.15.31:0/4111739631 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 msgr2=0x7f3a3c0adde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 --2- 172.21.15.31:0/4111739631 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 0x7f3a3c0adde0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3a38009d90 tx=0x7f3a3801c890 comp rx=0 tx=0).stop 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 -- 172.21.15.31:0/4111739631 shutdown_connections 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 --2- 172.21.15.31:0/4111739631 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c15c1d0 0x7f3a3c0adde0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 --2- 172.21.15.31:0/4111739631 >> v2:172.21.15.102:3300/0 conn(0x7f3a3c073750 0x7f3a3c0b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 -- 172.21.15.31:0/4111739631 >> 172.21.15.31:0/4111739631 conn(0x7f3a3c0b20a0 msgr2=0x7f3a3c0b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 -- 172.21.15.31:0/4111739631 shutdown_connections 2024-09-15T22:52:52.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.075+0000 7f3a44800640 1 -- 172.21.15.31:0/4111739631 wait complete. 2024-09-15T22:52:52.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 Processor -- start 2024-09-15T22:52:52.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- start start 2024-09-15T22:52:52.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c073750 0x7f3a3c15f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a3c15c1d0 0x7f3a3c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c0aecb0 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a3c0aeb30 con 0x7f3a3c15c1d0 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a3c0aee30 con 0x7f3a3c073750 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57416/0 (socket says 172.21.15.31:57416) 2024-09-15T22:52:52.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 -- 172.21.15.31:0/708158931 learned_addr learned my addr 172.21.15.31:0/708158931 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a42800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a3c15c1d0 0x7f3a3c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41e00640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c073750 0x7f3a3c15f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 -- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c073750 msgr2=0x7f3a3c15f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c073750 0x7f3a3c15f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 -- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a3c15c1d0 msgr2=0x7f3a3c1520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a3c15c1d0 0x7f3a3c1520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 -- 172.21.15.31:0/708158931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3c149960 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a41400640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c730 tx=0x7f3a2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c018070 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a2c0072f0 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a2c0047f0 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a3c153870 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.079+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3c154360 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3c153e50 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a2c004990 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a36000640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 0x7f3a20069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f3a2c085480 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a41e00640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 0x7f3a20069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.083+0000 7f3a41e00640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 0x7f3a20069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009a50 tx=0x7f3a30008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.087+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3a3c149960 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.283+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a3c152ed0 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a36000640 1 -- 172.21.15.31:0/708158931 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f3a2c055d40 con 0x7f3a3c0b49d0 2024-09-15T22:52:52.289 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:52.289 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:52.289 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:52.290 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 msgr2=0x7f3a20069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 0x7f3a20069d80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f3a30009a50 tx=0x7f3a30008040 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 msgr2=0x7f3a3c146680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3a2c00c730 tx=0x7f3a2c00cbf0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 shutdown_connections 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a200678c0 0x7f3a20069d80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a3c15c1d0 0x7f3a3c1520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a3c0b49d0 0x7f3a3c146680 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 --2- 172.21.15.31:0/708158931 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a3c073750 0x7f3a3c15f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 >> 172.21.15.31:0/708158931 conn(0x7f3a3c0b20a0 msgr2=0x7f3a3c0cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 shutdown_connections 2024-09-15T22:52:52.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.287+0000 7f3a44800640 1 -- 172.21.15.31:0/708158931 wait complete. 2024-09-15T22:52:52.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:52.476 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":42,"msgr_send_messages":34,"msgr_recv_bytes":19938,"msgr_send_bytes":59991,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.014255205,"msgr_running_send_time":0.002679870,"msgr_running_recv_time":0.005695817,"msgr_running_fast_dispatch_time":0.001242482,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.004242777,"avgtime":0.000132586},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000004978,"avgtime":0.000000497},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":37,"msgr_send_messages":29,"msgr_recv_bytes":112024,"msgr_send_bytes":11191,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.010313409,"msgr_running_send_time":0.001598652,"msgr_running_recv_time":0.010366483,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.011591570,"avgtime":0.000399709},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":108048,"msgr_send_encrypted_bytes":7904},"AsyncMessenger::Worker-2":{"msgr_recv_messages":26,"msgr_send_messages":32,"msgr_recv_bytes":14234,"msgr_send_bytes":76510,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006695738,"msgr_running_send_time":0.001438143,"msgr_running_recv_time":0.004153154,"msgr_running_fast_dispatch_time":0.000591894,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.003751088,"avgtime":0.000125036},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":62832},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.004104258,"avgtime":0.000076004}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199849,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.008166028,"avgtime":0.002041507},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42988,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":916,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237703,"buffer_anon_items":70,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55823,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5632,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.103998957,"avgtime":0.001890890},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":101,"get_sum":134659,"get_or_fail_fail":0,"get_or_fail_success":101,"take":0,"take_sum":0,"put":101,"put_sum":134659,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6567,"put":55,"put_sum":6567,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4346,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4346,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:52.478 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 4.97e-07, "sum": 4.978e-06 }, "msgr_recv_bytes": 19938, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 42, "msgr_running_fast_dispatch_time": 0.001242482, "msgr_running_recv_time": 0.005695817, "msgr_running_send_time": 0.00267987, "msgr_running_total_time": 0.014255205, "msgr_send_bytes": 59991, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000132586, "sum": 0.004242777 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 112024, "msgr_recv_encrypted_bytes": 108048, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010366483, "msgr_running_send_time": 0.001598652, "msgr_running_total_time": 0.010313409, "msgr_send_bytes": 11191, "msgr_send_encrypted_bytes": 7904, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000399709, "sum": 0.01159157 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14234, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 26, "msgr_running_fast_dispatch_time": 0.000591894, "msgr_running_recv_time": 0.004153154, "msgr_running_send_time": 0.001438143, "msgr_running_total_time": 0.006695738, "msgr_send_bytes": 76510, "msgr_send_encrypted_bytes": 62832, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000125036, "sum": 0.003751088 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 7.6004e-05, "sum": 0.004104258 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002041507, "sum": 0.008166028 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199849 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 916, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237703, "buffer_anon_items": 70, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 55823, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.00189089, "sum": 0.103998957 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5632, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 101, "get_or_fail_fail": 0, "get_or_fail_success": 101, "get_started": 0, "get_sum": 134659, "max": 104857600, "put": 101, "put_sum": 134659, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6567, "take": 55, "take_sum": 6567, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4346, "max": 3758096384, "put": 4, "put_sum": 4346, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:52.478 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2024-09-15T22:52:52.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:52.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 Processor -- start 2024-09-15T22:52:52.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 -- start start 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead4073750 0x7fead40b4490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fead40b49d0 0x7fead415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 0x7fead415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fead40b4e30 con 0x7fead40b49d0 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fead40cfe60 con 0x7fead415c000 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feada000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fead40d0100 con 0x7fead4073750 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.619+0000 7feacaa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fead40b49d0 0x7fead415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fead40b49d0 0x7fead415bac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57424/0 (socket says 172.21.15.31:57424) 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 -- 172.21.15.31:0/1752179562 learned_addr learned my addr 172.21.15.31:0/1752179562 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:52.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead3400640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead4073750 0x7fead40b4490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead3e00640 1 --2- 172.21.15.31:0/1752179562 >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 0x7fead415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 -- 172.21.15.31:0/1752179562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead4073750 msgr2=0x7fead40b4490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead4073750 0x7fead40b4490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 -- 172.21.15.31:0/1752179562 >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 msgr2=0x7fead415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 --2- 172.21.15.31:0/1752179562 >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 0x7fead415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 -- 172.21.15.31:0/1752179562 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead40d03e0 con 0x7fead40b49d0 2024-09-15T22:52:52.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead3e00640 1 --2- 172.21.15.31:0/1752179562 >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 0x7fead415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:52.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7feacaa00640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead40b49d0 0x7fead415bac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fead4070470 tx=0x7feabc01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24069262c6cf6039 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead2a00640 1 -- 172.21.15.31:0/1752179562 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0b0070 con 0x7fead40b49d0 2024-09-15T22:52:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead2a00640 1 -- 172.21.15.31:0/1752179562 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc0ab600 con 0x7fead40b49d0 2024-09-15T22:52:52.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.623+0000 7fead2a00640 1 -- 172.21.15.31:0/1752179562 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0ab9d0 con 0x7fead40b49d0 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- 172.21.15.31:0/1752179562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead40b49d0 msgr2=0x7fead415bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead40b49d0 0x7fead415bac0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fead4070470 tx=0x7feabc01c230 comp rx=0 tx=0).stop 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- 172.21.15.31:0/1752179562 shutdown_connections 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- 172.21.15.31:0/1752179562 >> v2:172.21.15.102:3300/0 conn(0x7fead415c000 0x7fead415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead40b49d0 0x7fead415bac0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- 172.21.15.31:0/1752179562 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead4073750 0x7fead40b4490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- 172.21.15.31:0/1752179562 >> 172.21.15.31:0/1752179562 conn(0x7fead40b20a0 msgr2=0x7fead40b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- 172.21.15.31:0/1752179562 shutdown_connections 2024-09-15T22:52:52.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- 172.21.15.31:0/1752179562 wait complete. 2024-09-15T22:52:52.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 Processor -- start 2024-09-15T22:52:52.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- start start 2024-09-15T22:52:52.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 0x7fead4164240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fead415c000 0x7fead4164780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fead4073cb0 con 0x7fead4073750 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fead4073b30 con 0x7fead415c000 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feada000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fead415c3e0 con 0x7fead40b49d0 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57434/0 (socket says 172.21.15.31:57434) 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 -- 172.21.15.31:0/4150031432 learned_addr learned my addr 172.21.15.31:0/4150031432 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3e00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fead415c000 0x7fead4164780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feacaa00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 0x7fead4164240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 -- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 msgr2=0x7fead4164240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 0x7fead4164240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 -- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fead415c000 msgr2=0x7fead4164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fead415c000 0x7fead4164780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 -- 172.21.15.31:0/4150031432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead415e410 con 0x7fead4073750 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7feacaa00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 0x7fead4164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.627+0000 7fead3400640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feac400e870 tx=0x7feac400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac4017070 con 0x7fead4073750 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac400ee60 con 0x7fead4073750 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac400cb80 con 0x7fead4073750 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead415c910 con 0x7fead4073750 2024-09-15T22:52:52.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead415ced0 con 0x7fead4073750 2024-09-15T22:52:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fead415bac0 con 0x7fead4073750 2024-09-15T22:52:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7feac401a070 con 0x7fead4073750 2024-09-15T22:52:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 0x7feab0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7feac4085f80 con 0x7fead4073750 2024-09-15T22:52:52.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.631+0000 7feacaa00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 0x7feab0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:52.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.635+0000 7feacaa00640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 0x7feab0069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ad000 tx=0x7feabc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:52.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.639+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7feac4056320 con 0x7fead4073750 2024-09-15T22:52:52.839 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.835+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fead40b1770 con 0x7fead4073750 2024-09-15T22:52:52.840 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.835+0000 7feacbe00640 1 -- 172.21.15.31:0/4150031432 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7feac405a620 con 0x7fead4073750 2024-09-15T22:52:52.840 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:52.841 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:52.841 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 msgr2=0x7feab0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 0x7feab0069d80 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7feabc0ad000 tx=0x7feabc008040 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 msgr2=0x7fead415da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feac400e870 tx=0x7feac400ed30 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 shutdown_connections 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7feab00678c0 0x7feab0069d80 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fead415c000 0x7fead4164780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fead40b49d0 0x7fead4164240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 --2- 172.21.15.31:0/4150031432 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fead4073750 0x7fead415da50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:52.843 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 >> 172.21.15.31:0/4150031432 conn(0x7fead40b20a0 msgr2=0x7fead406f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 shutdown_connections 2024-09-15T22:52:52.844 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:52.839+0000 7feada000640 1 -- 172.21.15.31:0/4150031432 wait complete. 2024-09-15T22:52:52.861 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:53.024 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":43,"msgr_send_messages":34,"msgr_recv_bytes":20340,"msgr_send_bytes":59991,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.014421698,"msgr_running_send_time":0.002751183,"msgr_running_recv_time":0.005733111,"msgr_running_fast_dispatch_time":0.001297216,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.004242777,"avgtime":0.000132586},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000004978,"avgtime":0.000000497},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":37,"msgr_send_messages":29,"msgr_recv_bytes":112024,"msgr_send_bytes":11191,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.010313409,"msgr_running_send_time":0.001598652,"msgr_running_recv_time":0.010366483,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.011591570,"avgtime":0.000399709},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":108048,"msgr_send_encrypted_bytes":7904},"AsyncMessenger::Worker-2":{"msgr_recv_messages":26,"msgr_send_messages":32,"msgr_recv_bytes":14234,"msgr_send_bytes":76510,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006695738,"msgr_running_send_time":0.001438143,"msgr_running_recv_time":0.004153154,"msgr_running_fast_dispatch_time":0.000591894,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.003751088,"avgtime":0.000125036},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":62832},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.004104258,"avgtime":0.000076004}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199849,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.008166028,"avgtime":0.002041507},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42988,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":916,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237703,"buffer_anon_items":70,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55823,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5632,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.103998957,"avgtime":0.001890890},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":102,"get_sum":134987,"get_or_fail_fail":0,"get_or_fail_success":102,"take":0,"take_sum":0,"put":102,"put_sum":134987,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6567,"put":55,"put_sum":6567,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4346,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4346,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:53.025 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 4.97e-07, "sum": 4.978e-06 }, "msgr_recv_bytes": 20340, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 43, "msgr_running_fast_dispatch_time": 0.001297216, "msgr_running_recv_time": 0.005733111, "msgr_running_send_time": 0.002751183, "msgr_running_total_time": 0.014421698, "msgr_send_bytes": 59991, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000132586, "sum": 0.004242777 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 112024, "msgr_recv_encrypted_bytes": 108048, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010366483, "msgr_running_send_time": 0.001598652, "msgr_running_total_time": 0.010313409, "msgr_send_bytes": 11191, "msgr_send_encrypted_bytes": 7904, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000399709, "sum": 0.01159157 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14234, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 26, "msgr_running_fast_dispatch_time": 0.000591894, "msgr_running_recv_time": 0.004153154, "msgr_running_send_time": 0.001438143, "msgr_running_total_time": 0.006695738, "msgr_send_bytes": 76510, "msgr_send_encrypted_bytes": 62832, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000125036, "sum": 0.003751088 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 7.6004e-05, "sum": 0.004104258 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002041507, "sum": 0.008166028 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199849 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 916, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237703, "buffer_anon_items": 70, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 55823, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.00189089, "sum": 0.103998957 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5632, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 102, "get_or_fail_fail": 0, "get_or_fail_success": 102, "get_started": 0, "get_sum": 134987, "max": 104857600, "put": 102, "put_sum": 134987, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6567, "take": 55, "take_sum": 6567, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4346, "max": 3758096384, "put": 4, "put_sum": 4346, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:53.025 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-15T22:52:53.026 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:53.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 Processor -- start 2024-09-15T22:52:53.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 -- start start 2024-09-15T22:52:53.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fe8c0159ef0 0x7fe8c00aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8c00d0800 0x7fe8c00b31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8c00af830 con 0x7fe8c015d420 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c00afb10 con 0x7fe8c00d0800 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.163+0000 7fe8c6c00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fe8c015c940 con 0x7fe8c0159ef0 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8c00d0800 0x7fe8c00b31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fe8c00d0800 0x7fe8c00b31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57440/0 (socket says 172.21.15.31:57440) 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 -- 172.21.15.31:0/4061085898 learned_addr learned my addr 172.21.15.31:0/4061085898 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8bfe00640 1 --2- 172.21.15.31:0/4061085898 >> v2:172.21.15.102:3300/0 conn(0x7fe8c0159ef0 0x7fe8c00aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 -- 172.21.15.31:0/4061085898 >> v2:172.21.15.102:3300/0 conn(0x7fe8c0159ef0 msgr2=0x7fe8c00aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 --2- 172.21.15.31:0/4061085898 >> v2:172.21.15.102:3300/0 conn(0x7fe8c0159ef0 0x7fe8c00aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 -- 172.21.15.31:0/4061085898 >> v1:172.21.15.102:6789/0 conn(0x7fe8c015d420 legacy=0x7fe8c00d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 -- 172.21.15.31:0/4061085898 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c015cc20 con 0x7fe8c00d0800 2024-09-15T22:52:53.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c4c00640 1 --2- 172.21.15.31:0/4061085898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c00b31d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00afc90 tx=0x7fe8b801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e1a0ea14929476 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:53.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8bf400640 1 -- 172.21.15.31:0/4061085898 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80a58a0 con 0x7fe8c00d0800 2024-09-15T22:52:53.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8bf400640 1 -- 172.21.15.31:0/4061085898 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b80a5a40 con 0x7fe8c00d0800 2024-09-15T22:52:53.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8bf400640 1 -- 172.21.15.31:0/4061085898 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b80a5e10 con 0x7fe8c00d0800 2024-09-15T22:52:53.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c6c00640 1 -- 172.21.15.31:0/4061085898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 msgr2=0x7fe8c00b31d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.167+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/4061085898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c00b31d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00afc90 tx=0x7fe8b801c9c0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- 172.21.15.31:0/4061085898 shutdown_connections 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/4061085898 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c00b31d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/4061085898 >> v2:172.21.15.102:3300/0 conn(0x7fe8c0159ef0 0x7fe8c00aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- 172.21.15.31:0/4061085898 >> 172.21.15.31:0/4061085898 conn(0x7fe8c00b20a0 msgr2=0x7fe8c00b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- 172.21.15.31:0/4061085898 shutdown_connections 2024-09-15T22:52:53.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- 172.21.15.31:0/4061085898 wait complete. 2024-09-15T22:52:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 Processor -- start 2024-09-15T22:52:53.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- start start 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8c0159ef0 0x7fe8c006f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8c015d420 0x7fe8c006de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0169290 con 0x7fe8c00d0800 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fe8c0169110 con 0x7fe8c015d420 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c6c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fe8c0169410 con 0x7fe8c0159ef0 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57442/0 (socket says 172.21.15.31:57442) 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 -- 172.21.15.31:0/3001268519 learned_addr learned my addr 172.21.15.31:0/3001268519 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:53.176 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8b7400640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8c0159ef0 0x7fe8c006f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8c4c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8c015d420 0x7fe8c006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 -- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8c0159ef0 msgr2=0x7fe8c006f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8c0159ef0 0x7fe8c006f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 -- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8c015d420 msgr2=0x7fe8c006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8c015d420 0x7fe8c006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 -- 172.21.15.31:0/3001268519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8c0157670 con 0x7fe8c00d0800 2024-09-15T22:52:53.177 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.171+0000 7fe8bfe00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000e930 tx=0x7fe8b000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b0017070 con 0x7fe8c00d0800 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8b000ca00 con 0x7fe8c00d0800 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b000cdb0 con 0x7fe8c00d0800 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8c0157950 con 0x7fe8c00d0800 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8c0157f10 con 0x7fe8c00d0800 2024-09-15T22:52:53.178 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8c00b31d0 con 0x7fe8c00d0800 2024-09-15T22:52:53.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fe8b001a070 con 0x7fe8c00d0800 2024-09-15T22:52:53.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 0x7fe89c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fe8b0086270 con 0x7fe8c00d0800 2024-09-15T22:52:53.179 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.175+0000 7fe8b7400640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 0x7fe89c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.180 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.179+0000 7fe8b7400640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 0x7fe89c069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe8c01597f0 tx=0x7fe8a8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:53.183 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.179+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fe8b00565a0 con 0x7fe8c00d0800 2024-09-15T22:52:53.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8c0153d30 con 0x7fe8c00d0800 2024-09-15T22:52:53.382 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8bcc00640 1 -- 172.21.15.31:0/3001268519 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7fe8b005a8a0 con 0x7fe8c00d0800 2024-09-15T22:52:53.382 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:53.382 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:53.383 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 msgr2=0x7fe89c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 0x7fe89c069d80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe8c01597f0 tx=0x7fe8a8009040 comp rx=0 tx=0).stop 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 msgr2=0x7fe8c0158710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fe8b000e930 tx=0x7fe8b000edf0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 shutdown_connections 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fe89c0678c0 0x7fe89c069d80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fe8c015d420 0x7fe8c006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fe8c0159ef0 0x7fe8c006f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 --2- 172.21.15.31:0/3001268519 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fe8c00d0800 0x7fe8c0158710 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 >> 172.21.15.31:0/3001268519 conn(0x7fe8c00b20a0 msgr2=0x7fe8c0151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 shutdown_connections 2024-09-15T22:52:53.385 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.379+0000 7fe8c6c00640 1 -- 172.21.15.31:0/3001268519 wait complete. 2024-09-15T22:52:53.404 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json perf dump 2024-09-15T22:52:53.567 INFO:teuthology.orchestra.run.smithi031.stdout:{"AsyncMessenger::Worker-0":{"msgr_recv_messages":43,"msgr_send_messages":34,"msgr_recv_bytes":20340,"msgr_send_bytes":59991,"msgr_created_connections":11,"msgr_active_connections":4,"msgr_running_total_time":0.014421698,"msgr_running_send_time":0.002751183,"msgr_running_recv_time":0.005733111,"msgr_running_fast_dispatch_time":0.001297216,"msgr_send_messages_queue_lat":{"avgcount":32,"sum":0.004242777,"avgtime":0.000132586},"msgr_handle_ack_lat":{"avgcount":10,"sum":0.000004978,"avgtime":0.000000497},"msgr_recv_encrypted_bytes":0,"msgr_send_encrypted_bytes":0},"AsyncMessenger::Worker-1":{"msgr_recv_messages":37,"msgr_send_messages":29,"msgr_recv_bytes":112024,"msgr_send_bytes":11191,"msgr_created_connections":5,"msgr_active_connections":4,"msgr_running_total_time":0.010313409,"msgr_running_send_time":0.001598652,"msgr_running_recv_time":0.010366483,"msgr_running_fast_dispatch_time":0.000289467,"msgr_send_messages_queue_lat":{"avgcount":29,"sum":0.011591570,"avgtime":0.000399709},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":108048,"msgr_send_encrypted_bytes":7904},"AsyncMessenger::Worker-2":{"msgr_recv_messages":26,"msgr_send_messages":32,"msgr_recv_bytes":14234,"msgr_send_bytes":76510,"msgr_created_connections":7,"msgr_active_connections":3,"msgr_running_total_time":0.006695738,"msgr_running_send_time":0.001438143,"msgr_running_recv_time":0.004153154,"msgr_running_fast_dispatch_time":0.000591894,"msgr_send_messages_queue_lat":{"avgcount":30,"sum":0.003751088,"avgtime":0.000125036},"msgr_handle_ack_lat":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"msgr_recv_encrypted_bytes":160,"msgr_send_encrypted_bytes":62832},"cct":{"total_workers":1,"unhealthy_workers":0},"finisher-MDSRank":{"queue_len":0,"complete_latency":{"avgcount":54,"sum":0.004104258,"avgtime":0.000076004}},"finisher-PurgeQueue":{"queue_len":0,"complete_latency":{"avgcount":4,"sum":0.000150227,"avgtime":0.000037556}},"mds":{"request":3,"reply":1,"reply_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"slow_reply":0,"forward":0,"dir_fetch_complete":12,"dir_fetch_keys":10,"dir_commit":0,"dir_split":0,"dir_merge":0,"inodes":11,"inodes_top":0,"inodes_bottom":11,"inodes_pin_tail":0,"inodes_pinned":11,"inodes_expired":0,"inodes_with_caps":2,"caps":2,"subtrees":2,"traverse":2,"traverse_hit":2,"traverse_forward":0,"traverse_discover":0,"traverse_dir_fetch":0,"traverse_remote_ino":0,"traverse_lock":0,"load_cent":0,"q":0,"exported":0,"exported_inodes":0,"imported":0,"imported_inodes":0,"openino_dir_fetch":0,"openino_backtrace_fetch":0,"openino_peer_discover":0,"root_rfiles":1,"root_rbytes":7,"root_rsnaps":0,"scrub_backtrace_fetch":0,"scrub_set_tag":0,"scrub_backtrace_repaired":0,"scrub_inotable_repaired":0,"scrub_dir_inodes":0,"scrub_dir_base_inodes":0,"scrub_dirfrag_rstats":0,"scrub_file_inodes":0,"handle_inode_file_caps":0,"ceph_cap_op_revoke":0,"ceph_cap_op_grant":1,"ceph_cap_op_trunc":0,"ceph_cap_op_flushsnap_ack":0,"ceph_cap_op_flush_ack":0,"handle_client_caps":1,"handle_client_caps_dirty":1,"handle_client_cap_release":0,"process_request_cap_release":1},"mds_cache":{"dir_update":0,"dir_update_receipt":0,"dir_try_discover":0,"dir_send_discover":0,"dir_handle_discover":0,"num_strays":0,"num_strays_delayed":0,"num_strays_enqueuing":0,"strays_created":0,"strays_enqueued":0,"strays_reintegrated":0,"strays_migrated":0,"num_recovering_processing":0,"num_recovering_enqueued":0,"num_recovering_prioritized":0,"recovery_started":0,"recovery_completed":0,"ireq_quiesce_path":0,"ireq_quiesce_inode":0,"ireq_enqueue_scrub":0,"ireq_exportdir":0,"ireq_flush":0,"ireq_fragmentdir":0,"ireq_fragstats":0,"ireq_inodestats":0},"mds_log":{"evlrg":0,"evadd":4,"evex":0,"evtrm":0,"ev":7,"evexg":0,"evexd":0,"segadd":0,"segex":0,"segtrm":0,"seg":2,"segmjr":2,"segexg":0,"segexd":0,"expos":4194304,"wrpos":4199849,"rdpos":4195244,"jlat":{"avgcount":4,"sum":0.008166028,"avgtime":0.002041507},"replayed":3},"mds_mem":{"ino":14,"ino+":14,"ino-":0,"dir":12,"dir+":12,"dir-":0,"dn":11,"dn+":11,"dn-":0,"cap":2,"cap+":2,"cap-":0,"rss":42988,"heap":248116},"mds_server":{"dispatch_client_request":2,"dispatch_server_request":0,"handle_client_request":3,"handle_client_session":1,"handle_peer_request":0,"req_create_latency":{"avgcount":1,"sum":0.002390551,"avgtime":0.002390551},"req_getattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_getfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_link_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookup_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookuphash_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupino_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupname_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupparent_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lookupsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_lssnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mkdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mknod_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_mksnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_open_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_readdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rename_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_renamesnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_snapdiff_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmdir_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmsnap_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_rmxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setdirlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setfilelock_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setlayout_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_setxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_symlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"req_unlink_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000},"cap_revoke_eviction":0,"cap_acquisition_throttle":0,"req_getvxattr_latency":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"mds_sessions":{"session_count":1,"session_add":1,"session_remove":0,"sessions_open":1,"sessions_stale":0,"total_load":1,"average_load":1,"avg_session_uptime":916,"mdthresh_evicted":0},"mempool":{"bloom_filter_bytes":0,"bloom_filter_items":0,"bluestore_alloc_bytes":0,"bluestore_alloc_items":0,"bluestore_cache_data_bytes":0,"bluestore_cache_data_items":0,"bluestore_cache_onode_bytes":0,"bluestore_cache_onode_items":0,"bluestore_cache_meta_bytes":0,"bluestore_cache_meta_items":0,"bluestore_cache_other_bytes":0,"bluestore_cache_other_items":0,"bluestore_cache_buffer_bytes":0,"bluestore_cache_buffer_items":0,"bluestore_extent_bytes":0,"bluestore_extent_items":0,"bluestore_blob_bytes":0,"bluestore_blob_items":0,"bluestore_shared_blob_bytes":0,"bluestore_shared_blob_items":0,"bluestore_inline_bl_bytes":0,"bluestore_inline_bl_items":0,"bluestore_fsck_bytes":0,"bluestore_fsck_items":0,"bluestore_txc_bytes":0,"bluestore_txc_items":0,"bluestore_writing_deferred_bytes":0,"bluestore_writing_deferred_items":0,"bluestore_writing_bytes":0,"bluestore_writing_items":0,"bluefs_bytes":0,"bluefs_items":0,"bluefs_file_reader_bytes":0,"bluefs_file_reader_items":0,"bluefs_file_writer_bytes":0,"bluefs_file_writer_items":0,"buffer_anon_bytes":237703,"buffer_anon_items":70,"buffer_meta_bytes":0,"buffer_meta_items":0,"osd_bytes":0,"osd_items":0,"osd_mapbl_bytes":0,"osd_mapbl_items":0,"osd_pglog_bytes":0,"osd_pglog_items":0,"osdmap_bytes":5656,"osdmap_items":91,"osdmap_mapping_bytes":0,"osdmap_mapping_items":0,"pgmap_bytes":0,"pgmap_items":0,"mds_co_bytes":55823,"mds_co_items":233,"unittest_1_bytes":0,"unittest_1_items":0,"unittest_2_bytes":0,"unittest_2_items":0},"objecter":{"op_active":0,"op_laggy":0,"op_send":55,"op_send_bytes":5632,"op_resend":0,"op_reply":55,"op_latency":{"avgcount":55,"sum":0.103998957,"avgtime":0.001890890},"op_inflight":0,"oplen_avg":{"avgcount":55,"sum":110},"op":55,"op_r":36,"op_w":19,"op_rmw":0,"op_pg":0,"osdop_stat":2,"osdop_create":0,"osdop_read":8,"osdop_write":4,"osdop_writefull":1,"osdop_writesame":0,"osdop_append":0,"osdop_zero":1,"osdop_truncate":0,"osdop_delete":5,"osdop_mapext":0,"osdop_sparse_read":0,"osdop_clonerange":0,"osdop_getxattr":24,"osdop_setxattr":0,"osdop_cmpxattr":0,"osdop_rmxattr":0,"osdop_resetxattrs":0,"osdop_call":0,"osdop_watch":0,"osdop_notify":0,"osdop_src_cmpxattr":0,"osdop_pgls":0,"osdop_pgls_filter":0,"osdop_other":0,"linger_active":0,"linger_send":0,"linger_resend":0,"linger_ping":0,"poolop_active":0,"poolop_send":0,"poolop_resend":0,"poolstat_active":0,"poolstat_send":0,"poolstat_resend":0,"statfs_active":0,"statfs_send":0,"statfs_resend":0,"command_active":0,"command_send":0,"command_resend":0,"map_epoch":0,"map_full":0,"map_inc":0,"osd_sessions":8,"osd_session_open":8,"osd_session_close":0,"osd_laggy":0,"omap_wr":13,"omap_rd":48,"omap_del":4},"oft":{"omap_total_objs":1,"omap_total_kv_pairs":1,"omap_total_updates":2,"omap_total_removes":1},"osd-slow-ops":{"slow_ops_count":0},"purge_queue":{"pq_executing_ops":0,"pq_executing_ops_high_water":0,"pq_executing":0,"pq_executing_high_water":0,"pq_executed_ops":0,"pq_executed":0,"pq_item_in_journal":0},"throttle-msgr_dispatch_throttler-mds":{"val":0,"max":104857600,"get_started":0,"get":102,"get_sum":134987,"get_or_fail_fail":0,"get_or_fail_success":102,"take":0,"take_sum":0,"put":102,"put_sum":134987,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_bytes":{"val":0,"max":104857600,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":6567,"put":55,"put_sum":6567,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-objecter_ops":{"val":0,"max":1024,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":55,"take_sum":55,"put":55,"put_sum":55,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle":{"val":0,"max":3758096384,"get_started":0,"get":0,"get_sum":0,"get_or_fail_fail":0,"get_or_fail_success":0,"take":0,"take_sum":0,"put":0,"put_sum":0,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}},"throttle-write_buf_throttle-0x55d5ebbe6a00":{"val":0,"max":3758096384,"get_started":0,"get":4,"get_sum":4346,"get_or_fail_fail":0,"get_or_fail_success":4,"take":0,"take_sum":0,"put":4,"put_sum":4346,"wait":{"avgcount":0,"sum":0.000000000,"avgtime":0.000000000}}} 2024-09-15T22:52:53.569 DEBUG:tasks.cephfs.filesystem:_json_asok output { "AsyncMessenger::Worker-0": { "msgr_active_connections": 4, "msgr_created_connections": 11, "msgr_handle_ack_lat": { "avgcount": 10, "avgtime": 4.97e-07, "sum": 4.978e-06 }, "msgr_recv_bytes": 20340, "msgr_recv_encrypted_bytes": 0, "msgr_recv_messages": 43, "msgr_running_fast_dispatch_time": 0.001297216, "msgr_running_recv_time": 0.005733111, "msgr_running_send_time": 0.002751183, "msgr_running_total_time": 0.014421698, "msgr_send_bytes": 59991, "msgr_send_encrypted_bytes": 0, "msgr_send_messages": 34, "msgr_send_messages_queue_lat": { "avgcount": 32, "avgtime": 0.000132586, "sum": 0.004242777 } }, "AsyncMessenger::Worker-1": { "msgr_active_connections": 4, "msgr_created_connections": 5, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 112024, "msgr_recv_encrypted_bytes": 108048, "msgr_recv_messages": 37, "msgr_running_fast_dispatch_time": 0.000289467, "msgr_running_recv_time": 0.010366483, "msgr_running_send_time": 0.001598652, "msgr_running_total_time": 0.010313409, "msgr_send_bytes": 11191, "msgr_send_encrypted_bytes": 7904, "msgr_send_messages": 29, "msgr_send_messages_queue_lat": { "avgcount": 29, "avgtime": 0.000399709, "sum": 0.01159157 } }, "AsyncMessenger::Worker-2": { "msgr_active_connections": 3, "msgr_created_connections": 7, "msgr_handle_ack_lat": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "msgr_recv_bytes": 14234, "msgr_recv_encrypted_bytes": 160, "msgr_recv_messages": 26, "msgr_running_fast_dispatch_time": 0.000591894, "msgr_running_recv_time": 0.004153154, "msgr_running_send_time": 0.001438143, "msgr_running_total_time": 0.006695738, "msgr_send_bytes": 76510, "msgr_send_encrypted_bytes": 62832, "msgr_send_messages": 32, "msgr_send_messages_queue_lat": { "avgcount": 30, "avgtime": 0.000125036, "sum": 0.003751088 } }, "cct": { "total_workers": 1, "unhealthy_workers": 0 }, "finisher-MDSRank": { "complete_latency": { "avgcount": 54, "avgtime": 7.6004e-05, "sum": 0.004104258 }, "queue_len": 0 }, "finisher-PurgeQueue": { "complete_latency": { "avgcount": 4, "avgtime": 3.7556e-05, "sum": 0.000150227 }, "queue_len": 0 }, "mds": { "caps": 2, "ceph_cap_op_flush_ack": 0, "ceph_cap_op_flushsnap_ack": 0, "ceph_cap_op_grant": 1, "ceph_cap_op_revoke": 0, "ceph_cap_op_trunc": 0, "dir_commit": 0, "dir_fetch_complete": 12, "dir_fetch_keys": 10, "dir_merge": 0, "dir_split": 0, "exported": 0, "exported_inodes": 0, "forward": 0, "handle_client_cap_release": 0, "handle_client_caps": 1, "handle_client_caps_dirty": 1, "handle_inode_file_caps": 0, "imported": 0, "imported_inodes": 0, "inodes": 11, "inodes_bottom": 11, "inodes_expired": 0, "inodes_pin_tail": 0, "inodes_pinned": 11, "inodes_top": 0, "inodes_with_caps": 2, "load_cent": 0, "openino_backtrace_fetch": 0, "openino_dir_fetch": 0, "openino_peer_discover": 0, "process_request_cap_release": 1, "q": 0, "reply": 1, "reply_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "request": 3, "root_rbytes": 7, "root_rfiles": 1, "root_rsnaps": 0, "scrub_backtrace_fetch": 0, "scrub_backtrace_repaired": 0, "scrub_dir_base_inodes": 0, "scrub_dir_inodes": 0, "scrub_dirfrag_rstats": 0, "scrub_file_inodes": 0, "scrub_inotable_repaired": 0, "scrub_set_tag": 0, "slow_reply": 0, "subtrees": 2, "traverse": 2, "traverse_dir_fetch": 0, "traverse_discover": 0, "traverse_forward": 0, "traverse_hit": 2, "traverse_lock": 0, "traverse_remote_ino": 0 }, "mds_cache": { "dir_handle_discover": 0, "dir_send_discover": 0, "dir_try_discover": 0, "dir_update": 0, "dir_update_receipt": 0, "ireq_enqueue_scrub": 0, "ireq_exportdir": 0, "ireq_flush": 0, "ireq_fragmentdir": 0, "ireq_fragstats": 0, "ireq_inodestats": 0, "ireq_quiesce_inode": 0, "ireq_quiesce_path": 0, "num_recovering_enqueued": 0, "num_recovering_prioritized": 0, "num_recovering_processing": 0, "num_strays": 0, "num_strays_delayed": 0, "num_strays_enqueuing": 0, "recovery_completed": 0, "recovery_started": 0, "strays_created": 0, "strays_enqueued": 0, "strays_migrated": 0, "strays_reintegrated": 0 }, "mds_log": { "ev": 7, "evadd": 4, "evex": 0, "evexd": 0, "evexg": 0, "evlrg": 0, "evtrm": 0, "expos": 4194304, "jlat": { "avgcount": 4, "avgtime": 0.002041507, "sum": 0.008166028 }, "rdpos": 4195244, "replayed": 3, "seg": 2, "segadd": 0, "segex": 0, "segexd": 0, "segexg": 0, "segmjr": 2, "segtrm": 0, "wrpos": 4199849 }, "mds_mem": { "cap": 2, "cap+": 2, "cap-": 0, "dir": 12, "dir+": 12, "dir-": 0, "dn": 11, "dn+": 11, "dn-": 0, "heap": 248116, "ino": 14, "ino+": 14, "ino-": 0, "rss": 42988 }, "mds_server": { "cap_acquisition_throttle": 0, "cap_revoke_eviction": 0, "dispatch_client_request": 2, "dispatch_server_request": 0, "handle_client_request": 3, "handle_client_session": 1, "handle_peer_request": 0, "req_create_latency": { "avgcount": 1, "avgtime": 0.002390551, "sum": 0.002390551 }, "req_getattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_getvxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_link_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookup_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookuphash_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupino_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupname_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupparent_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lookupsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_lssnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mkdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mknod_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_mksnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_open_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_readdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rename_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_renamesnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmdir_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmsnap_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_rmxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setdirlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setfilelock_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setlayout_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_setxattr_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_snapdiff_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_symlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 }, "req_unlink_latency": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "mds_sessions": { "average_load": 1, "avg_session_uptime": 916, "mdthresh_evicted": 0, "session_add": 1, "session_count": 1, "session_remove": 0, "sessions_open": 1, "sessions_stale": 0, "total_load": 1 }, "mempool": { "bloom_filter_bytes": 0, "bloom_filter_items": 0, "bluefs_bytes": 0, "bluefs_file_reader_bytes": 0, "bluefs_file_reader_items": 0, "bluefs_file_writer_bytes": 0, "bluefs_file_writer_items": 0, "bluefs_items": 0, "bluestore_alloc_bytes": 0, "bluestore_alloc_items": 0, "bluestore_blob_bytes": 0, "bluestore_blob_items": 0, "bluestore_cache_buffer_bytes": 0, "bluestore_cache_buffer_items": 0, "bluestore_cache_data_bytes": 0, "bluestore_cache_data_items": 0, "bluestore_cache_meta_bytes": 0, "bluestore_cache_meta_items": 0, "bluestore_cache_onode_bytes": 0, "bluestore_cache_onode_items": 0, "bluestore_cache_other_bytes": 0, "bluestore_cache_other_items": 0, "bluestore_extent_bytes": 0, "bluestore_extent_items": 0, "bluestore_fsck_bytes": 0, "bluestore_fsck_items": 0, "bluestore_inline_bl_bytes": 0, "bluestore_inline_bl_items": 0, "bluestore_shared_blob_bytes": 0, "bluestore_shared_blob_items": 0, "bluestore_txc_bytes": 0, "bluestore_txc_items": 0, "bluestore_writing_bytes": 0, "bluestore_writing_deferred_bytes": 0, "bluestore_writing_deferred_items": 0, "bluestore_writing_items": 0, "buffer_anon_bytes": 237703, "buffer_anon_items": 70, "buffer_meta_bytes": 0, "buffer_meta_items": 0, "mds_co_bytes": 55823, "mds_co_items": 233, "osd_bytes": 0, "osd_items": 0, "osd_mapbl_bytes": 0, "osd_mapbl_items": 0, "osd_pglog_bytes": 0, "osd_pglog_items": 0, "osdmap_bytes": 5656, "osdmap_items": 91, "osdmap_mapping_bytes": 0, "osdmap_mapping_items": 0, "pgmap_bytes": 0, "pgmap_items": 0, "unittest_1_bytes": 0, "unittest_1_items": 0, "unittest_2_bytes": 0, "unittest_2_items": 0 }, "objecter": { "command_active": 0, "command_resend": 0, "command_send": 0, "linger_active": 0, "linger_ping": 0, "linger_resend": 0, "linger_send": 0, "map_epoch": 0, "map_full": 0, "map_inc": 0, "omap_del": 4, "omap_rd": 48, "omap_wr": 13, "op": 55, "op_Infinitylight": 0, "op_active": 0, "op_laggy": 0, "op_latency": { "avgcount": 55, "avgtime": 0.00189089, "sum": 0.103998957 }, "op_pg": 0, "op_r": 36, "op_reply": 55, "op_resend": 0, "op_rmw": 0, "op_send": 55, "op_send_bytes": 5632, "op_w": 19, "oplen_avg": { "avgcount": 55, "sum": 110 }, "osd_laggy": 0, "osd_session_close": 0, "osd_session_open": 8, "osd_sessions": 8, "osdop_append": 0, "osdop_call": 0, "osdop_clonerange": 0, "osdop_cmpxattr": 0, "osdop_create": 0, "osdop_delete": 5, "osdop_getxattr": 24, "osdop_mapext": 0, "osdop_notify": 0, "osdop_other": 0, "osdop_pgls": 0, "osdop_pgls_filter": 0, "osdop_read": 8, "osdop_resetxattrs": 0, "osdop_rmxattr": 0, "osdop_setxattr": 0, "osdop_sparse_read": 0, "osdop_src_cmpxattr": 0, "osdop_stat": 2, "osdop_truncate": 0, "osdop_watch": 0, "osdop_write": 4, "osdop_writefull": 1, "osdop_writesame": 0, "osdop_zero": 1, "poolop_active": 0, "poolop_resend": 0, "poolop_send": 0, "poolstat_active": 0, "poolstat_resend": 0, "poolstat_send": 0, "statfs_active": 0, "statfs_resend": 0, "statfs_send": 0 }, "oft": { "omap_total_kv_pairs": 1, "omap_total_objs": 1, "omap_total_removes": 1, "omap_total_updates": 2 }, "osd-slow-ops": { "slow_ops_count": 0 }, "purge_queue": { "pq_executed": 0, "pq_executed_ops": 0, "pq_executing": 0, "pq_executing_high_water": 0, "pq_executing_ops": 0, "pq_executing_ops_high_water": 0, "pq_item_in_journal": 0 }, "throttle-msgr_dispatch_throttler-mds": { "get": 102, "get_or_fail_fail": 0, "get_or_fail_success": 102, "get_started": 0, "get_sum": 134987, "max": 104857600, "put": 102, "put_sum": 134987, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_bytes": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 104857600, "put": 55, "put_sum": 6567, "take": 55, "take_sum": 6567, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-objecter_ops": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 1024, "put": 55, "put_sum": 55, "take": 55, "take_sum": 55, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle": { "get": 0, "get_or_fail_fail": 0, "get_or_fail_success": 0, "get_started": 0, "get_sum": 0, "max": 3758096384, "put": 0, "put_sum": 0, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } }, "throttle-write_buf_throttle-0x55d5ebbe6a00": { "get": 4, "get_or_fail_fail": 0, "get_or_fail_success": 4, "get_started": 0, "get_sum": 4346, "max": 3758096384, "put": 4, "put_sum": 4346, "take": 0, "take_sum": 0, "val": 0, "wait": { "avgcount": 0, "avgtime": 0.0, "sum": 0.0 } } } 2024-09-15T22:52:53.569 INFO:tasks.cephfs.test_openfiletable:omap_total_removes:1 2024-09-15T22:52:53.569 INFO:tasks.cephfs.test_openfiletable:omap_total_kv_pairs:1 2024-09-15T22:52:53.569 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-15T22:52:53.570 DEBUG:teuthology.orchestra.run.smithi031:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:52:53.655 DEBUG:teuthology.orchestra.run.smithi102:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-15T22:52:53.735 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-15T22:52:53.735 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:53.735 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:53.735 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:53.744 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:53.745 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:53.801 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-15T22:52:53.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 Processor -- start 2024-09-15T22:52:53.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 -- start start 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f321c06ee70 0x7f321c06c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c06cc90 con 0x7f321c0b03c0 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f321c06d530 con 0x7f321c06ee70 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3223200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f321c06cf70 con 0x7f321c147860 2024-09-15T22:52:53.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3213400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f321c06ee70 0x7f321c06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3213400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f321c06ee70 0x7f321c06c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57458/0 (socket says 172.21.15.31:57458) 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.987+0000 7f3213400640 1 -- 172.21.15.31:0/654399103 learned_addr learned my addr 172.21.15.31:0/654399103 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3221200640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3213400640 1 -- 172.21.15.31:0/654399103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 msgr2=0x7f321c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3213400640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c0cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.993 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3213400640 1 -- 172.21.15.31:0/654399103 >> v1:172.21.15.102:6789/0 conn(0x7f321c0b03c0 legacy=0x7f321c06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3213400640 1 -- 172.21.15.31:0/654399103 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c06d250 con 0x7f321c06ee70 2024-09-15T22:52:53.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3213400640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c06c600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3204009870 tx=0x7f320401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b12154dd453d3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:53.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f321b400640 1 -- 172.21.15.31:0/654399103 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32040aa620 con 0x7f321c06ee70 2024-09-15T22:52:53.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f321b400640 1 -- 172.21.15.31:0/654399103 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32040af070 con 0x7f321c06ee70 2024-09-15T22:52:53.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f321b400640 1 -- 172.21.15.31:0/654399103 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32040aa9e0 con 0x7f321c06ee70 2024-09-15T22:52:53.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3223200640 1 -- 172.21.15.31:0/654399103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 msgr2=0x7f321c06c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:53.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.991+0000 7f3223200640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c06c600 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3204009870 tx=0x7f320401c4a0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- 172.21.15.31:0/654399103 shutdown_connections 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c0cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 --2- 172.21.15.31:0/654399103 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c06c600 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- 172.21.15.31:0/654399103 >> 172.21.15.31:0/654399103 conn(0x7f321c0cd680 msgr2=0x7f321c0cda90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- 172.21.15.31:0/654399103 shutdown_connections 2024-09-15T22:52:53.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- 172.21.15.31:0/654399103 wait complete. 2024-09-15T22:52:53.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 Processor -- start 2024-09-15T22:52:53.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- start start 2024-09-15T22:52:53.999 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321c0b03c0 0x7f321c13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0d01f0 con 0x7f321c06ee70 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f321c0d0070 con 0x7f321c0b03c0 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f321c0d0370 con 0x7f321c147860 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.000 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57474/0 (socket says 172.21.15.31:57474) 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 -- 172.21.15.31:0/1443130203 learned_addr learned my addr 172.21.15.31:0/1443130203 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3213400640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321c0b03c0 0x7f321c13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3221200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 -- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 msgr2=0x7f321c160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 -- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321c0b03c0 msgr2=0x7f321c13fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321c0b03c0 0x7f321c13fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 -- 172.21.15.31:0/1443130203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c140360 con 0x7f321c06ee70 2024-09-15T22:52:54.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f321be00640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c370 tx=0x7f320c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c0052d0 con 0x7f321c06ee70 2024-09-15T22:52:54.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c005470 con 0x7f321c06ee70 2024-09-15T22:52:54.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f321c140640 con 0x7f321c06ee70 2024-09-15T22:52:54.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.995+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320c007260 con 0x7f321c06ee70 2024-09-15T22:52:54.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f321c140c00 con 0x7f321c06ee70 2024-09-15T22:52:54.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f321c06c600 con 0x7f321c06ee70 2024-09-15T22:52:54.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f320c007400 con 0x7f321c06ee70 2024-09-15T22:52:54.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3218c00640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 0x7f31f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f320c085310 con 0x7f321c06ee70 2024-09-15T22:52:54.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:53.999+0000 7f3213400640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 0x7f31f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.004 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.003+0000 7f3213400640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 0x7f31f8069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f32040ae000 tx=0x7f32040a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.003+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f320c055590 con 0x7f321c06ee70 2024-09-15T22:52:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f321c0cdb00 con 0x7f321c06ee70 2024-09-15T22:52:54.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3218c00640 1 -- 172.21.15.31:0/1443130203 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v61) ==== 80+0+120 (secure 0 0 0) 0x7f320c0850d0 con 0x7f321c06ee70 2024-09-15T22:52:54.186 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6835/678504006 2024-09-16T22:52:35.837128+0000 2024-09-15T22:52:54.186 INFO:teuthology.orchestra.run.smithi031.stdout:172.21.15.31:6834/678504006 2024-09-16T22:52:35.837128+0000 2024-09-15T22:52:54.186 INFO:teuthology.orchestra.run.smithi031.stderr:listed 2 entries 2024-09-15T22:52:54.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 msgr2=0x7f31f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 0x7f31f8069d80 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f32040ae000 tx=0x7f32040a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 msgr2=0x7f321c12e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f320c00c370 tx=0x7f320c00c830 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 shutdown_connections 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f31f80678c0 0x7f31f8069d80 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f321c147860 0x7f321c160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f321c0b03c0 0x7f321c13fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 --2- 172.21.15.31:0/1443130203 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f321c06ee70 0x7f321c12e6a0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 >> 172.21.15.31:0/1443130203 conn(0x7f321c0cd680 msgr2=0x7f321c1627f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 shutdown_connections 2024-09-15T22:52:54.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.183+0000 7f3223200640 1 -- 172.21.15.31:0/1443130203 wait complete. 2024-09-15T22:52:54.207 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-15T22:52:54.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:54.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-15T22:52:54.235 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:52:54.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:52:54.236 DEBUG:teuthology.orchestra.run.smithi031:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-15T22:52:54.289 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:54.289 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:54.289 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:54.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:54.298 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:54.298 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:52:54.299 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:54.344 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:52:54.344 INFO:tasks.cephfs.mount:Terminating background process 2024-09-15T22:52:54.345 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:52:54.345 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:52:54.353 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:52:54.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:54.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 Processor -- start 2024-09-15T22:52:54.529 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 -- start start 2024-09-15T22:52:54.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c0b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c08c730 con 0x7fc18c0d0220 2024-09-15T22:52:54.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc18c0d2ba0 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.530 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc191e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0d2950 con 0x7fc18c161e30 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18b400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc18c0d0220 0x7fc18c0b4710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:59624/0 (socket says 172.21.15.31:59624) 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18b400640 1 -- 172.21.15.31:0/1107558523 learned_addr learned my addr 172.21.15.31:0/1107558523 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1107558523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c0b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019654859 0 0) 0x7fc18c08c730 con 0x7fc18c0d0220 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc170003530 con 0x7fc18c0d0220 2024-09-15T22:52:54.531 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18aa00640 1 -- 172.21.15.31:0/1107558523 >> v1:172.21.15.102:6789/0 conn(0x7fc18c0d0fd0 legacy=0x7fc18c0b4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 920996717 0 0) 0x7fc18c0d2ba0 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18aa00640 1 -- 172.21.15.31:0/1107558523 >> v1:172.21.15.31:6789/0 conn(0x7fc18c0d0220 legacy=0x7fc18c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.532 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.527+0000 7fc18aa00640 1 -- 172.21.15.31:0/1107558523 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c0d2e80 con 0x7fc18c161e30 2024-09-15T22:52:54.534 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1107558523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c0b33d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097f0 tx=0x7fc17c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=43bcc78e2eb0a520 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0aa610 con 0x7fc18c161e30 2024-09-15T22:52:54.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc17c0af070 con 0x7fc18c161e30 2024-09-15T22:52:54.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc18a000640 1 -- 172.21.15.31:0/1107558523 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc17c0aa9d0 con 0x7fc18c161e30 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 -- 172.21.15.31:0/1107558523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 msgr2=0x7fc18c0b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 --2- 172.21.15.31:0/1107558523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c0b33d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0097f0 tx=0x7fc17c01c4b0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 -- 172.21.15.31:0/1107558523 shutdown_connections 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 --2- 172.21.15.31:0/1107558523 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c0b33d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 -- 172.21.15.31:0/1107558523 >> 172.21.15.31:0/1107558523 conn(0x7fc18c08bfd0 msgr2=0x7fc18c0d4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 -- 172.21.15.31:0/1107558523 shutdown_connections 2024-09-15T22:52:54.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.531+0000 7fc191e00640 1 -- 172.21.15.31:0/1107558523 wait complete. 2024-09-15T22:52:54.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 Processor -- start 2024-09-15T22:52:54.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- start start 2024-09-15T22:52:54.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 0x7fc18c15ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0d1800 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc18c0d0630 con 0x7fc18c0d0220 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc18c0d1980 con 0x7fc18c161e30 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:57478/0 (socket says 172.21.15.31:57478) 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 -- 172.21.15.31:0/1948146278 learned_addr learned my addr 172.21.15.31:0/1948146278 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 0x7fc18c15ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc18b400640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 -- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 msgr2=0x7fc18c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 -- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 msgr2=0x7fc18c15ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 0x7fc18c15ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 -- 172.21.15.31:0/1948146278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc18c158ef0 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 0x7fc18c15ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:54.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc18b400640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc182000640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c480 tx=0x7fc17400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc174005480 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc174003600 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc18c0c9c80 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1740039f0 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.535+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc18c0ca240 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc18c162210 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc174003b90 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc183e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 0x7fc168069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fc174085b30 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 0x7fc168069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.539+0000 7fc18aa00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 0x7fc168069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ae000 tx=0x7fc17c0b5040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.543+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc1740182b0 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.743+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc18c160d20 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.748 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.743+0000 7fc183e00640 1 -- 172.21.15.31:0/1948146278 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7fc174056480 con 0x7fc18c0d0fd0 2024-09-15T22:52:54.748 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:54.748 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:54.749 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 msgr2=0x7fc168069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 0x7fc168069d80 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc17c0ae000 tx=0x7fc17c0b5040 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 msgr2=0x7fc18c0c95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fc17400c480 tx=0x7fc17400c940 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 shutdown_connections 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1680678c0 0x7fc168069d80 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc18c161e30 0x7fc18c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc18c0d0fd0 0x7fc18c0c95f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 --2- 172.21.15.31:0/1948146278 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc18c0d0220 0x7fc18c15ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 >> 172.21.15.31:0/1948146278 conn(0x7fc18c08bfd0 msgr2=0x7fc18c1545f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 shutdown_connections 2024-09-15T22:52:54.751 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.747+0000 7fc191e00640 1 -- 172.21.15.31:0/1948146278 wait complete. 2024-09-15T22:52:54.770 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.907+0000 7fb0eb400640 1 Processor -- start 2024-09-15T22:52:54.911 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.907+0000 7fb0eb400640 1 -- start start 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0eb400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fb0e4147930 0x7fb0e40b4270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0eb400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fb0e406c300 0x7fb0e40ae250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0eb400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e4147d10 con 0x7fb0e406fc50 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0eb400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e406f7c0 con 0x7fb0e4147930 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0eb400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e40710a0 con 0x7fb0e406c300 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e3e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fb0e406fc50 0x7fb0e406bbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54486/0 (socket says 172.21.15.31:54486) 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e3e00640 1 -- 172.21.15.31:0/2966055124 learned_addr learned my addr 172.21.15.31:0/2966055124 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/2966055124 >> v2:172.21.15.31:3300/0 conn(0x7fb0e4147930 0x7fb0e40b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e9400640 1 --2- 172.21.15.31:0/2966055124 >> v2:172.21.15.102:3300/0 conn(0x7fb0e406c300 0x7fb0e40ae250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e3400640 1 -- 172.21.15.31:0/2966055124 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1209808031 0 0) 0x7fb0d0001120 con 0x7fb0e406fc50 2024-09-15T22:52:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 -- 172.21.15.31:0/2966055124 >> v2:172.21.15.102:3300/0 conn(0x7fb0e406c300 msgr2=0x7fb0e40ae250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/2966055124 >> v2:172.21.15.102:3300/0 conn(0x7fb0e406c300 0x7fb0e40ae250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 -- 172.21.15.31:0/2966055124 >> v1:172.21.15.31:6789/0 conn(0x7fb0e406fc50 legacy=0x7fb0e406bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.914 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 -- 172.21.15.31:0/2966055124 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e406f1b0 con 0x7fb0e4147930 2024-09-15T22:52:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.911+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/2966055124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e4147930 0x7fb0e40b4270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40742c0 tx=0x7fb0d801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15d63c4370c44e10 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3400640 1 -- 172.21.15.31:0/2966055124 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80b0070 con 0x7fb0e4147930 2024-09-15T22:52:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3400640 1 -- 172.21.15.31:0/2966055124 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d80ab600 con 0x7fb0e4147930 2024-09-15T22:52:54.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3400640 1 -- 172.21.15.31:0/2966055124 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d80a4e60 con 0x7fb0e4147930 2024-09-15T22:52:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- 172.21.15.31:0/2966055124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e4147930 msgr2=0x7fb0e40b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- 172.21.15.31:0/2966055124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e4147930 0x7fb0e40b4270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb0e40742c0 tx=0x7fb0d801c360 comp rx=0 tx=0).stop 2024-09-15T22:52:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- 172.21.15.31:0/2966055124 shutdown_connections 2024-09-15T22:52:54.917 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- 172.21.15.31:0/2966055124 >> v2:172.21.15.102:3300/0 conn(0x7fb0e406c300 0x7fb0e40ae250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- 172.21.15.31:0/2966055124 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e4147930 0x7fb0e40b4270 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- 172.21.15.31:0/2966055124 >> 172.21.15.31:0/2966055124 conn(0x7fb0e40b6790 msgr2=0x7fb0e40b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- 172.21.15.31:0/2966055124 shutdown_connections 2024-09-15T22:52:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- 172.21.15.31:0/2966055124 wait complete. 2024-09-15T22:52:54.918 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 Processor -- start 2024-09-15T22:52:54.919 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- start start 2024-09-15T22:52:54.920 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0e406c300 0x7fb0e4141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0e4147930 0x7fb0e413f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e40701d0 con 0x7fb0e406fc50 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4070050 con 0x7fb0e406c300 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0eb400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e40709e0 con 0x7fb0e4147930 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42532/0 (socket says 172.21.15.31:42532) 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e3e00640 1 -- 172.21.15.31:0/754697202 learned_addr learned my addr 172.21.15.31:0/754697202 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0e406c300 0x7fb0e4141330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.915+0000 7fb0e9400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0e4147930 0x7fb0e413f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.921 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 -- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0e4147930 msgr2=0x7fb0e413f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0e4147930 0x7fb0e413f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 -- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0e406c300 msgr2=0x7fb0e4141330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0e406c300 0x7fb0e4141330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 -- 172.21.15.31:0/754697202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e413f960 con 0x7fb0e406fc50 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e3e00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c480 tx=0x7fb0d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.922 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0018070 con 0x7fb0e406fc50 2024-09-15T22:52:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d0007500 con 0x7fb0e406fc50 2024-09-15T22:52:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d0004a30 con 0x7fb0e406fc50 2024-09-15T22:52:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e413fc40 con 0x7fb0e406fc50 2024-09-15T22:52:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e4141870 con 0x7fb0e406fc50 2024-09-15T22:52:54.923 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0e40ae250 con 0x7fb0e406fc50 2024-09-15T22:52:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fb0d001b070 con 0x7fb0e406fc50 2024-09-15T22:52:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 0x7fb0c4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fb0d0085080 con 0x7fb0e406fc50 2024-09-15T22:52:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.919+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 0x7fb0c4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:54.924 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.923+0000 7fb0e8a00640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 0x7fb0c4069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80ad000 tx=0x7fb0d8008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:54.928 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:54.923+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fb0e4147d10 con 0x7fb0e406fc50 2024-09-15T22:52:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.123+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb0e40b7020 con 0x7fb0e406fc50 2024-09-15T22:52:55.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.123+0000 7fb0e0c00640 1 -- 172.21.15.31:0/754697202 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7fb0d0055400 con 0x7fb0e406fc50 2024-09-15T22:52:55.127 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:55.127 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:55.127 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 msgr2=0x7fb0c4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 0x7fb0c4069d80 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb0d80ad000 tx=0x7fb0d8008040 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 msgr2=0x7fb0e413eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb0d000c480 tx=0x7fb0d000c940 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 shutdown_connections 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fb0c40678c0 0x7fb0c4069d80 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fb0e4147930 0x7fb0e413f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fb0e406fc50 0x7fb0e413eb90 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 --2- 172.21.15.31:0/754697202 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fb0e406c300 0x7fb0e4141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 >> 172.21.15.31:0/754697202 conn(0x7fb0e40b6790 msgr2=0x7fb0e40b0d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:55.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 shutdown_connections 2024-09-15T22:52:55.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.127+0000 7fb0eb400640 1 -- 172.21.15.31:0/754697202 wait complete. 2024-09-15T22:52:55.149 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 Processor -- start 2024-09-15T22:52:55.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 -- start start 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1654071e80 0x7f16540d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f16540d0920 0x7f16540ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1654071030 con 0x7f165415fb60 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f165409ac50 con 0x7f1654071e80 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f165b000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f165409af30 con 0x7f16540d0920 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1654071e80 0x7f16540d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f1654071e80 0x7f16540d03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42544/0 (socket says 172.21.15.31:42544) 2024-09-15T22:52:55.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 -- 172.21.15.31:0/2819250396 learned_addr learned my addr 172.21.15.31:0/2819250396 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f1659000640 1 --2- 172.21.15.31:0/2819250396 >> v2:172.21.15.102:3300/0 conn(0x7f16540d0920 0x7f16540ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 -- 172.21.15.31:0/2819250396 >> v2:172.21.15.102:3300/0 conn(0x7f16540d0920 msgr2=0x7f16540ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 --2- 172.21.15.31:0/2819250396 >> v2:172.21.15.102:3300/0 conn(0x7f16540d0920 0x7f16540ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 -- 172.21.15.31:0/2819250396 >> v1:172.21.15.102:6789/0 conn(0x7f165415fb60 legacy=0x7f165409b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:55.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.287+0000 7f164b400640 1 -- 172.21.15.31:0/2819250396 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165409b210 con 0x7f1654071e80 2024-09-15T22:52:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f164b400640 1 --2- 172.21.15.31:0/2819250396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f16540d03e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1654070030 tx=0x7f163c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49af22f1eb834222 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f1653400640 1 -- 172.21.15.31:0/2819250396 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0b0070 con 0x7f1654071e80 2024-09-15T22:52:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f1653400640 1 -- 172.21.15.31:0/2819250396 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f163c0ab600 con 0x7f1654071e80 2024-09-15T22:52:55.294 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f1653400640 1 -- 172.21.15.31:0/2819250396 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0ab9d0 con 0x7f1654071e80 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 -- 172.21.15.31:0/2819250396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 msgr2=0x7f16540d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 --2- 172.21.15.31:0/2819250396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f16540d03e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f1654070030 tx=0x7f163c01c420 comp rx=0 tx=0).stop 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 -- 172.21.15.31:0/2819250396 shutdown_connections 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 --2- 172.21.15.31:0/2819250396 >> v2:172.21.15.102:3300/0 conn(0x7f16540d0920 0x7f16540ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 --2- 172.21.15.31:0/2819250396 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f16540d03e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 -- 172.21.15.31:0/2819250396 >> 172.21.15.31:0/2819250396 conn(0x7f16540d2370 msgr2=0x7f16540d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 -- 172.21.15.31:0/2819250396 shutdown_connections 2024-09-15T22:52:55.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.291+0000 7f165b000640 1 -- 172.21.15.31:0/2819250396 wait complete. 2024-09-15T22:52:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 Processor -- start 2024-09-15T22:52:55.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- start start 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 0x7f16540c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f165415fb60 0x7f16540c9980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f16541695c0 con 0x7f1654071e80 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f16540d0d30 con 0x7f16540d0920 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f1654169740 con 0x7f165415fb60 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42546/0 (socket says 172.21.15.31:42546) 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 -- 172.21.15.31:0/1551367357 learned_addr learned my addr 172.21.15.31:0/1551367357 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f164b400640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 0x7f16540c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1659000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f165415fb60 0x7f16540c9980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 -- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f165415fb60 msgr2=0x7f16540c9980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f165415fb60 0x7f16540c9980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 -- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 msgr2=0x7f16540c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 0x7f16540c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 -- 172.21.15.31:0/1551367357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16540cc6d0 con 0x7f1654071e80 2024-09-15T22:52:55.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f164b400640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 0x7f16540c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1653e00640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f164400c480 tx=0x7f164400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644012830 con 0x7f1654071e80 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1644017070 con 0x7f1654071e80 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16540b5cd0 con 0x7f1654071e80 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1644012c30 con 0x7f1654071e80 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16541556b0 con 0x7f1654071e80 2024-09-15T22:52:55.300 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.295+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16540b61b0 con 0x7f1654071e80 2024-09-15T22:52:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.299+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f164401c460 con 0x7f1654071e80 2024-09-15T22:52:55.301 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.299+0000 7f1650c00640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 0x7f1630069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.299+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f1644085c60 con 0x7f1654071e80 2024-09-15T22:52:55.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.299+0000 7f164b400640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 0x7f1630069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.303 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.299+0000 7f164b400640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 0x7f1630069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f163c0ad000 tx=0x7f163c0a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.306 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.303+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f16540b61b0 con 0x7f1654071e80 2024-09-15T22:52:55.473 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16540d03e0 con 0x7f1654071e80 2024-09-15T22:52:55.474 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f1650c00640 1 -- 172.21.15.31:0/1551367357 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+17093 (secure 0 0 0) 0x7f16440565b0 con 0x7f1654071e80 2024-09-15T22:52:55.474 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:55.475 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":61,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:35.837144+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:52:24.890486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:52:26.164803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/678504006":"2024-09-16T22:52:35.837128+0000","172.21.15.31:6834/678504006":"2024-09-16T22:52:35.837128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 msgr2=0x7f1630069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 0x7f1630069d80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f163c0ad000 tx=0x7f163c0a6000 comp rx=0 tx=0).stop 2024-09-15T22:52:55.476 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 msgr2=0x7f165415e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f164400c480 tx=0x7f164400c940 comp rx=0 tx=0).stop 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 shutdown_connections 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f16300678c0 0x7f1630069d80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f165415fb60 0x7f16540c9980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f16540d0920 0x7f16540c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 --2- 172.21.15.31:0/1551367357 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f1654071e80 0x7f165415e410 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.471+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 >> 172.21.15.31:0/1551367357 conn(0x7f16540d2370 msgr2=0x7f16540d0ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.475+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 shutdown_connections 2024-09-15T22:52:55.477 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.475+0000 7f165b000640 1 -- 172.21.15.31:0/1551367357 wait complete. 2024-09-15T22:52:55.497 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:52:55.497 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 Processor -- start 2024-09-15T22:52:55.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 -- start start 2024-09-15T22:52:55.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f148806bbf0 0x7f14880d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14880b4960 con 0x7f14880b4e40 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148806dbc0 con 0x7f14880cdbf0 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f148ce00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f14880d16e0 con 0x7f148806bbf0 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1485e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f148806bbf0 0x7f14880d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1486800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f14880b4e40 0x7f14880b5250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54488/0 (socket says 172.21.15.31:54488) 2024-09-15T22:52:55.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1486800640 1 -- 172.21.15.31:0/2555461311 learned_addr learned my addr 172.21.15.31:0/2555461311 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1484a00640 1 -- 172.21.15.31:0/2555461311 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632993221 0 0) 0x7f14880b4960 con 0x7f14880b4e40 2024-09-15T22:52:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1484a00640 1 -- 172.21.15.31:0/2555461311 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f146c003530 con 0x7f14880b4e40 2024-09-15T22:52:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1485e00640 1 -- 172.21.15.31:0/2555461311 >> v1:172.21.15.102:6789/0 conn(0x7f14880cdbf0 legacy=0x7f148806bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1485e00640 1 -- 172.21.15.31:0/2555461311 >> v1:172.21.15.31:6789/0 conn(0x7f14880b4e40 legacy=0x7f14880b5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.635+0000 7f1485e00640 1 -- 172.21.15.31:0/2555461311 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14880d19c0 con 0x7f148806bbf0 2024-09-15T22:52:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f1485e00640 1 --2- 172.21.15.31:0/2555461311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f14880d1020 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af854c00f26f3c85 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f1484a00640 1 -- 172.21.15.31:0/2555461311 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b0070 con 0x7f148806bbf0 2024-09-15T22:52:55.642 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f1484a00640 1 -- 172.21.15.31:0/2555461311 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780ab600 con 0x7f148806bbf0 2024-09-15T22:52:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f1484a00640 1 -- 172.21.15.31:0/2555461311 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14880b6170 con 0x7f148806bbf0 2024-09-15T22:52:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 -- 172.21.15.31:0/2555461311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 msgr2=0x7f14880d1020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 --2- 172.21.15.31:0/2555461311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f14880d1020 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801c410 comp rx=0 tx=0).stop 2024-09-15T22:52:55.643 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 -- 172.21.15.31:0/2555461311 shutdown_connections 2024-09-15T22:52:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 --2- 172.21.15.31:0/2555461311 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f14880d1020 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 -- 172.21.15.31:0/2555461311 >> 172.21.15.31:0/2555461311 conn(0x7f14880b67e0 msgr2=0x7f14880b6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 -- 172.21.15.31:0/2555461311 shutdown_connections 2024-09-15T22:52:55.644 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.639+0000 7f148ce00640 1 -- 172.21.15.31:0/2555461311 wait complete. 2024-09-15T22:52:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 Processor -- start 2024-09-15T22:52:55.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- start start 2024-09-15T22:52:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b4e40 0x7f14880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880cdbf0 0x7f148809c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f148816a0d0 con 0x7f148806bbf0 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f1488169f50 con 0x7f14880b4e40 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f148816a250 con 0x7f14880cdbf0 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42566/0 (socket says 172.21.15.31:42566) 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 -- 172.21.15.31:0/4259837993 learned_addr learned my addr 172.21.15.31:0/4259837993 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 -- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880cdbf0 msgr2=0x7f148809c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880cdbf0 0x7f148809c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 -- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b4e40 msgr2=0x7f14880709e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b4e40 0x7f14880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.647 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 -- 172.21.15.31:0/4259837993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148809b580 con 0x7f148806bbf0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f1485e00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780bc070 con 0x7f148806bbf0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14780b1040 con 0x7f148806bbf0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f148806f940 con 0x7f148806bbf0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14780b0050 con 0x7f148806bbf0 2024-09-15T22:52:55.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f148806ff00 con 0x7f148806bbf0 2024-09-15T22:52:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.643+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14880d1020 con 0x7f148806bbf0 2024-09-15T22:52:55.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.647+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f14780bf070 con 0x7f148806bbf0 2024-09-15T22:52:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.647+0000 7f147e000640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 0x7f1468069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.647+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f147811f9c0 con 0x7f148806bbf0 2024-09-15T22:52:55.650 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.647+0000 7f1485400640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 0x7f1468069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:55.651 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.647+0000 7f1485400640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 0x7f1468069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1474000f70 tx=0x7f14740079e0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:55.654 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.651+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f1478016090 con 0x7f148806bbf0 2024-09-15T22:52:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.847+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f148815d2f0 con 0x7f148806bbf0 2024-09-15T22:52:55.852 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f147e000640 1 -- 172.21.15.31:0/4259837993 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7f14780f0280 con 0x7f148806bbf0 2024-09-15T22:52:55.853 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:55.853 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:55.853 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:55.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 msgr2=0x7f1468069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 0x7f1468069d80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1474000f70 tx=0x7f14740079e0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 msgr2=0x7f148809ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f14780097c0 tx=0x7f147801ac50 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 shutdown_connections 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f14680678c0 0x7f1468069d80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f14880cdbf0 0x7f148809c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f14880b4e40 0x7f14880709e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 --2- 172.21.15.31:0/4259837993 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f148806bbf0 0x7f148809ee10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 >> 172.21.15.31:0/4259837993 conn(0x7f14880b67e0 msgr2=0x7f14880b0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 shutdown_connections 2024-09-15T22:52:55.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:55.851+0000 7f148ce00640 1 -- 172.21.15.31:0/4259837993 wait complete. 2024-09-15T22:52:55.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:52:56.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.011+0000 7fd2dd200640 1 Processor -- start 2024-09-15T22:52:56.015 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.011+0000 7fd2dd200640 1 -- start start 2024-09-15T22:52:56.016 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.011+0000 7fd2dd200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fd2d8159ef0 0x7fd2d80aef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2dd200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2d815d420 0x7fd2d80d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2dd200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2d80af830 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2dd200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d80afb10 con 0x7fd2d815d420 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2dd200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fd2d815c940 con 0x7fd2d8159ef0 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2d815d420 0x7fd2d80d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fd2d815d420 0x7fd2d80d00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42572/0 (socket says 172.21.15.31:42572) 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 -- 172.21.15.31:0/3039953735 learned_addr learned my addr 172.21.15.31:0/3039953735 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:56.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5e00640 1 --2- 172.21.15.31:0/3039953735 >> v2:172.21.15.102:3300/0 conn(0x7fd2d8159ef0 0x7fd2d80aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 -- 172.21.15.31:0/3039953735 >> v2:172.21.15.102:3300/0 conn(0x7fd2d8159ef0 msgr2=0x7fd2d80aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 --2- 172.21.15.31:0/3039953735 >> v2:172.21.15.102:3300/0 conn(0x7fd2d8159ef0 0x7fd2d80aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 -- 172.21.15.31:0/3039953735 >> v1:172.21.15.102:6789/0 conn(0x7fd2d80cf7f0 legacy=0x7fd2d815fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 -- 172.21.15.31:0/3039953735 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d815cc20 con 0x7fd2d815d420 2024-09-15T22:52:56.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d5400640 1 --2- 172.21.15.31:0/3039953735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d815d420 0x7fd2d80d00f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8070310 tx=0x7fd2c401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf3f360b40f0a540 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d4a00640 1 -- 172.21.15.31:0/3039953735 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40ab600 con 0x7fd2d815d420 2024-09-15T22:52:56.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d4a00640 1 -- 172.21.15.31:0/3039953735 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c40b0070 con 0x7fd2d815d420 2024-09-15T22:52:56.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.015+0000 7fd2d4a00640 1 -- 172.21.15.31:0/3039953735 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c40ab9c0 con 0x7fd2d815d420 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- 172.21.15.31:0/3039953735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d815d420 msgr2=0x7fd2d80d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- 172.21.15.31:0/3039953735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d815d420 0x7fd2d80d00f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8070310 tx=0x7fd2c401c4f0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- 172.21.15.31:0/3039953735 shutdown_connections 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- 172.21.15.31:0/3039953735 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d815d420 0x7fd2d80d00f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- 172.21.15.31:0/3039953735 >> v2:172.21.15.102:3300/0 conn(0x7fd2d8159ef0 0x7fd2d80aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.021 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- 172.21.15.31:0/3039953735 >> 172.21.15.31:0/3039953735 conn(0x7fd2d80b20a0 msgr2=0x7fd2d80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- 172.21.15.31:0/3039953735 shutdown_connections 2024-09-15T22:52:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- 172.21.15.31:0/3039953735 wait complete. 2024-09-15T22:52:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 Processor -- start 2024-09-15T22:52:56.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- start start 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d8159ef0 0x7fd2d8155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815d420 0x7fd2d806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8169290 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fd2d8169110 con 0x7fd2d8159ef0 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2dd200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fd2d8169410 con 0x7fd2d815d420 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42574/0 (socket says 172.21.15.31:42574) 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 -- 172.21.15.31:0/746952972 learned_addr learned my addr 172.21.15.31:0/746952972 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5400640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d8159ef0 0x7fd2d8155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d6800640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815d420 0x7fd2d806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 -- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815d420 msgr2=0x7fd2d806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815d420 0x7fd2d806bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 -- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d8159ef0 msgr2=0x7fd2d8155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d8159ef0 0x7fd2d8155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.019+0000 7fd2d5e00640 1 -- 172.21.15.31:0/746952972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2d8155c90 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2d5e00640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800efc0 tx=0x7fd2c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8018020 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2c8014480 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2c8014850 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2d8155f70 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2d8157950 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2d80aef00 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fd2c801b020 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.027 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.023+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fd2c8086c60 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.028 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.027+0000 7fd2d5400640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.027+0000 7fd2d5400640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40af000 tx=0x7fd2c40a7000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.027+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fd2c8022030 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.230 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.227+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2d8156140 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.231 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.227+0000 7fd2ce000640 1 -- 172.21.15.31:0/746952972 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5227 (secure 0 0 0) 0x7fd2c8010040 con 0x7fd2d80cf7f0 2024-09-15T22:52:56.231 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:56.231 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":40,"btime":"2024-09-15T22:52:39:862892+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-15T22:52:27.162874+0000","modified":"2024-09-15T22:52:39.862882+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":61,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5484},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5484":{"gid":5484,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":5,"addr":"172.21.15.31:6835/2507393641","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":2507393641},{"type":"v1","addr":"172.21.15.31:6835","nonce":2507393641}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[8],"metadata_pool":7,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5484,"qdb_cluster":[5484]},"id":3}]} 2024-09-15T22:52:56.231 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 40 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 msgr2=0x7fd2b8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd2c40af000 tx=0x7fd2c40a7000 comp rx=0 tx=0).stop 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 msgr2=0x7fd2d814f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fd2c800efc0 tx=0x7fd2c800c490 comp rx=0 tx=0).stop 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 shutdown_connections 2024-09-15T22:52:56.233 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fd2b80678c0 0x7fd2b8069d80 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fd2d815d420 0x7fd2d806bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fd2d8159ef0 0x7fd2d8155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 --2- 172.21.15.31:0/746952972 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fd2d80cf7f0 0x7fd2d814f5e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 >> 172.21.15.31:0/746952972 conn(0x7fd2d80b20a0 msgr2=0x7fd2d80b2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 shutdown_connections 2024-09-15T22:52:56.234 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.231+0000 7fd2dd200640 1 -- 172.21.15.31:0/746952972 wait complete. 2024-09-15T22:52:56.252 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:52:56.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 Processor -- start 2024-09-15T22:52:56.393 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 -- start start 2024-09-15T22:52:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5c8c0d1170 0x7f5c8c06d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c8c06e240 con 0x7f5c8c0d1550 2024-09-15T22:52:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5c8c06e800 con 0x7f5c8c0d1170 2024-09-15T22:52:56.394 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c94400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8c06e520 con 0x7f5c8c070900 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c91a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5c8c0d1170 0x7f5c8c06d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3301/0 says I am v2:172.21.15.31:55422/0 (socket says 172.21.15.31:55422) 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 -- 172.21.15.31:0/2230997363 learned_addr learned my addr 172.21.15.31:0/2230997363 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 -- 172.21.15.31:0/2230997363 >> v2:172.21.15.102:3300/0 conn(0x7f5c8c0d1170 msgr2=0x7f5c8c06d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:56.395 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 --2- 172.21.15.31:0/2230997363 >> v2:172.21.15.102:3300/0 conn(0x7f5c8c0d1170 0x7f5c8c06d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 -- 172.21.15.31:0/2230997363 >> v1:172.21.15.102:6789/0 conn(0x7f5c8c0d1550 legacy=0x7f5c8c0d0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.396 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.391+0000 7f5c92400640 1 -- 172.21.15.31:0/2230997363 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c0703e0 con 0x7f5c8c070900 2024-09-15T22:52:56.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c92400640 1 --2- 172.21.15.31:0/2230997363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009e50 tx=0x7f5c8401ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb01da7aa15937a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c8be00640 1 -- 172.21.15.31:0/2230997363 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c840a5700 con 0x7f5c8c070900 2024-09-15T22:52:56.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c8be00640 1 -- 172.21.15.31:0/2230997363 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c840a58a0 con 0x7f5c8c070900 2024-09-15T22:52:56.398 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c8be00640 1 -- 172.21.15.31:0/2230997363 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c840a5c70 con 0x7f5c8c070900 2024-09-15T22:52:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 -- 172.21.15.31:0/2230997363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 msgr2=0x7f5c8c070db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 --2- 172.21.15.31:0/2230997363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c84009e50 tx=0x7f5c8401ca30 comp rx=0 tx=0).stop 2024-09-15T22:52:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 -- 172.21.15.31:0/2230997363 shutdown_connections 2024-09-15T22:52:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 --2- 172.21.15.31:0/2230997363 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c070900 0x7f5c8c070db0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.399 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 --2- 172.21.15.31:0/2230997363 >> v2:172.21.15.102:3300/0 conn(0x7f5c8c0d1170 0x7f5c8c06d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 -- 172.21.15.31:0/2230997363 >> 172.21.15.31:0/2230997363 conn(0x7f5c8c0d2370 msgr2=0x7f5c8c0d2780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 -- 172.21.15.31:0/2230997363 shutdown_connections 2024-09-15T22:52:56.400 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.395+0000 7f5c94400640 1 -- 172.21.15.31:0/2230997363 wait complete. 2024-09-15T22:52:56.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 Processor -- start 2024-09-15T22:52:56.401 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- start start 2024-09-15T22:52:56.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c0d1170 0x7f5c8c15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.406 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 0x7f5c8c160090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c09b620 con 0x7f5c8c070900 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5c8c09b4a0 con 0x7f5c8c0d1550 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5c8c09b7a0 con 0x7f5c8c0d1170 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42584/0 (socket says 172.21.15.31:42584) 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 -- 172.21.15.31:0/4191468615 learned_addr learned my addr 172.21.15.31:0/4191468615 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c92400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 0x7f5c8c160090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91000640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c0d1170 0x7f5c8c15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 -- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c0d1170 msgr2=0x7f5c8c15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c0d1170 0x7f5c8c15f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 -- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 msgr2=0x7f5c8c160090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 0x7f5c8c160090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 -- 172.21.15.31:0/4191468615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c8c149cb0 con 0x7f5c8c070900 2024-09-15T22:52:56.407 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c92400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 0x7f5c8c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c91a00640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000e8a0 tx=0x7f5c8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c80017070 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c8000c8e0 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c8c15e370 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c8000cc90 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c8c15e930 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.399+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c8c070db0 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.403+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5c8001a070 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.403+0000 7f5c89600640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.403+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7f5c80085d60 con 0x7f5c8c070900 2024-09-15T22:52:56.408 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.403+0000 7f5c91000640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.409 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.403+0000 7f5c91000640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 0x7f5c6c069db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0cf3c0 tx=0x7f5c78009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.410 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.407+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5c80056620 con 0x7f5c8c070900 2024-09-15T22:52:56.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.571+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c8c0d2fd0 con 0x7f5c8c070900 2024-09-15T22:52:56.579 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c89600640 1 -- 172.21.15.31:0/4191468615 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+17093 (secure 0 0 0) 0x7f5c80055f20 con 0x7f5c8c070900 2024-09-15T22:52:56.579 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:52:56.579 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":61,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:35.837144+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_metadata","create_time":"2024-09-15T22:52:24.890486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_data","create_time":"2024-09-15T22:52:26.164803+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6835/678504006":"2024-09-16T22:52:35.837128+0000","172.21.15.31:6834/678504006":"2024-09-16T22:52:35.837128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:52:56.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 msgr2=0x7f5c6c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 0x7f5c6c069db0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f5c8c0cf3c0 tx=0x7f5c78009040 comp rx=0 tx=0).stop 2024-09-15T22:52:56.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 msgr2=0x7f5c8c149770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5c8000e8a0 tx=0x7f5c8000eca0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.580 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 shutdown_connections 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5c6c0678f0 0x7f5c6c069db0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5c8c0d1550 0x7f5c8c160090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5c8c0d1170 0x7f5c8c15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 --2- 172.21.15.31:0/4191468615 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5c8c070900 0x7f5c8c149770 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 >> 172.21.15.31:0/4191468615 conn(0x7f5c8c0d2370 msgr2=0x7f5c8c0b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 shutdown_connections 2024-09-15T22:52:56.581 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.575+0000 7f5c94400640 1 -- 172.21.15.31:0/4191468615 wait complete. 2024-09-15T22:52:56.598 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-15T22:52:56.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.735+0000 7fdeb0600640 1 Processor -- start 2024-09-15T22:52:56.741 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.735+0000 7fdeb0600640 1 -- start start 2024-09-15T22:52:56.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeb0600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fdea80d0800 0x7fdea8166ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeb0600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea80af830 con 0x7fdea815d420 2024-09-15T22:52:56.744 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeb0600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdea815c940 con 0x7fdea8159ef0 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeb0600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fdea80af610 con 0x7fdea80d0800 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fdea815d420 0x7fdea80d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54494/0 (socket says 172.21.15.31:54494) 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 -- 172.21.15.31:0/3615428576 learned_addr learned my addr 172.21.15.31:0/3615428576 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeae600640 1 --2- 172.21.15.31:0/3615428576 >> v2:172.21.15.102:3300/0 conn(0x7fdea80d0800 0x7fdea8166ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601638410 0 0) 0x7fdea80af830 con 0x7fdea815d420 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde90003530 con 0x7fdea815d420 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2265521746 0 0) 0x7fdea815c940 con 0x7fdea8159ef0 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdea80af830 con 0x7fdea8159ef0 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3086379850 0 0) 0x7fde90003530 con 0x7fdea815d420 2024-09-15T22:52:56.745 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 >> v2:172.21.15.102:3300/0 conn(0x7fdea80d0800 msgr2=0x7fdea8166ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 --2- 172.21.15.31:0/3615428576 >> v2:172.21.15.102:3300/0 conn(0x7fdea80d0800 0x7fdea8166ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 >> v1:172.21.15.102:6789/0 conn(0x7fdea8159ef0 legacy=0x7fdea80aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea815cc20 con 0x7fdea815d420 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7fde94001620 con 0x7fdea815d420 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeae600640 1 --2- 172.21.15.31:0/3615428576 >> v2:172.21.15.102:3300/0 conn(0x7fdea80d0800 0x7fdea8166ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 >> v1:172.21.15.31:6789/0 conn(0x7fdea815d420 legacy=0x7fdea80d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde90003b50 0x7fde90003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fde90004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde900051d0 0x7fde9000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.746 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80af610 con 0x7fde90004810 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fde9000c050 con 0x7fde900051d0 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fde9000c250 con 0x7fde90003b50 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fde90004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeadc00640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde90003b50 0x7fde90003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeae600640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde900051d0 0x7fde9000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 -- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde90003b50 msgr2=0x7fde90003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fde90003b50 0x7fde90003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 -- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde900051d0 msgr2=0x7fde9000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fde900051d0 0x7fde9000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdeae600640 1 -- 172.21.15.31:0/3615428576 reap_dead start 2024-09-15T22:52:56.747 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.739+0000 7fdead200640 1 -- 172.21.15.31:0/3615428576 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde90003530 con 0x7fde90004810 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdead200640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fde90004c90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c160 tx=0x7fde9401cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49d79ee4aea42de4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94007c50 con 0x7fde90004810 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde940a9020 con 0x7fde90004810 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdea7e00640 1 -- 172.21.15.31:0/3615428576 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde94005b00 con 0x7fde90004810 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 -- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 msgr2=0x7fde90004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fde90004c90 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fde9400c160 tx=0x7fde9401cb80 comp rx=0 tx=0).stop 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 -- 172.21.15.31:0/3615428576 shutdown_connections 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3615428576 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fde90004c90 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.749 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 -- 172.21.15.31:0/3615428576 >> 172.21.15.31:0/3615428576 conn(0x7fdea80b20a0 msgr2=0x7fdea80b24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 -- 172.21.15.31:0/3615428576 shutdown_connections 2024-09-15T22:52:56.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.743+0000 7fdeb0600640 1 -- 172.21.15.31:0/3615428576 wait complete. 2024-09-15T22:52:56.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 Processor -- start 2024-09-15T22:52:56.750 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- start start 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 0x7fdea81579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdea81f3f90 0x7fdea806bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80cf7f0 con 0x7fde90004810 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fdea80afb10 con 0x7fdea815e030 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fdea80cf970 con 0x7fdea81f3f90 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.752 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42608/0 (socket says 172.21.15.31:42608) 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 -- 172.21.15.31:0/3238358621 learned_addr learned my addr 172.21.15.31:0/3238358621 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeae600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdea81f3f90 0x7fdea806bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdead200640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 0x7fdea81579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 -- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdea81f3f90 msgr2=0x7fdea806bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdea81f3f90 0x7fdea806bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.753 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 -- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 msgr2=0x7fdea81579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 0x7fdea81579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 -- 172.21.15.31:0/3238358621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdea8156930 con 0x7fde90004810 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdead200640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 0x7fdea81579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeadc00640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0114a0 tx=0x7fde9c011960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c019020 con 0x7fde90004810 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde9c015820 con 0x7fde90004810 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde9c010040 con 0x7fde90004810 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdea8156c10 con 0x7fde90004810 2024-09-15T22:52:56.754 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdea81571d0 con 0x7fde90004810 2024-09-15T22:52:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.747+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdea80aef00 con 0x7fde90004810 2024-09-15T22:52:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.751+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fde9c01c020 con 0x7fde90004810 2024-09-15T22:52:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.751+0000 7fdea5600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 0x7fde88069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:56.755 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.751+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6187+0+0 (secure 0 0 0) 0x7fde9c088c60 con 0x7fde90004810 2024-09-15T22:52:56.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.751+0000 7fdead200640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 0x7fde88069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:56.756 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.751+0000 7fdead200640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 0x7fde88069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde940aa000 tx=0x7fdea815cb10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:56.758 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.755+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fde9c023020 con 0x7fde90004810 2024-09-15T22:52:56.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.955+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdea80b26d0 con 0x7fde90004810 2024-09-15T22:52:56.957 INFO:tasks.ceph.mon.a.smithi031.stderr:2024-09-15T22:52:56.955+0000 7f89b4600640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-15T22:52:56.959 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.955+0000 7fdea5600640 1 -- 172.21.15.31:0/3238358621 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7fde9c059490 con 0x7fde90004810 2024-09-15T22:52:56.959 INFO:teuthology.orchestra.run.smithi031.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-15T22:52:56.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 msgr2=0x7fde88069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 0x7fde88069d80 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fde940aa000 tx=0x7fdea815cb10 comp rx=0 tx=0).stop 2024-09-15T22:52:56.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 msgr2=0x7fdea8156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:56.962 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fde9c0114a0 tx=0x7fde9c011960 comp rx=0 tx=0).stop 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 shutdown_connections 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fde880678c0 0x7fde88069d80 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fdea81f3f90 0x7fdea806bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fdea815e030 0x7fdea81579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 --2- 172.21.15.31:0/3238358621 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fde90004810 0x7fdea8156350 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 >> 172.21.15.31:0/3238358621 conn(0x7fdea80b20a0 msgr2=0x7fdea8154130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 shutdown_connections 2024-09-15T22:52:56.963 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:56.959+0000 7fdeb0600640 1 -- 172.21.15.31:0/3238358621 wait complete. 2024-09-15T22:52:56.967 INFO:tasks.ceph.mds.a.smithi031.stderr: -1253> 2024-09-15T22:52:40.847+0000 7f9d84600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-15T22:52:56.982 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-15T22:52:57.012 INFO:tasks.ceph.mds.a.smithi031.stdout:starting mds.a at 2024-09-15T22:52:57.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 Processor -- start 2024-09-15T22:52:57.129 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 -- start start 2024-09-15T22:52:57.130 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f241815ed10 0x7f241815f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24180726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f241815f670 con 0x7f241815b0b0 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f241815fb90 con 0x7f241815ed10 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2420400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f24180ae8e0 con 0x7f2418072210 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241da00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f241815b0b0 0x7f241806df00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54512/0 (socket says 172.21.15.31:54512) 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241da00640 1 -- 172.21.15.31:0/2612621745 learned_addr learned my addr 172.21.15.31:0/2612621745 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241d000640 1 --2- 172.21.15.31:0/2612621745 >> v2:172.21.15.31:3300/0 conn(0x7f241815ed10 0x7f241815f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241e400640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24180726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2417e00640 1 -- 172.21.15.31:0/2612621745 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3211918849 0 0) 0x7f241815f670 con 0x7f241815b0b0 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f2417e00640 1 -- 172.21.15.31:0/2612621745 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2400003530 con 0x7f241815b0b0 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241d000640 1 -- 172.21.15.31:0/2612621745 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 msgr2=0x7f24180726a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241d000640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24180726a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.131 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241d000640 1 -- 172.21.15.31:0/2612621745 >> v1:172.21.15.31:6789/0 conn(0x7f241815b0b0 legacy=0x7f241806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.132 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.127+0000 7f241d000640 1 -- 172.21.15.31:0/2612621745 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f241806fd10 con 0x7f241815ed10 2024-09-15T22:52:57.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f241d000640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815ed10 0x7f241815f130 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f24040097c0 tx=0x7f240401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1632461a2467e9ef server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:57.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2417e00640 1 -- 172.21.15.31:0/2612621745 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040a7070 con 0x7f241815ed10 2024-09-15T22:52:57.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2417e00640 1 -- 172.21.15.31:0/2612621745 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24040b0070 con 0x7f241815ed10 2024-09-15T22:52:57.134 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2417e00640 1 -- 172.21.15.31:0/2612621745 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040ab870 con 0x7f241815ed10 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 -- 172.21.15.31:0/2612621745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815ed10 msgr2=0x7f241815f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815ed10 0x7f241815f130 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f24040097c0 tx=0x7f240401c470 comp rx=0 tx=0).stop 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 -- 172.21.15.31:0/2612621745 shutdown_connections 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24180726a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 --2- 172.21.15.31:0/2612621745 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815ed10 0x7f241815f130 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 -- 172.21.15.31:0/2612621745 >> 172.21.15.31:0/2612621745 conn(0x7f241806bbf0 msgr2=0x7f241806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 -- 172.21.15.31:0/2612621745 shutdown_connections 2024-09-15T22:52:57.135 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 -- 172.21.15.31:0/2612621745 wait complete. 2024-09-15T22:52:57.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.131+0000 7f2420400640 1 Processor -- start 2024-09-15T22:52:57.136 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- start start 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24181f7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f241815ed10 0x7f24181f9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f241815c620 con 0x7f241815b0b0 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f241815c4a0 con 0x7f241815ed10 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f241806f8a0 con 0x7f2418072210 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42650/0 (socket says 172.21.15.31:42650) 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 -- 172.21.15.31:0/2099881936 learned_addr learned my addr 172.21.15.31:0/2099881936 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:57.138 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241da00640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24181f7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241e400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f241815ed10 0x7f24181f9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 -- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 msgr2=0x7f24181f7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24181f7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 -- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f241815ed10 msgr2=0x7f24181f9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f241815ed10 0x7f24181f9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.139 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 -- 172.21.15.31:0/2099881936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24180b3290 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f241d000640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f240401ab20 tx=0x7f2404019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040abbb0 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24040abd50 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24040bf650 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24180b3530 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24180b3af0 con 0x7f241815b0b0 2024-09-15T22:52:57.140 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.135+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24180726a0 con 0x7f241815b0b0 2024-09-15T22:52:57.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.139+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f24180733f0 con 0x7f241815b0b0 2024-09-15T22:52:57.141 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.139+0000 7f2415600640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 0x7f23f8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:57.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.139+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6273+0+0 (secure 0 0 0) 0x7f24041204c0 con 0x7f241815b0b0 2024-09-15T22:52:57.142 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.139+0000 7f241da00640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 0x7f23f8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:57.143 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.139+0000 7f241da00640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 0x7f23f8069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f240c005890 tx=0x7f240c009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:57.146 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.143+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2404016090 con 0x7f241815b0b0 2024-09-15T22:52:57.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.351+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f24181658c0 con 0x7f241815b0b0 2024-09-15T22:52:57.968 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.963+0000 7f2415600640 1 -- 172.21.15.31:0/2099881936 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f24040f0ed0 con 0x7f241815b0b0 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 msgr2=0x7f23f8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 0x7f23f8069d80 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f240c005890 tx=0x7f240c009040 comp rx=0 tx=0).stop 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 msgr2=0x7f2418153240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f240401ab20 tx=0x7f2404019210 comp rx=0 tx=0).stop 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 shutdown_connections 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f23f80678c0 0x7f23f8069d80 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f241815ed10 0x7f24181f9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f241815b0b0 0x7f2418153240 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 --2- 172.21.15.31:0/2099881936 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2418072210 0x7f24181f7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 >> 172.21.15.31:0/2099881936 conn(0x7f241806bbf0 msgr2=0x7f24180d0590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 shutdown_connections 2024-09-15T22:52:57.972 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:57.967+0000 7f2420400640 1 -- 172.21.15.31:0/2099881936 wait complete. 2024-09-15T22:52:57.993 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-15T22:52:58.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.183+0000 7f3a6a800640 1 Processor -- start 2024-09-15T22:52:58.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.183+0000 7f3a6a800640 1 -- start start 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a6a800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a6415b440 0x7f3a6406e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a6a800640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 0x7f3a640ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a6a800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a640b3a40 con 0x7f3a64073980 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a6a800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f3a640af570 con 0x7f3a6415b440 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a6a800640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f3a640b32d0 con 0x7f3a6406fb40 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a6415b440 0x7f3a6406e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f3a6415b440 0x7f3a6406e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42656/0 (socket says 172.21.15.31:42656) 2024-09-15T22:52:58.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 -- 172.21.15.31:0/3701487129 learned_addr learned my addr 172.21.15.31:0/3701487129 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:58.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 -- 172.21.15.31:0/3701487129 >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 msgr2=0x7f3a640ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:58.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3701487129 >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 0x7f3a640ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 --2- 172.21.15.31:0/3701487129 >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 0x7f3a640ad2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 -- 172.21.15.31:0/3701487129 >> v1:172.21.15.102:6789/0 conn(0x7f3a64073980 legacy=0x7f3a640b4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:58.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a63400640 1 -- 172.21.15.31:0/3701487129 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6406e550 con 0x7f3a6415b440 2024-09-15T22:52:58.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.187+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3701487129 >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 0x7f3a640ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:52:58.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a63400640 1 --2- 172.21.15.31:0/3701487129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6415b440 0x7f3a6406e010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3a640af330 tx=0x7f3a5401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4e8960b3005b686 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a62000640 1 -- 172.21.15.31:0/3701487129 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540b1070 con 0x7f3a6415b440 2024-09-15T22:52:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a62000640 1 -- 172.21.15.31:0/3701487129 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a540ac620 con 0x7f3a6415b440 2024-09-15T22:52:58.193 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a62000640 1 -- 172.21.15.31:0/3701487129 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540ac9f0 con 0x7f3a6415b440 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- 172.21.15.31:0/3701487129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6415b440 msgr2=0x7f3a6406e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3701487129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6415b440 0x7f3a6406e010 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3a640af330 tx=0x7f3a5401c4b0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- 172.21.15.31:0/3701487129 shutdown_connections 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3701487129 >> v2:172.21.15.102:3300/0 conn(0x7f3a6406fb40 0x7f3a640ad2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3701487129 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6415b440 0x7f3a6406e010 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- 172.21.15.31:0/3701487129 >> 172.21.15.31:0/3701487129 conn(0x7f3a6406bbf0 msgr2=0x7f3a6406c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- 172.21.15.31:0/3701487129 shutdown_connections 2024-09-15T22:52:58.194 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- 172.21.15.31:0/3701487129 wait complete. 2024-09-15T22:52:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 Processor -- start 2024-09-15T22:52:58.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- start start 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 0x7f3a6409aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 0x7f3a6414c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f3a640ad7f0 con 0x7f3a6406fb40 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f3a640b3520 con 0x7f3a64073980 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.191+0000 7f3a6a800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f3a640b4940 con 0x7f3a6415b440 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42664/0 (socket says 172.21.15.31:42664) 2024-09-15T22:52:58.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 -- 172.21.15.31:0/3525201043 learned_addr learned my addr 172.21.15.31:0/3525201043 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63e00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 0x7f3a6414c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 0x7f3a6409aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 -- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 msgr2=0x7f3a6414c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 0x7f3a6414c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 -- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 msgr2=0x7f3a6409aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 0x7f3a6409aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 -- 172.21.15.31:0/3525201043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a6409b410 con 0x7f3a6406fb40 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63e00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 0x7f3a6414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 0x7f3a6409aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a63400640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3a540af040 tx=0x7f3a5401acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540b1040 con 0x7f3a6406fb40 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a540bd070 con 0x7f3a6406fb40 2024-09-15T22:52:58.199 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a540b7880 con 0x7f3a6406fb40 2024-09-15T22:52:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a640b02b0 con 0x7f3a6406fb40 2024-09-15T22:52:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a640b0870 con 0x7f3a6406fb40 2024-09-15T22:52:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a640ad2b0 con 0x7f3a6406fb40 2024-09-15T22:52:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.195+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f3a540b7a20 con 0x7f3a6406fb40 2024-09-15T22:52:58.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.199+0000 7f3a5b400640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 0x7f3a44069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.199+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6273+0+0 (secure 0 0 0) 0x7f3a54120480 con 0x7f3a6406fb40 2024-09-15T22:52:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.199+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 0x7f3a44069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:58.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.199+0000 7f3a62a00640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 0x7f3a44069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:58.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.203+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f3a540160d0 con 0x7f3a6406fb40 2024-09-15T22:52:58.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.367+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3a640ad970 con 0x7f3a6406fb40 2024-09-15T22:52:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.967+0000 7f3a5b400640 1 -- 172.21.15.31:0/3525201043 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v63) ==== 181+0+0 (secure 0 0 0) 0x7f3a540f0d70 con 0x7f3a6406fb40 2024-09-15T22:52:58.971 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_metadata' removed 2024-09-15T22:52:58.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 msgr2=0x7f3a44069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:58.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 0x7f3a44069d80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3a50006fd0 tx=0x7f3a50008040 comp rx=0 tx=0).stop 2024-09-15T22:52:58.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 msgr2=0x7f3a6414a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3a540af040 tx=0x7f3a5401acf0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 shutdown_connections 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f3a440678c0 0x7f3a44069d80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f3a6415b440 0x7f3a6414c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f3a64073980 0x7f3a6409aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 --2- 172.21.15.31:0/3525201043 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f3a6406fb40 0x7f3a6414a5a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 >> 172.21.15.31:0/3525201043 conn(0x7f3a6406bbf0 msgr2=0x7f3a640ce120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 shutdown_connections 2024-09-15T22:52:58.974 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:58.971+0000 7f3a6a800640 1 -- 172.21.15.31:0/3525201043 wait complete. 2024-09-15T22:52:59.003 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-15T22:52:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.147+0000 7fa0f3e00640 1 Processor -- start 2024-09-15T22:52:59.152 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.147+0000 7fa0f3e00640 1 -- start start 2024-09-15T22:52:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f3e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0ec15b440 0x7fa0ec06e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.153 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f3e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa0ec073980 0x7fa0ec073d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f3e00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0ec0b3a40 con 0x7fa0ec06fb40 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f3e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ec0af570 con 0x7fa0ec15b440 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f3e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa0ec0b32d0 con 0x7fa0ec073980 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0ec15b440 0x7fa0ec06e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa0ec15b440 0x7fa0ec06e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42666/0 (socket says 172.21.15.31:42666) 2024-09-15T22:52:59.154 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 -- 172.21.15.31:0/3175624453 learned_addr learned my addr 172.21.15.31:0/3175624453 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1e00640 1 --2- 172.21.15.31:0/3175624453 >> v2:172.21.15.102:3300/0 conn(0x7fa0ec073980 0x7fa0ec073d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 -- 172.21.15.31:0/3175624453 >> v2:172.21.15.102:3300/0 conn(0x7fa0ec073980 msgr2=0x7fa0ec073d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 --2- 172.21.15.31:0/3175624453 >> v2:172.21.15.102:3300/0 conn(0x7fa0ec073980 0x7fa0ec073d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 -- 172.21.15.31:0/3175624453 >> v1:172.21.15.102:6789/0 conn(0x7fa0ec06fb40 legacy=0x7fa0ec0ad2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:52:59.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.151+0000 7fa0f1400640 1 -- 172.21.15.31:0/3175624453 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec06e550 con 0x7fa0ec15b440 2024-09-15T22:52:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f1400640 1 --2- 172.21.15.31:0/3175624453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec15b440 0x7fa0ec06e010 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0afd80 tx=0x7fa0e001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a822fc6c84099a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0ebe00640 1 -- 172.21.15.31:0/3175624453 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00b0070 con 0x7fa0ec15b440 2024-09-15T22:52:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0ebe00640 1 -- 172.21.15.31:0/3175624453 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e00ab600 con 0x7fa0ec15b440 2024-09-15T22:52:59.157 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0ebe00640 1 -- 172.21.15.31:0/3175624453 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00ab9d0 con 0x7fa0ec15b440 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3175624453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec15b440 msgr2=0x7fa0ec06e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3175624453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec15b440 0x7fa0ec06e010 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0afd80 tx=0x7fa0e001c520 comp rx=0 tx=0).stop 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3175624453 shutdown_connections 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3175624453 >> v2:172.21.15.102:3300/0 conn(0x7fa0ec073980 0x7fa0ec073d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3175624453 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec15b440 0x7fa0ec06e010 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3175624453 >> 172.21.15.31:0/3175624453 conn(0x7fa0ec06bbf0 msgr2=0x7fa0ec06c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:59.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3175624453 shutdown_connections 2024-09-15T22:52:59.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3175624453 wait complete. 2024-09-15T22:52:59.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 Processor -- start 2024-09-15T22:52:59.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.155+0000 7fa0f3e00640 1 -- start start 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 0x7fa0ec1f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0ec15b440 0x7fa0ec156860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec165fa0 con 0x7fa0ec06fb40 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa0ec0b3520 con 0x7fa0ec073980 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa0ec166120 con 0x7fa0ec15b440 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42680/0 (socket says 172.21.15.31:42680) 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 -- 172.21.15.31:0/3533493910 learned_addr learned my addr 172.21.15.31:0/3533493910 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f0a00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 0x7fa0ec1f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0ec15b440 0x7fa0ec156860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.162 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 -- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0ec15b440 msgr2=0x7fa0ec156860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0ec15b440 0x7fa0ec156860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 -- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 msgr2=0x7fa0ec1f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 0x7fa0ec1f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 -- 172.21.15.31:0/3533493910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0ec0685a0 con 0x7fa0ec06fb40 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f0a00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 0x7fa0ec1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f1400640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0e001abd0 tx=0x7fa0e001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00b0040 con 0x7fa0ec06fb40 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0e00ab400 con 0x7fa0ec06fb40 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0e00b6660 con 0x7fa0ec06fb40 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0ec14d990 con 0x7fa0ec06fb40 2024-09-15T22:52:59.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0ec1f8500 con 0x7fa0ec06fb40 2024-09-15T22:52:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0ec073d90 con 0x7fa0ec06fb40 2024-09-15T22:52:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.159+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa0e00be030 con 0x7fa0ec06fb40 2024-09-15T22:52:59.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.163+0000 7fa0e9600640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 0x7fa0cc069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:52:59.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.163+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 5893+0+0 (secure 0 0 0) 0x7fa0e011f600 con 0x7fa0ec06fb40 2024-09-15T22:52:59.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.163+0000 7fa0f0a00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 0x7fa0cc069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:52:59.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.163+0000 7fa0f0a00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 0x7fa0cc069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0b52b0 tx=0x7fa0d8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:52:59.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.167+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fa0e00c5060 con 0x7fa0ec06fb40 2024-09-15T22:52:59.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.331+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa0ec06f920 con 0x7fa0ec06fb40 2024-09-15T22:52:59.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.975+0000 7fa0e9600640 1 -- 172.21.15.31:0/3533493910 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v64) ==== 169+0+0 (secure 0 0 0) 0x7fa0e0016110 con 0x7fa0ec06fb40 2024-09-15T22:52:59.978 INFO:teuthology.orchestra.run.smithi031.stderr:pool 'cephfs_data' removed 2024-09-15T22:52:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 msgr2=0x7fa0cc069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 0x7fa0cc069d80 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa0ec0b52b0 tx=0x7fa0d8009040 comp rx=0 tx=0).stop 2024-09-15T22:52:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 msgr2=0x7fa0ec1fbac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:52:59.981 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fa0e001abd0 tx=0x7fa0e001ad60 comp rx=0 tx=0).stop 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 shutdown_connections 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa0cc0678c0 0x7fa0cc069d80 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa0ec15b440 0x7fa0ec156860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa0ec073980 0x7fa0ec1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 --2- 172.21.15.31:0/3533493910 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa0ec06fb40 0x7fa0ec1fbac0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 >> 172.21.15.31:0/3533493910 conn(0x7fa0ec06bbf0 msgr2=0x7fa0ec0ad2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 shutdown_connections 2024-09-15T22:52:59.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:52:59.979+0000 7fa0f3e00640 1 -- 172.21.15.31:0/3533493910 wait complete. 2024-09-15T22:53:00.011 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:53:00.014 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:53:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2024-09-15T22:53:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on skipped message = False 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:53:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2024-09-15T22:53:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug trim objects = true 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 20 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 20 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 10 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2024-09-15T22:53:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2024-09-15T22:53:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:53:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon down mkfs grace = 300 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon op complaint time = 120 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on pool no app = False 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2024-09-15T22:53:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: client mount timeout = 600 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: debug client = 20 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = "" 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.c] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.b] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.d] 2024-09-15T22:53:00.066 INFO:teuthology.orchestra.run.smithi031.stdout:[mds] 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds = 20 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: debug mds balancer = 20 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug frag = True 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: mds debug scatterstat = True 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: mds op complaint time = 180 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: mds verify scatter = True 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: osd op complaint time = 180 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: rados mon op timeout = 900 2024-09-15T22:53:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: rados osd op timeout = 900 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-15T22:53:00.068 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-15T22:53:00.069 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-15T22:53:00.070 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = "172.21.15.31,172.21.15.102,[v2:172.21.15.102:3301,v1:172.21.15.102:6790]" 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on skipped message = False 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = e1487968-efb4-47ad-8070-6e7082115957 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-15T22:53:00.071 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-15T22:53:00.072 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 20 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 20 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:53:00.073 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 10 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:53:00.074 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-15T22:53:00.075 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.076 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: mon down mkfs grace = 300 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: mon op complaint time = 120 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on pool no app = False 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: client mount timeout = 600 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: debug client = 20 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:53:00.077 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = "" 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.b] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.c] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.a] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.c] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.b] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mds.d] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout:[mds] 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds = 20 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: debug mds balancer = 20 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-15T22:53:00.078 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug frag = True 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: mds debug scatterstat = True 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: mds op complaint time = 180 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: mds verify scatter = True 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: osd op complaint time = 180 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: rados mon op timeout = 900 2024-09-15T22:53:00.079 INFO:teuthology.orchestra.run.smithi102.stdout: rados osd op timeout = 900 2024-09-15T22:53:00.080 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-09-15T22:53:00.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 Processor -- start 2024-09-15T22:53:00.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 -- start start 2024-09-15T22:53:00.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07240720b0 0x7f0724072b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 0x7f07240d07c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0724073060 con 0x7f072415b170 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f07240d0d00 con 0x7f07240720b0 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.267+0000 7f072ae00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0724073330 con 0x7f07240d0370 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07240720b0 0x7f0724072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f07240720b0 0x7f0724072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42688/0 (socket says 172.21.15.31:42688) 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 -- 172.21.15.31:0/4145545662 learned_addr learned my addr 172.21.15.31:0/4145545662 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f0728e00640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 0x7f07240d07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.273 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 -- 172.21.15.31:0/4145545662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 msgr2=0x7f07240d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:00.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 0x7f07240d07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 -- 172.21.15.31:0/4145545662 >> v1:172.21.15.102:6789/0 conn(0x7f072415b170 legacy=0x7f07240add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 -- 172.21.15.31:0/4145545662 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724073610 con 0x7f07240720b0 2024-09-15T22:53:00.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f0728e00640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 0x7f07240d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:00.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f071b400640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240720b0 0x7f0724072b20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb95e27c8c7f7e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f0723400640 1 -- 172.21.15.31:0/4145545662 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a95f0 con 0x7f07240720b0 2024-09-15T22:53:00.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f0723400640 1 -- 172.21.15.31:0/4145545662 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0a9790 con 0x7f07240720b0 2024-09-15T22:53:00.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.271+0000 7f0723400640 1 -- 172.21.15.31:0/4145545662 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0a9b60 con 0x7f07240720b0 2024-09-15T22:53:00.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- 172.21.15.31:0/4145545662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240720b0 msgr2=0x7f0724072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240720b0 0x7f0724072b20 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f070c009870 tx=0x7f070c01c530 comp rx=0 tx=0).stop 2024-09-15T22:53:00.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- 172.21.15.31:0/4145545662 shutdown_connections 2024-09-15T22:53:00.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240d0370 0x7f07240d07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- 172.21.15.31:0/4145545662 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240720b0 0x7f0724072b20 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- 172.21.15.31:0/4145545662 >> 172.21.15.31:0/4145545662 conn(0x7f072406be90 msgr2=0x7f072406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- 172.21.15.31:0/4145545662 shutdown_connections 2024-09-15T22:53:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- 172.21.15.31:0/4145545662 wait complete. 2024-09-15T22:53:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 Processor -- start 2024-09-15T22:53:00.278 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- start start 2024-09-15T22:53:00.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240720b0 0x7f0724156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 0x7f0724146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f07240b4200 con 0x7f07240d0370 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f07240b4080 con 0x7f072415b170 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f072ae00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f07240b4380 con 0x7f07240720b0 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f071b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f071b400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42698/0 (socket says 172.21.15.31:42698) 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f071b400640 1 -- 172.21.15.31:0/4119375418 learned_addr learned my addr 172.21.15.31:0/4119375418 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f0723e00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240720b0 0x7f0724156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f0728e00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 0x7f0724146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.275+0000 7f071b400640 1 -- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240720b0 msgr2=0x7f0724156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f071b400640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240720b0 0x7f0724156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f071b400640 1 -- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 msgr2=0x7f0724146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f071b400640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 0x7f0724146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f071b400640 1 -- 172.21.15.31:0/4119375418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0724152bd0 con 0x7f07240d0370 2024-09-15T22:53:00.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0728e00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 0x7f0724146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:00.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f071b400640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ab040 tx=0x7f070c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b1800 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f070c0b19a0 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f070c0b1d90 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0724155d90 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0724156350 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0724072b20 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f070c0a9650 con 0x7f07240d0370 2024-09-15T22:53:00.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 0x7f0700069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f070c120260 con 0x7f07240d0370 2024-09-15T22:53:00.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.279+0000 7f0723e00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 0x7f0700069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.283+0000 7f0723e00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 0x7f0700069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0714007fd0 tx=0x7f0714009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.283+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f070c0c3030 con 0x7f07240d0370 2024-09-15T22:53:00.454 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.451+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f07241469a0 con 0x7f07240d0370 2024-09-15T22:53:00.457 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f0720c00640 1 -- 172.21.15.31:0/4119375418 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) ==== 104+0+0 (secure 0 0 0) 0x7f070c0ad020 con 0x7f07240d0370 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 msgr2=0x7f0700069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 0x7f0700069db0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0714007fd0 tx=0x7f0714009040 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 msgr2=0x7f0724155700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f070c0ab040 tx=0x7f070c01ad70 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 shutdown_connections 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f07000678f0 0x7f0700069db0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f072415b170 0x7f0724146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f07240d0370 0x7f0724155700 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 --2- 172.21.15.31:0/4119375418 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f07240720b0 0x7f0724156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 >> 172.21.15.31:0/4119375418 conn(0x7f072406be90 msgr2=0x7f072406c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:00.460 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 shutdown_connections 2024-09-15T22:53:00.461 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.455+0000 7f072ae00640 1 -- 172.21.15.31:0/4119375418 wait complete. 2024-09-15T22:53:00.479 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters' 2024-09-15T22:53:00.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.615+0000 7f5f8d200640 1 Processor -- start 2024-09-15T22:53:00.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.615+0000 7f5f8d200640 1 -- start start 2024-09-15T22:53:00.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f8d200640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5f8806f270 0x7f5f8806f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.622 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f8d200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f8806fb90 con 0x7f5f880b47a0 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f8d200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f88072d40 con 0x7f5f88072870 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f8d200640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5f8815ba60 con 0x7f5f8806f270 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f7d400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5f880b47a0 0x7f5f88072160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54516/0 (socket says 172.21.15.31:54516) 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f7d400640 1 -- 172.21.15.31:0/3591255528 learned_addr learned my addr 172.21.15.31:0/3591255528 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85e00640 1 --2- 172.21.15.31:0/3591255528 >> v2:172.21.15.102:3300/0 conn(0x7f5f8806f270 0x7f5f8806f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85400640 1 -- 172.21.15.31:0/3591255528 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503953245 0 0) 0x7f5f8806fb90 con 0x7f5f880b47a0 2024-09-15T22:53:00.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85400640 1 -- 172.21.15.31:0/3591255528 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f6c003530 con 0x7f5f880b47a0 2024-09-15T22:53:00.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85e00640 1 -- 172.21.15.31:0/3591255528 >> v1:172.21.15.102:6789/0 conn(0x7f5f88072870 legacy=0x7f5f8815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85e00640 1 -- 172.21.15.31:0/3591255528 >> v1:172.21.15.31:6789/0 conn(0x7f5f880b47a0 legacy=0x7f5f88072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.619+0000 7f5f85e00640 1 -- 172.21.15.31:0/3591255528 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f88073020 con 0x7f5f8806f270 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f85e00640 1 --2- 172.21.15.31:0/3591255528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f8806f270 0x7f5f8806f650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f780097c0 tx=0x7f5f7801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644c656c15fd4458 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f85400640 1 -- 172.21.15.31:0/3591255528 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f780b0070 con 0x7f5f8806f270 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f85400640 1 -- 172.21.15.31:0/3591255528 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f780ab600 con 0x7f5f8806f270 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f85400640 1 -- 172.21.15.31:0/3591255528 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f780ab9d0 con 0x7f5f8806f270 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- 172.21.15.31:0/3591255528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f8806f270 msgr2=0x7f5f8806f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 --2- 172.21.15.31:0/3591255528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f8806f270 0x7f5f8806f650 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f780097c0 tx=0x7f5f7801c4a0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- 172.21.15.31:0/3591255528 shutdown_connections 2024-09-15T22:53:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 --2- 172.21.15.31:0/3591255528 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f8806f270 0x7f5f8806f650 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- 172.21.15.31:0/3591255528 >> 172.21.15.31:0/3591255528 conn(0x7f5f88067e00 msgr2=0x7f5f8806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- 172.21.15.31:0/3591255528 shutdown_connections 2024-09-15T22:53:00.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- 172.21.15.31:0/3591255528 wait complete. 2024-09-15T22:53:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 Processor -- start 2024-09-15T22:53:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- start start 2024-09-15T22:53:00.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5f8806f270 0x7f5f88152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f88072870 0x7f5f88149e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88155b90 con 0x7f5f880b47a0 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5f88155a10 con 0x7f5f88072870 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.623+0000 7f5f8d200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5f880b4bb0 con 0x7f5f8806f270 2024-09-15T22:53:00.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42700/0 (socket says 172.21.15.31:42700) 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 -- 172.21.15.31:0/16053789 learned_addr learned my addr 172.21.15.31:0/16053789 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f85e00640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5f8806f270 0x7f5f88152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f7d400640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f88072870 0x7f5f88149e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 -- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5f8806f270 msgr2=0x7f5f88152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5f8806f270 0x7f5f88152410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 -- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f88072870 msgr2=0x7f5f88149e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f88072870 0x7f5f88149e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 -- 172.21.15.31:0/16053789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f8814a350 con 0x7f5f880b47a0 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f86800640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c7a0 tx=0x7f5f8000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f80003b80 con 0x7f5f880b47a0 2024-09-15T22:53:00.636 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f80003d20 con 0x7f5f880b47a0 2024-09-15T22:53:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f8000aa30 con 0x7f5f880b47a0 2024-09-15T22:53:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f88151650 con 0x7f5f880b47a0 2024-09-15T22:53:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f88151c10 con 0x7f5f880b47a0 2024-09-15T22:53:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f8815c840 con 0x7f5f880b47a0 2024-09-15T22:53:00.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.627+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5f8000abd0 con 0x7f5f880b47a0 2024-09-15T22:53:00.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.631+0000 7f5f7ea00640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 0x7f5f64069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:00.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.631+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f5f80085930 con 0x7f5f880b47a0 2024-09-15T22:53:00.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.631+0000 7f5f85e00640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 0x7f5f64069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:00.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.631+0000 7f5f85e00640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 0x7f5f64069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f780ad000 tx=0x7f5f780a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:00.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.635+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5f80055f30 con 0x7f5f880b47a0 2024-09-15T22:53:00.866 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.863+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]} v 0) -- 0x7f5f880af670 con 0x7f5f880b47a0 2024-09-15T22:53:00.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.975+0000 7f5f7ea00640 1 -- 172.21.15.31:0/16053789 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_openfiletable.OpenFileTable.test_perf_counters"]}]=0 v155) ==== 143+0+0 (secure 0 0 0) 0x7f5f8005a230 con 0x7f5f880b47a0 2024-09-15T22:53:00.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 msgr2=0x7f5f64069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 0x7f5f64069d80 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f5f780ad000 tx=0x7f5f780a6000 comp rx=0 tx=0).stop 2024-09-15T22:53:00.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 msgr2=0x7f5f88152bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:00.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f5f8000c7a0 tx=0x7f5f8000cc60 comp rx=0 tx=0).stop 2024-09-15T22:53:00.982 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 shutdown_connections 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5f640678c0 0x7f5f64069d80 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5f880b47a0 0x7f5f88152bc0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5f88072870 0x7f5f88149e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 --2- 172.21.15.31:0/16053789 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5f8806f270 0x7f5f88152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 >> 172.21.15.31:0/16053789 conn(0x7f5f88067e00 msgr2=0x7f5f880b0150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 shutdown_connections 2024-09-15T22:53:00.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:00.979+0000 7f5f8d200640 1 -- 172.21.15.31:0/16053789 wait complete. 2024-09-15T22:53:01.002 INFO:tasks.cephfs_test_runner:Opening a file should increment omap_total_updates by 1. ... ok 2024-09-15T22:53:01.002 INFO:tasks.cephfs_test_runner: 2024-09-15T22:53:01.002 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-15T22:53:01.002 INFO:tasks.cephfs_test_runner:Ran 2 tests in 123.981s 2024-09-15T22:53:01.003 INFO:tasks.cephfs_test_runner: 2024-09-15T22:53:01.003 INFO:tasks.cephfs_test_runner:OK 2024-09-15T22:53:01.003 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-15T22:53:01.014 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-15T22:53:01.060 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-15T22:53:01.061 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:53:01.061 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:53:01.069 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:53:01.070 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2024-09-15T22:53:01.070 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:53:01.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16353336k,nr_inodes=4088334,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9430 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275600k,nr_inodes=818900,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275604k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-15T22:53:01.122 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:53:01.122 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:53:01.131 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:53:01.131 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-15T22:53:01.131 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-15T22:53:01.184 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16350240k,nr_inodes=4087560,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=4335 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 none /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3274980k,nr_inodes=818745,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3274984k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-15T22:53:01.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.184 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:53:01.194 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-15T22:53:01.194 INFO:teuthology.orchestra.run.smithi031.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-15T22:53:01.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-15T22:53:01.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.258 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-15T22:53:01.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-15T22:53:01.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.855 DEBUG:teuthology.orchestra.run.smithi031:> ip netns list 2024-09-15T22:53:01.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:01.865 DEBUG:teuthology.orchestra.run.smithi031:> sudo ip link delete ceph-brx 2024-09-15T22:53:02.302 INFO:teuthology.orchestra.run.smithi031.stderr:Cannot find device "ceph-brx" 2024-09-15T22:53:02.305 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:53:02.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:02.306 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:53:02.315 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-15T22:53:02.316 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-15T22:53:02.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:02.316 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-15T22:53:02.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:02.382 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-15T22:53:02.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:02.888 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-15T22:53:03.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:03.031 DEBUG:teuthology.orchestra.run.smithi102:> ip netns list 2024-09-15T22:53:03.040 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-15T22:53:03.040 DEBUG:teuthology.orchestra.run.smithi102:> sudo ip link delete ceph-brx 2024-09-15T22:53:03.434 INFO:teuthology.orchestra.run.smithi102.stderr:Cannot find device "ceph-brx" 2024-09-15T22:53:03.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:53:03.437 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-15T22:53:03.448 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-15T22:53:03.449 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:53:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 Processor -- start 2024-09-15T22:53:03.601 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 -- start start 2024-09-15T22:53:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4d415f770 0x7fc4d409aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 0x7fc4d4161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4d40d0c70 con 0x7fc4d415e6d0 2024-09-15T22:53:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d4160040 con 0x7fc4d415f770 2024-09-15T22:53:03.602 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4db400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc4d40d0f50 con 0x7fc4d409af80 2024-09-15T22:53:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4d415f770 0x7fc4d409aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fc4d415f770 0x7fc4d409aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42716/0 (socket says 172.21.15.31:42716) 2024-09-15T22:53:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 -- 172.21.15.31:0/2222523110 learned_addr learned my addr 172.21.15.31:0/2222523110 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:03.603 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4d9400640 1 --2- 172.21.15.31:0/2222523110 >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 0x7fc4d4161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 -- 172.21.15.31:0/2222523110 >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 msgr2=0x7fc4d4161410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 --2- 172.21.15.31:0/2222523110 >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 0x7fc4d4161410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 -- 172.21.15.31:0/2222523110 >> v1:172.21.15.102:6789/0 conn(0x7fc4d415e6d0 legacy=0x7fc4d40d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4cbe00640 1 -- 172.21.15.31:0/2222523110 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d40d1230 con 0x7fc4d415f770 2024-09-15T22:53:03.604 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.599+0000 7fc4d9400640 1 --2- 172.21.15.31:0/2222523110 >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 0x7fc4d4161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:03.605 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4cbe00640 1 --2- 172.21.15.31:0/2222523110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d409aa40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4074120 tx=0x7fc4bc01cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0aef91f9c11e407 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.606 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4d3e00640 1 -- 172.21.15.31:0/2222523110 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0ab5f0 con 0x7fc4d415f770 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4d3e00640 1 -- 172.21.15.31:0/2222523110 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4bc0b0070 con 0x7fc4d415f770 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4d3e00640 1 -- 172.21.15.31:0/2222523110 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4bc0ab9b0 con 0x7fc4d415f770 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 -- 172.21.15.31:0/2222523110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 msgr2=0x7fc4d409aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 --2- 172.21.15.31:0/2222523110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d409aa40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7fc4d4074120 tx=0x7fc4bc01cf40 comp rx=0 tx=0).stop 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 -- 172.21.15.31:0/2222523110 shutdown_connections 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 --2- 172.21.15.31:0/2222523110 >> v2:172.21.15.102:3300/0 conn(0x7fc4d409af80 0x7fc4d4161410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 --2- 172.21.15.31:0/2222523110 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d409aa40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.607 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 -- 172.21.15.31:0/2222523110 >> 172.21.15.31:0/2222523110 conn(0x7fc4d40d23b0 msgr2=0x7fc4d40d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 -- 172.21.15.31:0/2222523110 shutdown_connections 2024-09-15T22:53:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.603+0000 7fc4db400640 1 -- 172.21.15.31:0/2222523110 wait complete. 2024-09-15T22:53:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 Processor -- start 2024-09-15T22:53:03.608 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- start start 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4d409af80 0x7fc4d415a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4d415e6d0 0x7fc4d40b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d406d0b0 con 0x7fc4d415f770 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc4d40d17f0 con 0x7fc4d415e6d0 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc4d406d230 con 0x7fc4d409af80 2024-09-15T22:53:03.610 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42726/0 (socket says 172.21.15.31:42726) 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 -- 172.21.15.31:0/2864460189 learned_addr learned my addr 172.21.15.31:0/2864460189 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d8a00640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4d409af80 0x7fc4d415a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4cbe00640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4d415e6d0 0x7fc4d40b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 -- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4d409af80 msgr2=0x7fc4d415a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4d409af80 0x7fc4d415a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 -- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4d415e6d0 msgr2=0x7fc4d40b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4d415e6d0 0x7fc4d40b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.611 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 -- 172.21.15.31:0/2864460189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4d406e6e0 con 0x7fc4d415f770 2024-09-15T22:53:03.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d9400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00cef0 tx=0x7fc4cc00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc01a070 con 0x7fc4d415f770 2024-09-15T22:53:03.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4cc00d860 con 0x7fc4d415f770 2024-09-15T22:53:03.612 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4cc00dc50 con 0x7fc4d415f770 2024-09-15T22:53:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4d415ae10 con 0x7fc4d415f770 2024-09-15T22:53:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4d40b7bb0 con 0x7fc4d415f770 2024-09-15T22:53:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.607+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4d4161410 con 0x7fc4d415f770 2024-09-15T22:53:03.613 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.611+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc4cc01d070 con 0x7fc4d415f770 2024-09-15T22:53:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.611+0000 7fc4d1600640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 0x7fc4b0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.611+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fc4cc086390 con 0x7fc4d415f770 2024-09-15T22:53:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.611+0000 7fc4d8a00640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 0x7fc4b0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.614 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.611+0000 7fc4d8a00640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 0x7fc4b0069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cc720 tx=0x7fc4c4007e40 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.615+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc4cc056a50 con 0x7fc4d415f770 2024-09-15T22:53:03.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc4d409b570 con 0x7fc4b00678c0 2024-09-15T22:53:03.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4d1600640 1 -- 172.21.15.31:0/2864460189 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7fc4d409b570 con 0x7fc4b00678c0 2024-09-15T22:53:03.785 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 msgr2=0x7fc4b0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 0x7fc4b0069d80 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fc4d40cc720 tx=0x7fc4c4007e40 comp rx=0 tx=0).stop 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 msgr2=0x7fc4d40b6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fc4cc00cef0 tx=0x7fc4cc00a710 comp rx=0 tx=0).stop 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 shutdown_connections 2024-09-15T22:53:03.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc4b00678c0 0x7fc4b0069d80 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc4d415f770 0x7fc4d40b6b40 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc4d415e6d0 0x7fc4d40b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 --2- 172.21.15.31:0/2864460189 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc4d409af80 0x7fc4d415a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 >> 172.21.15.31:0/2864460189 conn(0x7fc4d40d23b0 msgr2=0x7fc4d40ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 shutdown_connections 2024-09-15T22:53:03.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.779+0000 7fc4db400640 1 -- 172.21.15.31:0/2864460189 wait complete. 2024-09-15T22:53:03.802 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-15T22:53:03.594208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":227504,"kb_used_data":7104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747216,"statfs":{"total":773094113280,"available":772861149184,"internally_reserved":0,"allocated":7274496,"data_stored":3955029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7179,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-72,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.633648"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":248,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T22:53:00.414912+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:53:00.414912+0000","last_peered":"2024-09-15T22:53:00.414912+0000","last_clean":"2024-09-15T22:53:00.414912+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:53:00.414912+0000","last_undegraded":"2024-09-15T22:53:00.414912+0000","last_fullsized":"2024-09-15T22:53:00.414912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":753664,"data_stored":344500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:53:03.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:53:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 Processor -- start 2024-09-15T22:53:03.945 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 -- start start 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b04e0 0x7fcd2c0add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c0ae2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd2c0af440 con 0x7fcd2c15c080 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fcd2c0b0050 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd33c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2c0af720 con 0x7fcd2c15f5a0 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b04e0 0x7fcd2c0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.946 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fcd2c0b04e0 0x7fcd2c0add60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42728/0 (socket says 172.21.15.31:42728) 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 -- 172.21.15.31:0/1733945433 learned_addr learned my addr 172.21.15.31:0/1733945433 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd31c00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c0ae2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 -- 172.21.15.31:0/1733945433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 msgr2=0x7fcd2c0ae2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c0ae2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 -- 172.21.15.31:0/1733945433 >> v1:172.21.15.102:6789/0 conn(0x7fcd2c15c080 legacy=0x7fcd2c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.947 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.943+0000 7fcd2be00640 1 -- 172.21.15.31:0/1733945433 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c0afa00 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.949 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd2be00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c0add60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009870 tx=0x7fcd1801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197806dac8346815 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd2b400640 1 -- 172.21.15.31:0/1733945433 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180b2070 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd2b400640 1 -- 172.21.15.31:0/1733945433 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd180a9070 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd2b400640 1 -- 172.21.15.31:0/1733945433 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180ad880 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 -- 172.21.15.31:0/1733945433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c0b04e0 msgr2=0x7fcd2c0add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c0add60 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd18009870 tx=0x7fcd1801c560 comp rx=0 tx=0).stop 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 -- 172.21.15.31:0/1733945433 shutdown_connections 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c0ae2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 --2- 172.21.15.31:0/1733945433 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c0add60 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 -- 172.21.15.31:0/1733945433 >> 172.21.15.31:0/1733945433 conn(0x7fcd2c06bcc0 msgr2=0x7fcd2c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 -- 172.21.15.31:0/1733945433 shutdown_connections 2024-09-15T22:53:03.951 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 -- 172.21.15.31:0/1733945433 wait complete. 2024-09-15T22:53:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.947+0000 7fcd33c00640 1 Processor -- start 2024-09-15T22:53:03.952 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- start start 2024-09-15T22:53:03.954 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c15ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c160840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c06f4a0 con 0x7fcd2c15c080 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fcd2c06f320 con 0x7fcd2c0b04e0 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fcd2c06f620 con 0x7fcd2c15f5a0 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42730/0 (socket says 172.21.15.31:42730) 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 -- 172.21.15.31:0/4222498602 learned_addr learned my addr 172.21.15.31:0/4222498602 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 -- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 msgr2=0x7fcd2c160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd31200640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c15ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.955 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 -- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 msgr2=0x7fcd2c15ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c15ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 -- 172.21.15.31:0/4222498602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd2c15f350 con 0x7fcd2c15c080 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd31200640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd2be00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcd1801ac10 tx=0x7fcd18019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180bc070 con 0x7fcd2c15c080 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd180b6620 con 0x7fcd2c15c080 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd180b2040 con 0x7fcd2c15c080 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd2c15d220 con 0x7fcd2c15c080 2024-09-15T22:53:03.956 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd2c148250 con 0x7fcd2c15c080 2024-09-15T22:53:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.951+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd2c070a90 con 0x7fcd2c15c080 2024-09-15T22:53:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.955+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fcd180ab070 con 0x7fcd2c15c080 2024-09-15T22:53:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.955+0000 7fcd28c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 0x7fcd0c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.955+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fcd1811efe0 con 0x7fcd2c15c080 2024-09-15T22:53:03.957 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.955+0000 7fcd31200640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 0x7fcd0c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:03.958 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.955+0000 7fcd31200640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 0x7fcd0c069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd200016f0 tx=0x7fcd20009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:03.961 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:03.959+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fcd18016150 con 0x7fcd2c15c080 2024-09-15T22:53:04.123 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.119+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcd2c0d0500 con 0x7fcd0c0678c0 2024-09-15T22:53:04.124 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd28c00640 1 -- 172.21.15.31:0/4222498602 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7fcd2c0d0500 con 0x7fcd0c0678c0 2024-09-15T22:53:04.124 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:04.125 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:53:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 msgr2=0x7fcd0c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 0x7fcd0c069d80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fcd200016f0 tx=0x7fcd20009040 comp rx=0 tx=0).stop 2024-09-15T22:53:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 msgr2=0x7fcd2c148a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fcd1801ac10 tx=0x7fcd18019300 comp rx=0 tx=0).stop 2024-09-15T22:53:04.126 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 shutdown_connections 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fcd0c0678c0 0x7fcd0c069d80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fcd2c15f5a0 0x7fcd2c160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fcd2c15c080 0x7fcd2c148a50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 --2- 172.21.15.31:0/4222498602 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fcd2c0b04e0 0x7fcd2c15ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 >> 172.21.15.31:0/4222498602 conn(0x7fcd2c06bcc0 msgr2=0x7fcd2c0b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 shutdown_connections 2024-09-15T22:53:04.127 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.123+0000 7fcd33c00640 1 -- 172.21.15.31:0/4222498602 wait complete. 2024-09-15T22:53:04.145 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-15T22:53:03.594208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":227504,"kb_used_data":7104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747216,"statfs":{"total":773094113280,"available":772861149184,"internally_reserved":0,"allocated":7274496,"data_stored":3955029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7179,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-72,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.633648"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":248,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T22:53:00.414912+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:53:00.414912+0000","last_peered":"2024-09-15T22:53:00.414912+0000","last_clean":"2024-09-15T22:53:00.414912+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:53:00.414912+0000","last_undegraded":"2024-09-15T22:53:00.414912+0000","last_fullsized":"2024-09-15T22:53:00.414912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":753664,"data_stored":344500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:53:04.146 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-15T22:53:04.146 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:53:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 Processor -- start 2024-09-15T22:53:04.286 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 -- start start 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f44072160 0x7f8f44072540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4406e160 0x7f8f4406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f44072a80 con 0x7f8f4413fa40 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f8f4413f640 con 0x7f8f44072160 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f49c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8f441413c0 con 0x7f8f4406e160 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f8f44072160 0x7f8f44072540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f8f4413fa40 0x7f8f4413fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54522/0 (socket says 172.21.15.31:54522) 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42000640 1 -- 172.21.15.31:0/2453920959 learned_addr learned my addr 172.21.15.31:0/2453920959 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f43400640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4406e160 0x7f8f4406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42a00640 1 -- 172.21.15.31:0/2453920959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4406e160 msgr2=0x7f8f4406e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42a00640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4406e160 0x7f8f4406e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.288 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42a00640 1 -- 172.21.15.31:0/2453920959 >> v1:172.21.15.31:6789/0 conn(0x7f8f4413fa40 legacy=0x7f8f4413fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.289 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.283+0000 7f8f42a00640 1 -- 172.21.15.31:0/2453920959 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f441407b0 con 0x7f8f44072160 2024-09-15T22:53:04.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f42a00640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f44072540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfa42d2e68a0ad0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f41600640 1 -- 172.21.15.31:0/2453920959 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340b0070 con 0x7f8f44072160 2024-09-15T22:53:04.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f41600640 1 -- 172.21.15.31:0/2453920959 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f340ab600 con 0x7f8f44072160 2024-09-15T22:53:04.291 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f41600640 1 -- 172.21.15.31:0/2453920959 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f340ab9d0 con 0x7f8f44072160 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 -- 172.21.15.31:0/2453920959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 msgr2=0x7f8f44072540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f44072540 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f8f340097c0 tx=0x7f8f3401c410 comp rx=0 tx=0).stop 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 -- 172.21.15.31:0/2453920959 shutdown_connections 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4406e160 0x7f8f4406e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 --2- 172.21.15.31:0/2453920959 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f44072540 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 -- 172.21.15.31:0/2453920959 >> 172.21.15.31:0/2453920959 conn(0x7f8f44067e00 msgr2=0x7f8f4406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 -- 172.21.15.31:0/2453920959 shutdown_connections 2024-09-15T22:53:04.292 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.287+0000 7f8f49c00640 1 -- 172.21.15.31:0/2453920959 wait complete. 2024-09-15T22:53:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 Processor -- start 2024-09-15T22:53:04.293 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- start start 2024-09-15T22:53:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 0x7f8f441550d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.295 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 0x7f8f4415ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44168ee0 con 0x7f8f44072160 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f8f44168d60 con 0x7f8f4406e160 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f8f44169060 con 0x7f8f4413fa40 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42744/0 (socket says 172.21.15.31:42744) 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 -- 172.21.15.31:0/3641079253 learned_addr learned my addr 172.21.15.31:0/3641079253 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f43400640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 0x7f8f4415ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42a00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 0x7f8f441550d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.296 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 -- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 msgr2=0x7f8f4415ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 0x7f8f4415ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 -- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 msgr2=0x7f8f441550d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 0x7f8f441550d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 -- 172.21.15.31:0/3641079253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f4415bd40 con 0x7f8f44072160 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42a00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 0x7f8f441550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f43400640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 0x7f8f4415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f42000640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c370 tx=0x7f8f3000c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f30017070 con 0x7f8f44072160 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f30005cf0 con 0x7f8f44072160 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f300072f0 con 0x7f8f44072160 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f4413f1e0 con 0x7f8f44072160 2024-09-15T22:53:04.297 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.291+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f440b3960 con 0x7f8f44072160 2024-09-15T22:53:04.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f44072540 con 0x7f8f44072160 2024-09-15T22:53:04.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f8f3001a070 con 0x7f8f44072160 2024-09-15T22:53:04.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f3aa00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 0x7f8f24069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.298 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f8f30084f70 con 0x7f8f44072160 2024-09-15T22:53:04.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f42a00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 0x7f8f24069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.299 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.295+0000 7f8f42a00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 0x7f8f24069db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f340a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.302 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.299+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f8f30055b30 con 0x7f8f44072160 2024-09-15T22:53:04.463 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.459+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8f44139750 con 0x7f8f240678f0 2024-09-15T22:53:04.464 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f3aa00640 1 -- 172.21.15.31:0/3641079253 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13494 (secure 0 0 0) 0x7f8f44139750 con 0x7f8f240678f0 2024-09-15T22:53:04.465 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:04.465 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 msgr2=0x7f8f24069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 0x7f8f24069db0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8f340ad000 tx=0x7f8f340a6000 comp rx=0 tx=0).stop 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 msgr2=0x7f8f4415c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f8f3000c370 tx=0x7f8f3000c830 comp rx=0 tx=0).stop 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 shutdown_connections 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f8f240678f0 0x7f8f24069db0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f8f4413fa40 0x7f8f4415ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f8f44072160 0x7f8f4415c790 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.467 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 --2- 172.21.15.31:0/3641079253 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f8f4406e160 0x7f8f441550d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 >> 172.21.15.31:0/3641079253 conn(0x7f8f44067e00 msgr2=0x7f8f4415ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 shutdown_connections 2024-09-15T22:53:04.468 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.463+0000 7f8f49c00640 1 -- 172.21.15.31:0/3641079253 wait complete. 2024-09-15T22:53:04.486 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2024-09-15T22:53:03.594208+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":171,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":227504,"kb_used_data":7104,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747216,"statfs":{"total":773094113280,"available":772861149184,"internally_reserved":0,"allocated":7274496,"data_stored":3955029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7179,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-79,"num_read_kb":-83,"num_write":-72,"num_write_kb":-30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-15,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.633648"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":248,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T22:53:00.414912+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:53:00.414912+0000","last_peered":"2024-09-15T22:53:00.414912+0000","last_clean":"2024-09-15T22:53:00.414912+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:53:00.414912+0000","last_undegraded":"2024-09-15T22:53:00.414912+0000","last_fullsized":"2024-09-15T22:53:00.414912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542182,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28344,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343496,"statfs":{"total":96636764160,"available":96607739904,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542181,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":736,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":753664,"data_stored":344500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542181,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542182,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542183,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":344507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542181,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32504,"kb_used_data":1316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339336,"statfs":{"total":96636764160,"available":96603480064,"internally_reserved":0,"allocated":1347584,"data_stored":934868,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:53:04.486 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-15T22:53:04.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 Processor -- start 2024-09-15T22:53:04.627 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 -- start start 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5300700c0 0x7ff5300cc940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530070630 con 0x7ff53009aa40 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff530070910 con 0x7ff5300d0ba0 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52f200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff530070bf0 con 0x7ff5300700c0 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52de00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ff53009aa40 0x7ff53009ae20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:54526/0 (socket says 172.21.15.31:54526) 2024-09-15T22:53:04.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.623+0000 7ff52de00640 1 -- 172.21.15.31:0/2396957042 learned_addr learned my addr 172.21.15.31:0/2396957042 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5300700c0 0x7ff5300cc940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418670529 0 0) 0x7ff530070630 con 0x7ff53009aa40 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff514003530 con 0x7ff53009aa40 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 156988234 0 0) 0x7ff514003530 con 0x7ff53009aa40 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5300700c0 msgr2=0x7ff5300cc940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5300700c0 0x7ff5300cc940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 >> v1:172.21.15.102:6789/0 conn(0x7ff5300d0ba0 legacy=0x7ff5300716d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff530070ed0 con 0x7ff53009aa40 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7ff520001680 con 0x7ff53009aa40 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 >> v1:172.21.15.31:6789/0 conn(0x7ff53009aa40 legacy=0x7ff53009ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5140039f0 0x7ff514003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff514004350 0x7ff514004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff51400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff530070bf0 con 0x7ff514005030 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff51400bf10 con 0x7ff514004350 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff51400c0c0 con 0x7ff5140039f0 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5300700c0 0x7ff5300cc940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52de00640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5140039f0 0x7ff514003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff51400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff525400640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff514004350 0x7ff514004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 -- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5140039f0 msgr2=0x7ff514003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff5140039f0 0x7ff514003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 -- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff514004350 msgr2=0x7ff514004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff514004350 0x7ff514004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.627+0000 7ff52e800640 1 -- 172.21.15.31:0/2396957042 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff514003530 con 0x7ff514005030 2024-09-15T22:53:04.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52e800640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff51400b9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff5300704a0 tx=0x7ff52801cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77c4a435bee0dcb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528009d40 con 0x7ff514005030 2024-09-15T22:53:04.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5280a5d70 con 0x7ff514005030 2024-09-15T22:53:04.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52d400640 1 -- 172.21.15.31:0/2396957042 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff528003bc0 con 0x7ff514005030 2024-09-15T22:53:04.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- 172.21.15.31:0/2396957042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 msgr2=0x7ff51400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 --2- 172.21.15.31:0/2396957042 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff51400b9d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff5300704a0 tx=0x7ff52801cd20 comp rx=0 tx=0).stop 2024-09-15T22:53:04.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52e800640 1 -- 172.21.15.31:0/2396957042 reap_dead start 2024-09-15T22:53:04.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- 172.21.15.31:0/2396957042 shutdown_connections 2024-09-15T22:53:04.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- 172.21.15.31:0/2396957042 >> 172.21.15.31:0/2396957042 conn(0x7ff5300b3ca0 msgr2=0x7ff5300b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:04.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- 172.21.15.31:0/2396957042 shutdown_connections 2024-09-15T22:53:04.634 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- 172.21.15.31:0/2396957042 wait complete. 2024-09-15T22:53:04.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 Processor -- start 2024-09-15T22:53:04.635 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- start start 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff53006e920 0x7ff53015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff53015ef40 0x7ff53006cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ff530071f60 con 0x7ff514005030 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ff530071de0 con 0x7ff53015ef40 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.631+0000 7ff52f200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ff53015c530 con 0x7ff53006e920 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42768/0 (socket says 172.21.15.31:42768) 2024-09-15T22:53:04.637 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 -- 172.21.15.31:0/1066984015 learned_addr learned my addr 172.21.15.31:0/1066984015 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff525400640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff53006e920 0x7ff53015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52e800640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff53015ef40 0x7ff53006cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 -- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff53006e920 msgr2=0x7ff53015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff53006e920 0x7ff53015ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 -- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff53015ef40 msgr2=0x7ff53006cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff53015ef40 0x7ff53006cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 -- 172.21.15.31:0/1066984015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5300b65f0 con 0x7ff514005030 2024-09-15T22:53:04.638 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52de00640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff5200072c0 tx=0x7ff520007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff520001660 con 0x7ff514005030 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff520018070 con 0x7ff514005030 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52000fbe0 con 0x7ff514005030 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5300b5550 con 0x7ff514005030 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5300b5b10 con 0x7ff514005030 2024-09-15T22:53:04.639 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff530070590 con 0x7ff514005030 2024-09-15T22:53:04.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.635+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ff52001d460 con 0x7ff514005030 2024-09-15T22:53:04.640 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.639+0000 7ff526a00640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 0x7ff50c069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:04.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.639+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7ff520085ba0 con 0x7ff514005030 2024-09-15T22:53:04.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.639+0000 7ff525400640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 0x7ff50c069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:04.641 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.639+0000 7ff525400640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 0x7ff50c069db0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff53015f5c0 tx=0x7ff518009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:04.645 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.643+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ff520056110 con 0x7ff514005030 2024-09-15T22:53:04.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff5300b5290 con 0x7ff514005030 2024-09-15T22:53:04.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff526a00640 1 -- 172.21.15.31:0/1066984015 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) ==== 74+0+13397 (secure 0 0 0) 0x7ff52005a410 con 0x7ff514005030 2024-09-15T22:53:04.814 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:04.814 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":64,"fsid":"e1487968-efb4-47ad-8070-6e7082115957","created":"2024-09-15T22:49:52.511630+0000","modified":"2024-09-15T22:52:59.971878+0000","last_up_change":"2024-09-15T22:50:05.541640+0000","last_in_change":"2024-09-15T22:49:55.045078+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-15T22:50:05.613279+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e983633f-f8df-4b53-a4d5-b53a21b0e27e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6801","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6803","nonce":1549484768}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6805","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6807","nonce":1549484768}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6812","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6814","nonce":1549484768}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6809","nonce":1549484768},{"type":"v1","addr":"172.21.15.31:6811","nonce":1549484768}]},"public_addr":"172.21.15.31:6803/1549484768","cluster_addr":"172.21.15.31:6807/1549484768","heartbeat_back_addr":"172.21.15.31:6814/1549484768","heartbeat_front_addr":"172.21.15.31:6811/1549484768","state":["exists","up"]},{"osd":1,"uuid":"d541b283-b44d-41a6-b4a9-4cca6906e954","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6824","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6825","nonce":844776262}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6826","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6827","nonce":844776262}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6830","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6831","nonce":844776262}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6828","nonce":844776262},{"type":"v1","addr":"172.21.15.31:6829","nonce":844776262}]},"public_addr":"172.21.15.31:6825/844776262","cluster_addr":"172.21.15.31:6827/844776262","heartbeat_back_addr":"172.21.15.31:6831/844776262","heartbeat_front_addr":"172.21.15.31:6829/844776262","state":["exists","up"]},{"osd":2,"uuid":"46507bc7-a82a-4e01-977d-6c3c08f30949","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6802","nonce":2940701196}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6806","nonce":2940701196}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6813","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6815","nonce":2940701196}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6808","nonce":2940701196},{"type":"v1","addr":"172.21.15.31:6810","nonce":2940701196}]},"public_addr":"172.21.15.31:6802/2940701196","cluster_addr":"172.21.15.31:6806/2940701196","heartbeat_back_addr":"172.21.15.31:6815/2940701196","heartbeat_front_addr":"172.21.15.31:6810/2940701196","state":["exists","up"]},{"osd":3,"uuid":"762dec9c-4049-45ab-94ae-ad29fdc88c0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6816","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6817","nonce":2974285706}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6818","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6819","nonce":2974285706}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6822","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6823","nonce":2974285706}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6820","nonce":2974285706},{"type":"v1","addr":"172.21.15.31:6821","nonce":2974285706}]},"public_addr":"172.21.15.31:6817/2974285706","cluster_addr":"172.21.15.31:6819/2974285706","heartbeat_back_addr":"172.21.15.31:6823/2974285706","heartbeat_front_addr":"172.21.15.31:6821/2974285706","state":["exists","up"]},{"osd":4,"uuid":"edbda74d-1465-4bbc-9630-e7d9828d4bb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6801","nonce":3006746036}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6803","nonce":3006746036}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6807","nonce":3006746036}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3006746036},{"type":"v1","addr":"172.21.15.102:6805","nonce":3006746036}]},"public_addr":"172.21.15.102:6801/3006746036","cluster_addr":"172.21.15.102:6803/3006746036","heartbeat_back_addr":"172.21.15.102:6807/3006746036","heartbeat_front_addr":"172.21.15.102:6805/3006746036","state":["exists","up"]},{"osd":5,"uuid":"9999e18f-1532-4383-bad2-b81c6fb5d480","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6825","nonce":4486619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6826","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6827","nonce":4486619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6830","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6831","nonce":4486619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6828","nonce":4486619},{"type":"v1","addr":"172.21.15.102:6829","nonce":4486619}]},"public_addr":"172.21.15.102:6825/4486619","cluster_addr":"172.21.15.102:6827/4486619","heartbeat_back_addr":"172.21.15.102:6831/4486619","heartbeat_front_addr":"172.21.15.102:6829/4486619","state":["exists","up"]},{"osd":6,"uuid":"f9096bba-6933-4732-bf4d-acce049c90f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6809","nonce":1303586807}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6811","nonce":1303586807}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6815","nonce":1303586807}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":1303586807},{"type":"v1","addr":"172.21.15.102:6813","nonce":1303586807}]},"public_addr":"172.21.15.102:6809/1303586807","cluster_addr":"172.21.15.102:6811/1303586807","heartbeat_back_addr":"172.21.15.102:6815/1303586807","heartbeat_front_addr":"172.21.15.102:6813/1303586807","state":["exists","up"]},{"osd":7,"uuid":"8fdb18df-b9ef-4577-803b-1292f61dd25f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":55,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6817","nonce":944524781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6819","nonce":944524781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6823","nonce":944524781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":944524781},{"type":"v1","addr":"172.21.15.102:6821","nonce":944524781}]},"public_addr":"172.21.15.102:6817/944524781","cluster_addr":"172.21.15.102:6819/944524781","heartbeat_back_addr":"172.21.15.102:6823/944524781","heartbeat_front_addr":"172.21.15.102:6821/944524781","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.267091+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.030292+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.011329+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.202146+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:01.842609+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.688020+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.017740+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-15T22:50:02.526023+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.31:6833/2507393641":"2024-09-16T22:52:56.957250+0000","172.21.15.31:6835/2507393641":"2024-09-16T22:52:56.957250+0000","172.21.15.31:6835/678504006":"2024-09-16T22:52:35.837128+0000","172.21.15.31:6834/678504006":"2024-09-16T22:52:35.837128+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 msgr2=0x7ff50c069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 0x7ff50c069db0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff53015f5c0 tx=0x7ff518009040 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 msgr2=0x7ff53015b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.811+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff5200072c0 tx=0x7ff520007780 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 shutdown_connections 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ff50c0678f0 0x7ff50c069db0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ff53015ef40 0x7ff53006cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ff53006e920 0x7ff53015ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 --2- 172.21.15.31:0/1066984015 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ff514005030 0x7ff53015b660 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 >> 172.21.15.31:0/1066984015 conn(0x7ff5300b3ca0 msgr2=0x7ff5300ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:04.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 shutdown_connections 2024-09-15T22:53:04.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:04.815+0000 7ff52f200640 1 -- 172.21.15.31:0/1066984015 wait complete. 2024-09-15T22:53:05.836 INFO:tasks.ceph:Scrubbing osd.0 2024-09-15T22:53:05.837 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.991+0000 7f9d39a00640 1 Processor -- start 2024-09-15T22:53:05.996 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.991+0000 7f9d39a00640 1 -- start start 2024-09-15T22:53:05.997 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d39a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d340b3aa0 0x7f9d340ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d39a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340cd010 0x7f9d3406de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d39a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d34072600 con 0x7f9d3415abd0 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d39a00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9d340b3050 con 0x7f9d340b3aa0 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d39a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9d340b3610 con 0x7f9d340cd010 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9d340b3aa0 0x7f9d340ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32a00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9d3415abd0 0x7f9d34071ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34548/0 (socket says 172.21.15.31:34548) 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32a00640 1 -- 172.21.15.31:0/3395253776 learned_addr learned my addr 172.21.15.31:0/3395253776 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d33400640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340cd010 0x7f9d3406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32000640 1 -- 172.21.15.31:0/3395253776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340cd010 msgr2=0x7f9d3406de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32000640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340cd010 0x7f9d3406de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32000640 1 -- 172.21.15.31:0/3395253776 >> v1:172.21.15.31:6789/0 conn(0x7f9d3415abd0 legacy=0x7f9d34071ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d32000640 1 -- 172.21.15.31:0/3395253776 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d34073a50 con 0x7f9d340b3aa0 2024-09-15T22:53:05.998 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.995+0000 7f9d31600640 1 -- 172.21.15.31:0/3395253776 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2163546224 0 0) 0x7f9d34072600 con 0x7f9d3415abd0 2024-09-15T22:53:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d32000640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340b3aa0 0x7f9d340ccad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097c0 tx=0x7f9d2001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53af2d9dd4fc661c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d31600640 1 -- 172.21.15.31:0/3395253776 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200b0070 con 0x7f9d340b3aa0 2024-09-15T22:53:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d31600640 1 -- 172.21.15.31:0/3395253776 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d200ab600 con 0x7f9d340b3aa0 2024-09-15T22:53:06.001 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d31600640 1 -- 172.21.15.31:0/3395253776 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200ab9d0 con 0x7f9d340b3aa0 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- 172.21.15.31:0/3395253776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340b3aa0 msgr2=0x7f9d340ccad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340b3aa0 0x7f9d340ccad0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f9d200097c0 tx=0x7f9d2001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- 172.21.15.31:0/3395253776 shutdown_connections 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340cd010 0x7f9d3406de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 --2- 172.21.15.31:0/3395253776 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340b3aa0 0x7f9d340ccad0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- 172.21.15.31:0/3395253776 >> 172.21.15.31:0/3395253776 conn(0x7f9d3406be90 msgr2=0x7f9d3406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- 172.21.15.31:0/3395253776 shutdown_connections 2024-09-15T22:53:06.002 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- 172.21.15.31:0/3395253776 wait complete. 2024-09-15T22:53:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 Processor -- start 2024-09-15T22:53:06.003 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 -- start start 2024-09-15T22:53:06.005 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340b3aa0 0x7f9d3415db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:05.999+0000 7f9d39a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 0x7f9d341504a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d3415abd0 0x7f9d3406f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9d340b4db0 con 0x7f9d340cd010 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9d340b3ee0 con 0x7f9d3415abd0 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9d340b4f30 con 0x7f9d340b3aa0 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 0x7f9d341504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 0x7f9d341504a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37472/0 (socket says 172.21.15.31:37472) 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 -- 172.21.15.31:0/2322647900 learned_addr learned my addr 172.21.15.31:0/2322647900 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340b3aa0 0x7f9d3415db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.006 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d33400640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d3415abd0 0x7f9d3406f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 -- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340b3aa0 msgr2=0x7f9d3415db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9d340b3aa0 0x7f9d3415db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 -- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d3415abd0 msgr2=0x7f9d3406f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9d3415abd0 0x7f9d3406f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d3415cb20 con 0x7f9d340cd010 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d32000640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 0x7f9d341504a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ae040 tx=0x7f9d2001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200b0040 con 0x7f9d340cd010 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d20004020 con 0x7f9d340cd010 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d341509e0 con 0x7f9d340cd010 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d200043f0 con 0x7f9d340cd010 2024-09-15T22:53:06.007 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d3415d080 con 0x7f9d340cd010 2024-09-15T22:53:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d340ccad0 con 0x7f9d340cd010 2024-09-15T22:53:06.008 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.003+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9d200bf060 con 0x7f9d340cd010 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9d140678f0 0x7f9d14069db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f9d2011f560 con 0x7f9d340cd010 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7f9d1406de30 0x7f9d14070270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d14070940 con 0x7f9d1406de30 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f9d20126050 con 0x7f9d340cd010 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d32a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9d140678f0 0x7f9d14069db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.009 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d33400640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7f9d1406de30 0x7f9d14070270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d33400640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7f9d1406de30 0x7f9d14070270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d32a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9d140678f0 0x7f9d14069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d24000f70 tx=0x7f9d24007df0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.010 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.007+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== osd.0 v2:172.21.15.31:6801/1549484768 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d14070940 con 0x7f9d1406de30 2024-09-15T22:53:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.019+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 --> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9d3415d920 con 0x7f9d1406de30 2024-09-15T22:53:06.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.019+0000 7f9d2aa00640 1 -- 172.21.15.31:0/2322647900 <== osd.0 v2:172.21.15.31:6801/1549484768 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9d3415d920 con 0x7f9d1406de30 2024-09-15T22:53:06.024 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:06.024 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7f9d1406de30 msgr2=0x7f9d14070270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:6801/1549484768,v1:172.21.15.31:6803/1549484768] conn(0x7f9d1406de30 0x7f9d14070270 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9d140678f0 msgr2=0x7f9d14069db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9d140678f0 0x7f9d14069db0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f9d24000f70 tx=0x7f9d24007df0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 msgr2=0x7f9d341504a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 --2- 172.21.15.31:0/2322647900 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9d340cd010 0x7f9d341504a0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9d200ae040 tx=0x7f9d2001ace0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d33400640 1 -- 172.21.15.31:0/2322647900 reap_dead start 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 shutdown_connections 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 >> 172.21.15.31:0/2322647900 conn(0x7f9d3406be90 msgr2=0x7f9d341511f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 shutdown_connections 2024-09-15T22:53:06.026 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.023+0000 7f9d39a00640 1 -- 172.21.15.31:0/2322647900 wait complete. 2024-09-15T22:53:06.043 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-15T22:53:06.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 Processor -- start 2024-09-15T22:53:06.185 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 -- start start 2024-09-15T22:53:06.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 0x7f0de806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0de80afb10 0x7f0de80725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0de8147730 con 0x7f0de8072160 2024-09-15T22:53:06.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f0de806ec30 con 0x7f0de80afb10 2024-09-15T22:53:06.186 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0df0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0de8072ae0 con 0x7f0de8147350 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0dee000640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f0de80afb10 0x7f0de80725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0decc00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f0de8072160 0x7f0de80af400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34556/0 (socket says 172.21.15.31:34556) 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0decc00640 1 -- 172.21.15.31:0/3960233006 learned_addr learned my addr 172.21.15.31:0/3960233006 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0ded600640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 0x7f0de806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0dee000640 1 -- 172.21.15.31:0/3960233006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 msgr2=0x7f0de806f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:06.187 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0dee000640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 0x7f0de806f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0dee000640 1 -- 172.21.15.31:0/3960233006 >> v1:172.21.15.31:6789/0 conn(0x7f0de8072160 legacy=0x7f0de80af400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0dee000640 1 -- 172.21.15.31:0/3960233006 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de806e300 con 0x7f0de80afb10 2024-09-15T22:53:06.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0de7e00640 1 -- 172.21.15.31:0/3960233006 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032045374 0 0) 0x7f0de8147730 con 0x7f0de8072160 2024-09-15T22:53:06.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.183+0000 7f0ded600640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 0x7f0de806f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:06.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0dee000640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de80afb10 0x7f0de80725a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0de806edb0 tx=0x7f0de001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9090e07f6cc48330 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0de7e00640 1 -- 172.21.15.31:0/3960233006 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00b2070 con 0x7f0de80afb10 2024-09-15T22:53:06.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0de7e00640 1 -- 172.21.15.31:0/3960233006 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de00a5810 con 0x7f0de80afb10 2024-09-15T22:53:06.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0de7e00640 1 -- 172.21.15.31:0/3960233006 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00a5be0 con 0x7f0de80afb10 2024-09-15T22:53:06.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 -- 172.21.15.31:0/3960233006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de80afb10 msgr2=0x7f0de80725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de80afb10 0x7f0de80725a0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f0de806edb0 tx=0x7f0de001c950 comp rx=0 tx=0).stop 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 -- 172.21.15.31:0/3960233006 shutdown_connections 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de80afb10 0x7f0de80725a0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 --2- 172.21.15.31:0/3960233006 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8147350 0x7f0de806f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 -- 172.21.15.31:0/3960233006 >> 172.21.15.31:0/3960233006 conn(0x7f0de8067e00 msgr2=0x7f0de806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 -- 172.21.15.31:0/3960233006 shutdown_connections 2024-09-15T22:53:06.192 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.187+0000 7f0df0000640 1 -- 172.21.15.31:0/3960233006 wait complete. 2024-09-15T22:53:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 Processor -- start 2024-09-15T22:53:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- start start 2024-09-15T22:53:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 0x7f0de8161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0de80afb10 0x7f0de8141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.195 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f0de80b3e70 con 0x7f0de8147350 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f0de80b3cf0 con 0x7f0de80afb10 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f0de816af90 con 0x7f0de8072160 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37496/0 (socket says 172.21.15.31:37496) 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 -- 172.21.15.31:0/379670176 learned_addr learned my addr 172.21.15.31:0/379670176 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0decc00640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0de80afb10 0x7f0de8141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0ded600640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 0x7f0de8161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 -- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 msgr2=0x7f0de8161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 0x7f0de8161c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 -- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0de80afb10 msgr2=0x7f0de8141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0de80afb10 0x7f0de8141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.196 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 -- 172.21.15.31:0/379670176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de8140c80 con 0x7f0de8147350 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0ded600640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 0x7f0de8161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0dee000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009d90 tx=0x7f0de00196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00b2050 con 0x7f0de8147350 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de00b3040 con 0x7f0de8147350 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de00ad850 con 0x7f0de8147350 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0de8140f60 con 0x7f0de8147350 2024-09-15T22:53:06.197 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0de813c4e0 con 0x7f0de8147350 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.191+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0de813c300 con 0x7f0de8147350 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.195+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f0de00c0020 con 0x7f0de8147350 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.195+0000 7f0de5600640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 0x7f0dc8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.195+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f0de0120500 con 0x7f0de8147350 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.195+0000 7f0ded600640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 0x7f0dc8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.198 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.195+0000 7f0ded600640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 0x7f0dc8069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009970 tx=0x7f0ddc008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.201 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.199+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f0de813c300 con 0x7f0de8147350 2024-09-15T22:53:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.363+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0de813c720 con 0x7f0dc80678c0 2024-09-15T22:53:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0de5600640 1 -- 172.21.15.31:0/379670176 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0ddc010870 con 0x7f0dc80678c0 2024-09-15T22:53:06.368 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 0 to deep-scrub 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 msgr2=0x7f0dc8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 0x7f0dc8069d80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc009970 tx=0x7f0ddc008040 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 msgr2=0x7f0de8160020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f0de0009d90 tx=0x7f0de00196f0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 shutdown_connections 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f0dc80678c0 0x7f0dc8069d80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f0de8147350 0x7f0de8160020 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f0de80afb10 0x7f0de8141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 --2- 172.21.15.31:0/379670176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f0de8072160 0x7f0de8161c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 >> 172.21.15.31:0/379670176 conn(0x7f0de8067e00 msgr2=0x7f0de815e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 shutdown_connections 2024-09-15T22:53:06.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.367+0000 7f0df0000640 1 -- 172.21.15.31:0/379670176 wait complete. 2024-09-15T22:53:06.389 INFO:tasks.ceph:Scrubbing osd.1 2024-09-15T22:53:06.390 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:06.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 Processor -- start 2024-09-15T22:53:06.535 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 -- start start 2024-09-15T22:53:06.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b480b3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b4806ff20 0x7f2b4815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2b4815d1f0 0x7f2b480cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f2b48156d20 con 0x7f2b4806ff20 2024-09-15T22:53:06.536 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2b480b40c0 con 0x7f2b4815d1f0 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b4e600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2b480b43a0 con 0x7f2b4815c8d0 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.531+0000 7f2b3ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b4806ff20 0x7f2b4815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f2b4806ff20 0x7f2b4815ccb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37502/0 (socket says 172.21.15.31:37502) 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 -- 172.21.15.31:0/3086175179 learned_addr learned my addr 172.21.15.31:0/3086175179 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b47400640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b480b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b47e00640 1 --2- 172.21.15.31:0/3086175179 >> v2:172.21.15.102:3300/0 conn(0x7f2b4815d1f0 0x7f2b480cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 -- 172.21.15.31:0/3086175179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 msgr2=0x7f2b480b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b480b3840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 -- 172.21.15.31:0/3086175179 >> v2:172.21.15.102:3300/0 conn(0x7f2b4815d1f0 msgr2=0x7f2b480cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/3086175179 >> v2:172.21.15.102:3300/0 conn(0x7f2b4815d1f0 0x7f2b480cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.538 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 -- 172.21.15.31:0/3086175179 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b480b4680 con 0x7f2b4806ff20 2024-09-15T22:53:06.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4806ff20 0x7f2b4815ccb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b480ce190 tx=0x7f2b3001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cedf79ea2825d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b46a00640 1 -- 172.21.15.31:0/3086175179 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b300aa610 con 0x7f2b4806ff20 2024-09-15T22:53:06.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b46a00640 1 -- 172.21.15.31:0/3086175179 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b300af070 con 0x7f2b4806ff20 2024-09-15T22:53:06.540 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.535+0000 7f2b46a00640 1 -- 172.21.15.31:0/3086175179 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b300aa9d0 con 0x7f2b4806ff20 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- 172.21.15.31:0/3086175179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4806ff20 msgr2=0x7f2b4815ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4806ff20 0x7f2b4815ccb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f2b480ce190 tx=0x7f2b3001c4f0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- 172.21.15.31:0/3086175179 shutdown_connections 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- 172.21.15.31:0/3086175179 >> v2:172.21.15.102:3300/0 conn(0x7f2b4815d1f0 0x7f2b480cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4806ff20 0x7f2b4815ccb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- 172.21.15.31:0/3086175179 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b480b3840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- 172.21.15.31:0/3086175179 >> 172.21.15.31:0/3086175179 conn(0x7f2b4806be90 msgr2=0x7f2b4806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- 172.21.15.31:0/3086175179 shutdown_connections 2024-09-15T22:53:06.541 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- 172.21.15.31:0/3086175179 wait complete. 2024-09-15T22:53:06.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 Processor -- start 2024-09-15T22:53:06.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- start start 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b4806ff20 0x7f2b4814d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b4809cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 0x7f2b480ad7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2b480cfd50 con 0x7f2b4815d1f0 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2b4815d600 con 0x7f2b4806ff20 2024-09-15T22:53:06.544 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b4e600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2b480cfed0 con 0x7f2b4815c8d0 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 0x7f2b480ad7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 0x7f2b480ad7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37514/0 (socket says 172.21.15.31:37514) 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 -- 172.21.15.31:0/406673471 learned_addr learned my addr 172.21.15.31:0/406673471 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47400640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b4806ff20 0x7f2b4814d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b4809cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 -- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 msgr2=0x7f2b4809cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b4809cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 -- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b4806ff20 msgr2=0x7f2b4814d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b4806ff20 0x7f2b4814d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47e00640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4809d3b0 con 0x7f2b4815d1f0 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2b4815c8d0 0x7f2b4809cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.539+0000 7f2b47400640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2b4806ff20 0x7f2b4814d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:06.545 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b47e00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 0x7f2b480ad7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009d30 tx=0x7f2b4000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40018020 con 0x7f2b4815d1f0 2024-09-15T22:53:06.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b40014480 con 0x7f2b4815d1f0 2024-09-15T22:53:06.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40014870 con 0x7f2b4815d1f0 2024-09-15T22:53:06.546 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4809d690 con 0x7f2b4815d1f0 2024-09-15T22:53:06.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b4809dc50 con 0x7f2b4815d1f0 2024-09-15T22:53:06.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b480d0290 con 0x7f2b4815d1f0 2024-09-15T22:53:06.547 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2b4001b020 con 0x7f2b4815d1f0 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2b240678c0 0x7f2b24069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f2b400865b0 con 0x7f2b4815d1f0 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7f2b2406de00 0x7f2b24070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b40017e70 con 0x7f2b2406de00 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f2b4008d050 con 0x7f2b4815d1f0 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b47400640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2b240678c0 0x7f2b24069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.548 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.543+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7f2b2406de00 0x7f2b24070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.547+0000 7f2b3ea00640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7f2b2406de00 0x7f2b24070240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.547+0000 7f2b47400640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2b240678c0 0x7f2b24069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009bb0 tx=0x7f2b38008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.549 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.547+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== osd.1 v2:172.21.15.31:6824/844776262 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b40017e70 con 0x7f2b2406de00 2024-09-15T22:53:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 --> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2b4815f6f0 con 0x7f2b2406de00 2024-09-15T22:53:06.562 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b3fe00640 1 -- 172.21.15.31:0/406673471 <== osd.1 v2:172.21.15.31:6824/844776262 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2b4815f6f0 con 0x7f2b2406de00 2024-09-15T22:53:06.563 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:06.563 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7f2b2406de00 msgr2=0x7f2b24070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:6824/844776262,v1:172.21.15.31:6825/844776262] conn(0x7f2b2406de00 0x7f2b24070240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2b240678c0 msgr2=0x7f2b24069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2b240678c0 0x7f2b24069d80 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f2b38009bb0 tx=0x7f2b38008040 comp rx=0 tx=0).stop 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 msgr2=0x7f2b480ad7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 --2- 172.21.15.31:0/406673471 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2b4815d1f0 0x7f2b480ad7f0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f2b40009d30 tx=0x7f2b4000c490 comp rx=0 tx=0).stop 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b47e00640 1 -- 172.21.15.31:0/406673471 reap_dead start 2024-09-15T22:53:06.564 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 shutdown_connections 2024-09-15T22:53:06.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 >> 172.21.15.31:0/406673471 conn(0x7f2b4806be90 msgr2=0x7f2b4806edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 shutdown_connections 2024-09-15T22:53:06.565 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.559+0000 7f2b4e600640 1 -- 172.21.15.31:0/406673471 wait complete. 2024-09-15T22:53:06.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-15T22:53:06.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.719+0000 7f20a2600640 1 Processor -- start 2024-09-15T22:53:06.724 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.719+0000 7f20a2600640 1 -- start start 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f20a2600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f20a2600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f209c0b04e0 0x7f209c0add60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f20a2600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f209c0af440 con 0x7f209c15f5a0 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f20a2600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f209c0b0050 con 0x7f209c0b04e0 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f20a2600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f209c0af720 con 0x7f209c15c080 2024-09-15T22:53:06.725 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f2092a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f209c0b04e0 0x7f209c0add60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f209be00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f209c15f5a0 0x7f209c161fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34558/0 (socket says 172.21.15.31:34558) 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f209be00640 1 -- 172.21.15.31:0/1624455704 learned_addr learned my addr 172.21.15.31:0/1624455704 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f209b400640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f2092a00640 1 -- 172.21.15.31:0/1624455704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 msgr2=0x7f209c070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f2092a00640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f2092a00640 1 -- 172.21.15.31:0/1624455704 >> v1:172.21.15.31:6789/0 conn(0x7f209c15f5a0 legacy=0x7f209c161fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.726 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f2092a00640 1 -- 172.21.15.31:0/1624455704 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c0afa00 con 0x7f209c0b04e0 2024-09-15T22:53:06.727 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.723+0000 7f209b400640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:06.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f2092a00640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c0b04e0 0x7f209c0add60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20840097c0 tx=0x7f208401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d4e2fe13b35a95 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f209aa00640 1 -- 172.21.15.31:0/1624455704 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840b0070 con 0x7f209c0b04e0 2024-09-15T22:53:06.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f209aa00640 1 -- 172.21.15.31:0/1624455704 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20840ab600 con 0x7f209c0b04e0 2024-09-15T22:53:06.729 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f209aa00640 1 -- 172.21.15.31:0/1624455704 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20840ab9d0 con 0x7f209c0b04e0 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- 172.21.15.31:0/1624455704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c0b04e0 msgr2=0x7f209c0add60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c0b04e0 0x7f209c0add60 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f20840097c0 tx=0x7f208401c4a0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- 172.21.15.31:0/1624455704 shutdown_connections 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c0b04e0 0x7f209c0add60 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 --2- 172.21.15.31:0/1624455704 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- 172.21.15.31:0/1624455704 >> 172.21.15.31:0/1624455704 conn(0x7f209c06bcc0 msgr2=0x7f209c06c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- 172.21.15.31:0/1624455704 shutdown_connections 2024-09-15T22:53:06.730 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- 172.21.15.31:0/1624455704 wait complete. 2024-09-15T22:53:06.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 Processor -- start 2024-09-15T22:53:06.731 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.727+0000 7f20a2600640 1 -- start start 2024-09-15T22:53:06.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f209c0b04e0 0x7f209c0cfdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.733 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f209c16b4b0 con 0x7f209c15f5a0 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f209c16b330 con 0x7f209c0b04e0 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f209c16b630 con 0x7f209c15c080 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37530/0 (socket says 172.21.15.31:37530) 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 -- 172.21.15.31:0/2124183085 learned_addr learned my addr 172.21.15.31:0/2124183085 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209b400640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f209c0b04e0 0x7f209c0cfdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f2092a00640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 -- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 msgr2=0x7f209c152f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c152f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.734 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 -- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f209c0b04e0 msgr2=0x7f209c0cfdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f209c0b04e0 0x7f209c0cfdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 -- 172.21.15.31:0/2124183085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1491a0 con 0x7f209c15f5a0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f209be00640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f209400ca80 tx=0x7f209400cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094017070 con 0x7f209c15f5a0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f209400ac30 con 0x7f209c15f5a0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094012400 con 0x7f209c15f5a0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c149480 con 0x7f209c15f5a0 2024-09-15T22:53:06.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c148e70 con 0x7f209c15f5a0 2024-09-15T22:53:06.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c0add60 con 0x7f209c15f5a0 2024-09-15T22:53:06.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.731+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f209401a070 con 0x7f209c15f5a0 2024-09-15T22:53:06.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.735+0000 7f2093e00640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 0x7f2078069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:06.736 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.735+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f20940858a0 con 0x7f209c15f5a0 2024-09-15T22:53:06.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.735+0000 7f209b400640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 0x7f2078069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:06.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.735+0000 7f209b400640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 0x7f2078069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f208c009950 tx=0x7f208c008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:06.740 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.739+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2094055d80 con 0x7f209c15f5a0 2024-09-15T22:53:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f209c152660 con 0x7f20780678c0 2024-09-15T22:53:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f2093e00640 1 -- 172.21.15.31:0/2124183085 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f209c152660 con 0x7f20780678c0 2024-09-15T22:53:06.913 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 1 to deep-scrub 2024-09-15T22:53:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 msgr2=0x7f2078069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 0x7f2078069d80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f208c009950 tx=0x7f208c008040 comp rx=0 tx=0).stop 2024-09-15T22:53:06.915 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 msgr2=0x7f209c136430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f209400ca80 tx=0x7f209400cf40 comp rx=0 tx=0).stop 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 shutdown_connections 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f20780678c0 0x7f2078069d80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f209c15f5a0 0x7f209c136430 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f209c15c080 0x7f209c152f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 --2- 172.21.15.31:0/2124183085 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f209c0b04e0 0x7f209c0cfdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 >> 172.21.15.31:0/2124183085 conn(0x7f209c06bcc0 msgr2=0x7f209c06c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 shutdown_connections 2024-09-15T22:53:06.916 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:06.911+0000 7f20a2600640 1 -- 172.21.15.31:0/2124183085 wait complete. 2024-09-15T22:53:06.935 INFO:tasks.ceph:Scrubbing osd.2 2024-09-15T22:53:06.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:07.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.075+0000 7f604f400640 1 Processor -- start 2024-09-15T22:53:07.080 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.075+0000 7f604f400640 1 -- start start 2024-09-15T22:53:07.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604f400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f6048166e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604f400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6048156d20 con 0x7f604815c8d0 2024-09-15T22:53:07.081 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604f400640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60480b40c0 con 0x7f60480d0010 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604f400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f60480b43a0 con 0x7f604806ff20 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604ca00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f604815c8d0 0x7f60480b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34564/0 (socket says 172.21.15.31:34564) 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604ca00640 1 -- 172.21.15.31:0/754853248 learned_addr learned my addr 172.21.15.31:0/754853248 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604d400640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f6048166e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2739310360 0 0) 0x7f6048156d20 con 0x7f604815c8d0 2024-09-15T22:53:07.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f602c003530 con 0x7f604815c8d0 2024-09-15T22:53:07.083 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2994665134 0 0) 0x7f602c003530 con 0x7f604815c8d0 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 msgr2=0x7f6048166e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f6048166e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 >> v1:172.21.15.102:6789/0 conn(0x7f60480d0010 legacy=0x7f604815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60480b4680 con 0x7f604815c8d0 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f60380016a0 con 0x7f604815c8d0 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 >> v1:172.21.15.31:6789/0 conn(0x7f604815c8d0 legacy=0x7f60480b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f602c0039f0 0x7f602c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f602c004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f602c0050d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f60480b43a0 con 0x7f602c0043a0 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f602c00ba00 con 0x7f602c0039f0 2024-09-15T22:53:07.084 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f602c00bc00 con 0x7f604806ff20 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f602c004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604ca00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f602c0039f0 0x7f602c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604d400640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f602c0050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 -- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 msgr2=0x7f602c0050d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f602c0050d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 -- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f602c0039f0 msgr2=0x7f602c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f602c0039f0 0x7f602c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f603fe00640 1 -- 172.21.15.31:0/754853248 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f602c003530 con 0x7f602c0043a0 2024-09-15T22:53:07.085 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.079+0000 7f604d400640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604806ff20 0x7f602c0050d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f603fe00640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f602c004870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6030001910 tx=0x7f603001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399e0a93071905e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60300b5070 con 0x7f602c0043a0 2024-09-15T22:53:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60300a8910 con 0x7f602c0043a0 2024-09-15T22:53:07.086 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f6047e00640 1 -- 172.21.15.31:0/754853248 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6030001510 con 0x7f602c0043a0 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 -- 172.21.15.31:0/754853248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 msgr2=0x7f602c004870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 --2- 172.21.15.31:0/754853248 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f602c004870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6030001910 tx=0x7f603001ecd0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604d400640 1 -- 172.21.15.31:0/754853248 reap_dead start 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 -- 172.21.15.31:0/754853248 shutdown_connections 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 -- 172.21.15.31:0/754853248 >> 172.21.15.31:0/754853248 conn(0x7f604806be90 msgr2=0x7f604806c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 -- 172.21.15.31:0/754853248 shutdown_connections 2024-09-15T22:53:07.087 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.083+0000 7f604f400640 1 -- 172.21.15.31:0/754853248 wait complete. 2024-09-15T22:53:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 Processor -- start 2024-09-15T22:53:07.088 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- start start 2024-09-15T22:53:07.089 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f6048150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60481506c0 0x7f604809d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604809dc30 0x7f60481f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f604815d3c0 con 0x7f602c0043a0 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f60480b4c40 con 0x7f60481506c0 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f604815d540 con 0x7f604809dc30 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f6048150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f6048150180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37558/0 (socket says 172.21.15.31:37558) 2024-09-15T22:53:07.090 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 -- 172.21.15.31:0/2333311446 learned_addr learned my addr 172.21.15.31:0/2333311446 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:07.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 -- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604809dc30 msgr2=0x7f60481f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f604809dc30 0x7f60481f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 -- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60481506c0 msgr2=0x7f604809d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.091 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f60481506c0 0x7f604809d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f604809a1b0 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604ca00640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f6048150180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6038004ee0 tx=0x7f6038007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603800f700 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6038018070 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f604809a490 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f603800fae0 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f604809aa50 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.087+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f604815ccb0 con 0x7f602c0043a0 2024-09-15T22:53:07.092 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f603800fc80 con 0x7f602c0043a0 2024-09-15T22:53:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f60240678c0 0x7f6024069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f6038085a90 con 0x7f602c0043a0 2024-09-15T22:53:07.093 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7f602406de00 0x7f6024070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f603fe00640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f60240678c0 0x7f6024069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6024070910 con 0x7f602406de00 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f603808a2a0 con 0x7f602c0043a0 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f604d400640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7f602406de00 0x7f6024070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f604d400640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7f602406de00 0x7f6024070240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.094 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f603fe00640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f60240678c0 0x7f6024069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60300b2000 tx=0x7f60300012c0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.095 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.091+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== osd.2 v2:172.21.15.31:6800/2940701196 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6024070910 con 0x7f602406de00 2024-09-15T22:53:07.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 --> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f60481540c0 con 0x7f602406de00 2024-09-15T22:53:07.108 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f6045600640 1 -- 172.21.15.31:0/2333311446 <== osd.2 v2:172.21.15.31:6800/2940701196 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f60481540c0 con 0x7f602406de00 2024-09-15T22:53:07.109 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:07.109 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:07.109 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7f602406de00 msgr2=0x7f6024070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:6800/2940701196,v1:172.21.15.31:6802/2940701196] conn(0x7f602406de00 0x7f6024070240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f60240678c0 msgr2=0x7f6024069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f60240678c0 0x7f6024069d80 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f60300b2000 tx=0x7f60300012c0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 msgr2=0x7f6048150180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 --2- 172.21.15.31:0/2333311446 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f602c0043a0 0x7f6048150180 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6038004ee0 tx=0x7f6038007430 comp rx=0 tx=0).stop 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604d400640 1 -- 172.21.15.31:0/2333311446 reap_dead start 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 shutdown_connections 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 >> 172.21.15.31:0/2333311446 conn(0x7f604806be90 msgr2=0x7f6048153180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.110 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 shutdown_connections 2024-09-15T22:53:07.111 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.107+0000 7f604f400640 1 -- 172.21.15.31:0/2333311446 wait complete. 2024-09-15T22:53:07.128 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-15T22:53:07.269 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 Processor -- start 2024-09-15T22:53:07.270 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 -- start start 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 0x7f099c0d00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c0d0920 con 0x7f099c0b6e60 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f099c0d0c00 con 0x7f099c0d0fa0 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099b200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f099c0b6660 con 0x7f099c070b40 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099a800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f099c0b6e60 0x7f099c15c480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34580/0 (socket says 172.21.15.31:34580) 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f099a800640 1 -- 172.21.15.31:0/3792652305 learned_addr learned my addr 172.21.15.31:0/3792652305 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:07.271 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0991400640 1 --2- 172.21.15.31:0/3792652305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 0x7f099c0d00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 290773153 0 0) 0x7f099c0d0920 con 0x7f099c0b6e60 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0980003530 con 0x7f099c0b6e60 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2914966536 0 0) 0x7f099c0d0c00 con 0x7f099c0d0fa0 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0991400640 1 -- 172.21.15.31:0/3792652305 >> v1:172.21.15.102:6789/0 conn(0x7f099c0d0fa0 legacy=0x7f099c0d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0991400640 1 -- 172.21.15.31:0/3792652305 >> v1:172.21.15.31:6789/0 conn(0x7f099c0b6e60 legacy=0x7f099c15c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.272 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.267+0000 7f0991400640 1 -- 172.21.15.31:0/3792652305 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c0b6940 con 0x7f099c070b40 2024-09-15T22:53:07.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f0991400640 1 --2- 172.21.15.31:0/3792652305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 0x7f099c0d00f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09840097f0 tx=0x7f098401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93dbfa05ce89baf2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09840b0070 con 0x7f099c070b40 2024-09-15T22:53:07.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09840ab600 con 0x7f099c070b40 2024-09-15T22:53:07.275 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f0999400640 1 -- 172.21.15.31:0/3792652305 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09840ab9d0 con 0x7f099c070b40 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 -- 172.21.15.31:0/3792652305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 msgr2=0x7f099c0d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 --2- 172.21.15.31:0/3792652305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 0x7f099c0d00f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09840097f0 tx=0x7f098401c4e0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 -- 172.21.15.31:0/3792652305 shutdown_connections 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 --2- 172.21.15.31:0/3792652305 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c070b40 0x7f099c0d00f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 -- 172.21.15.31:0/3792652305 >> 172.21.15.31:0/3792652305 conn(0x7f099c0b3f20 msgr2=0x7f099c0b4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 -- 172.21.15.31:0/3792652305 shutdown_connections 2024-09-15T22:53:07.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.271+0000 7f099b200640 1 -- 172.21.15.31:0/3792652305 wait complete. 2024-09-15T22:53:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 Processor -- start 2024-09-15T22:53:07.277 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- start start 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 0x7f099c151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c0d0fa0 0x7f099c14e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f099c16a210 con 0x7f099c070b40 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f099c16a090 con 0x7f099c0b6e60 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f099c16a390 con 0x7f099c0d0fa0 2024-09-15T22:53:07.279 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37562/0 (socket says 172.21.15.31:37562) 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 -- 172.21.15.31:0/2728109905 learned_addr learned my addr 172.21.15.31:0/2728109905 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0991400640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 0x7f099c151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099a800640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c0d0fa0 0x7f099c14e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 -- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c0d0fa0 msgr2=0x7f099c14e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c0d0fa0 0x7f099c14e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 -- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 msgr2=0x7f099c151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 0x7f099c151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 -- 172.21.15.31:0/2728109905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099c152610 con 0x7f099c070b40 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0991400640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 0x7f099c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:07.280 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0999e00640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c440 tx=0x7f098c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c005480 con 0x7f099c070b40 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f098c003600 con 0x7f099c070b40 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c0039f0 con 0x7f099c070b40 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099c1528f0 con 0x7f099c070b40 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.275+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f099c06d250 con 0x7f099c070b40 2024-09-15T22:53:07.281 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c0d0920 con 0x7f099c070b40 2024-09-15T22:53:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f098c003b90 con 0x7f099c070b40 2024-09-15T22:53:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f0992a00640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 0x7f0978069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.282 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f098c085810 con 0x7f099c070b40 2024-09-15T22:53:07.283 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f0991400640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 0x7f0978069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.284 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.279+0000 7f0991400640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 0x7f0978069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09840ad000 tx=0x7f09840a6000 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.287 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.283+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f098c055d80 con 0x7f099c070b40 2024-09-15T22:53:07.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.447+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f099c152ac0 con 0x7f09780678c0 2024-09-15T22:53:07.452 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f0992a00640 1 -- 172.21.15.31:0/2728109905 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f099c152ac0 con 0x7f09780678c0 2024-09-15T22:53:07.453 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 2 to deep-scrub 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 msgr2=0x7f0978069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 0x7f0978069d80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f09840ad000 tx=0x7f09840a6000 comp rx=0 tx=0).stop 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 msgr2=0x7f099c15e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f098c00c440 tx=0x7f098c00c900 comp rx=0 tx=0).stop 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 shutdown_connections 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f09780678c0 0x7f0978069d80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.455 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f099c0d0fa0 0x7f099c14e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f099c0b6e60 0x7f099c151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 --2- 172.21.15.31:0/2728109905 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f099c070b40 0x7f099c15e120 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 >> 172.21.15.31:0/2728109905 conn(0x7f099c0b3f20 msgr2=0x7f099c14f850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 shutdown_connections 2024-09-15T22:53:07.456 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.451+0000 7f099b200640 1 -- 172.21.15.31:0/2728109905 wait complete. 2024-09-15T22:53:07.473 INFO:tasks.ceph:Scrubbing osd.3 2024-09-15T22:53:07.474 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 Processor -- start 2024-09-15T22:53:07.618 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 -- start start 2024-09-15T22:53:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f6eb015abd0 0x7f6eb00b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb006de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb0073a50 con 0x7f6eb0071ef0 2024-09-15T22:53:07.619 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb00b3fe0 con 0x7f6eb015abd0 2024-09-15T22:53:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eb5400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb00b3050 con 0x7f6eb00cd1e0 2024-09-15T22:53:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6ea5e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f6eb0071ef0 0x7f6eb00ccad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34596/0 (socket says 172.21.15.31:34596) 2024-09-15T22:53:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6ea5e00640 1 -- 172.21.15.31:0/3082300621 learned_addr learned my addr 172.21.15.31:0/3082300621 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:07.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eae800640 1 --2- 172.21.15.31:0/3082300621 >> v2:172.21.15.102:3300/0 conn(0x7f6eb015abd0 0x7f6eb00b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.615+0000 7f6eaf200640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb006de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eade00640 1 -- 172.21.15.31:0/3082300621 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3969705592 0 0) 0x7f6eb0073a50 con 0x7f6eb0071ef0 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eade00640 1 -- 172.21.15.31:0/3082300621 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e94003530 con 0x7f6eb0071ef0 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eae800640 1 -- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 msgr2=0x7f6eb006de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eae800640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb006de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eae800640 1 -- 172.21.15.31:0/3082300621 >> v1:172.21.15.31:6789/0 conn(0x7f6eb0071ef0 legacy=0x7f6eb00ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eae800640 1 -- 172.21.15.31:0/3082300621 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0073cf0 con 0x7f6eb015abd0 2024-09-15T22:53:07.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eae800640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb00b3aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097c0 tx=0x7f6ea001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b12108d61b14d2bd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.623 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eade00640 1 -- 172.21.15.31:0/3082300621 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00b0070 con 0x7f6eb015abd0 2024-09-15T22:53:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eade00640 1 -- 172.21.15.31:0/3082300621 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea00ab600 con 0x7f6eb015abd0 2024-09-15T22:53:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.619+0000 7f6eade00640 1 -- 172.21.15.31:0/3082300621 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00ab9d0 con 0x7f6eb015abd0 2024-09-15T22:53:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 msgr2=0x7f6eb00b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.624 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb00b3aa0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f6ea00097c0 tx=0x7f6ea001c4a0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- 172.21.15.31:0/3082300621 shutdown_connections 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb006de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- 172.21.15.31:0/3082300621 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb00b3aa0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- 172.21.15.31:0/3082300621 >> 172.21.15.31:0/3082300621 conn(0x7f6eb006be90 msgr2=0x7f6eb006c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- 172.21.15.31:0/3082300621 shutdown_connections 2024-09-15T22:53:07.625 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- 172.21.15.31:0/3082300621 wait complete. 2024-09-15T22:53:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 Processor -- start 2024-09-15T22:53:07.626 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- start start 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 0x7f6eb00af030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb0150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb0154e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb006e3b0 con 0x7f6eb0071ef0 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb00b4fc0 con 0x7f6eb015abd0 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eb5400640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb006e530 con 0x7f6eb00cd1e0 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 0x7f6eb00af030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 0x7f6eb00af030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37566/0 (socket says 172.21.15.31:37566) 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 -- 172.21.15.31:0/4001930303 learned_addr learned my addr 172.21.15.31:0/4001930303 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6ea5e00640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb0150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.628 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eaf200640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb0154e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 -- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 msgr2=0x7f6eb0150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f6eb00cd1e0 0x7f6eb0150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 -- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 msgr2=0x7f6eb0154e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb0154e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0150640 con 0x7f6eb0071ef0 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eaf200640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f6eb015abd0 0x7f6eb0154e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:07.629 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.623+0000 7f6eae800640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 0x7f6eb00af030 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ea001a0d0 tx=0x7f6ea001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea00b0050 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea00bc070 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0006e20 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb0156ae0 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb01570a0 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6eb00addd0 con 0x7f6eb0071ef0 2024-09-15T22:53:07.630 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f6ea00b5830 con 0x7f6eb0071ef0 2024-09-15T22:53:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6e8c0678c0 0x7f6e8c069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f6ea0120270 con 0x7f6eb0071ef0 2024-09-15T22:53:07.631 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f6e8c06de00 0x7f6e8c070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6ea00ab600 con 0x7f6e8c06de00 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f6ea0127050 con 0x7f6eb0071ef0 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6ea5e00640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6e8c0678c0 0x7f6e8c069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.627+0000 7f6eaf200640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f6e8c06de00 0x7f6e8c070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.631+0000 7f6eaf200640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f6e8c06de00 0x7f6e8c070240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.632 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.631+0000 7f6ea5e00640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6e8c0678c0 0x7f6e8c069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0154480 tx=0x7f6e98009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.633 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.631+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== osd.3 v2:172.21.15.31:6816/2974285706 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6ea00ab600 con 0x7f6e8c06de00 2024-09-15T22:53:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 --> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f6eb006e910 con 0x7f6e8c06de00 2024-09-15T22:53:07.646 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6ea7400640 1 -- 172.21.15.31:0/4001930303 <== osd.3 v2:172.21.15.31:6816/2974285706 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f6eb006e910 con 0x7f6e8c06de00 2024-09-15T22:53:07.647 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:07.647 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:07.647 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f6e8c06de00 msgr2=0x7f6e8c070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:6816/2974285706,v1:172.21.15.31:6817/2974285706] conn(0x7f6e8c06de00 0x7f6e8c070240 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6e8c0678c0 msgr2=0x7f6e8c069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f6e8c0678c0 0x7f6e8c069d80 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0154480 tx=0x7f6e98009040 comp rx=0 tx=0).stop 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 msgr2=0x7f6eb00af030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 --2- 172.21.15.31:0/4001930303 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f6eb0071ef0 0x7f6eb00af030 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ea001a0d0 tx=0x7f6ea001ace0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eaf200640 1 -- 172.21.15.31:0/4001930303 reap_dead start 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 shutdown_connections 2024-09-15T22:53:07.648 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 >> 172.21.15.31:0/4001930303 conn(0x7f6eb006be90 msgr2=0x7f6eb0168350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 shutdown_connections 2024-09-15T22:53:07.649 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.643+0000 7f6eb5400640 1 -- 172.21.15.31:0/4001930303 wait complete. 2024-09-15T22:53:07.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-15T22:53:07.808 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 Processor -- start 2024-09-15T22:53:07.809 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 -- start start 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc190166d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1901407b0 con 0x7fc190072160 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc190140a90 con 0x7fc19013fa40 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc197a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc19013f640 con 0x7fc19006f170 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195000640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fc190072160 0x7fc190072540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34606/0 (socket says 172.21.15.31:34606) 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195000640 1 -- 172.21.15.31:0/2821190955 learned_addr learned my addr 172.21.15.31:0/2821190955 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:07.810 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195a00640 1 --2- 172.21.15.31:0/2821190955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc190166d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545021617 0 0) 0x7fc1901407b0 con 0x7fc190072160 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc174003530 con 0x7fc190072160 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 <== mon.1 v1:172.21.15.102:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 199042991 0 0) 0x7fc190140a90 con 0x7fc19013fa40 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 --> v1:172.21.15.102:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1901407b0 con 0x7fc19013fa40 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195a00640 1 -- 172.21.15.31:0/2821190955 >> v1:172.21.15.102:6789/0 conn(0x7fc19013fa40 legacy=0x7fc19013fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195a00640 1 -- 172.21.15.31:0/2821190955 >> v1:172.21.15.31:6789/0 conn(0x7fc190072160 legacy=0x7fc190072540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.811 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.807+0000 7fc195a00640 1 -- 172.21.15.31:0/2821190955 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc190140d70 con 0x7fc19006f170 2024-09-15T22:53:07.813 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc195a00640 1 --2- 172.21.15.31:0/2821190955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc190166d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097f0 tx=0x7fc18801c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44c01469a9f9301d server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880b0070 con 0x7fc19006f170 2024-09-15T22:53:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1880ab600 con 0x7fc19006f170 2024-09-15T22:53:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc18f400640 1 -- 172.21.15.31:0/2821190955 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880ab9d0 con 0x7fc19006f170 2024-09-15T22:53:07.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- 172.21.15.31:0/2821190955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 msgr2=0x7fc190166d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 --2- 172.21.15.31:0/2821190955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc190166d50 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097f0 tx=0x7fc18801c450 comp rx=0 tx=0).stop 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- 172.21.15.31:0/2821190955 shutdown_connections 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 --2- 172.21.15.31:0/2821190955 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc190166d50 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- 172.21.15.31:0/2821190955 >> 172.21.15.31:0/2821190955 conn(0x7fc190067e00 msgr2=0x7fc19006bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- 172.21.15.31:0/2821190955 shutdown_connections 2024-09-15T22:53:07.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- 172.21.15.31:0/2821190955 wait complete. 2024-09-15T22:53:07.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 Processor -- start 2024-09-15T22:53:07.816 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.811+0000 7fc197a00640 1 -- start start 2024-09-15T22:53:07.817 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc1900a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 0x7fc190144280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc190169cc0 con 0x7fc19013fa40 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc1901413c0 con 0x7fc190072160 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc190169e40 con 0x7fc19006f170 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37582/0 (socket says 172.21.15.31:37582) 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 -- 172.21.15.31:0/2608827449 learned_addr learned my addr 172.21.15.31:0/2608827449 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc18fe00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 0x7fc190144280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195000640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc1900a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 -- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 msgr2=0x7fc1900a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.818 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc1900a94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 -- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 msgr2=0x7fc190144280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 0x7fc190144280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 -- 172.21.15.31:0/2608827449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1900a99e0 con 0x7fc19013fa40 2024-09-15T22:53:07.819 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc18fe00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 0x7fc190144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc195a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ae040 tx=0x7fc18801ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880b0050 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc1880bc070 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1880b5810 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc19015e210 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc19015e7d0 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.815+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc190072540 con 0x7fc19013fa40 2024-09-15T22:53:07.820 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.819+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc1880b59b0 con 0x7fc19013fa40 2024-09-15T22:53:07.821 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.819+0000 7fc18cc00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 0x7fc170069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:07.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.819+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fc188120380 con 0x7fc19013fa40 2024-09-15T22:53:07.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.819+0000 7fc195000640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 0x7fc170069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:07.822 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.819+0000 7fc195000640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 0x7fc170069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc1800012f0 tx=0x7fc180009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:07.826 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.823+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc1880160d0 con 0x7fc19013fa40 2024-09-15T22:53:07.991 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.987+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc19006f840 con 0x7fc1700678c0 2024-09-15T22:53:07.992 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.987+0000 7fc18cc00640 1 -- 172.21.15.31:0/2608827449 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc19006f840 con 0x7fc1700678c0 2024-09-15T22:53:07.992 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 3 to deep-scrub 2024-09-15T22:53:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 msgr2=0x7fc170069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 0x7fc170069d80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fc1800012f0 tx=0x7fc180009040 comp rx=0 tx=0).stop 2024-09-15T22:53:07.994 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 msgr2=0x7fc1900b0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ae040 tx=0x7fc18801ac90 comp rx=0 tx=0).stop 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 shutdown_connections 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc1700678c0 0x7fc170069d80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc19013fa40 0x7fc1900b0bc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc190072160 0x7fc190144280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 --2- 172.21.15.31:0/2608827449 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc19006f170 0x7fc1900a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 >> 172.21.15.31:0/2608827449 conn(0x7fc190067e00 msgr2=0x7fc19015d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 shutdown_connections 2024-09-15T22:53:07.995 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:07.991+0000 7fc197a00640 1 -- 172.21.15.31:0/2608827449 wait complete. 2024-09-15T22:53:08.015 INFO:tasks.ceph:Scrubbing osd.4 2024-09-15T22:53:08.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.155+0000 7f5db9000640 1 Processor -- start 2024-09-15T22:53:08.160 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.155+0000 7f5db9000640 1 -- start start 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db9000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db40d0010 0x7f5db415ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db9000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f5db406ff20 0x7f5db415d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db9000640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db4156d20 con 0x7f5db415c8d0 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db9000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f5db415d730 con 0x7f5db406ff20 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db9000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5db40b40c0 con 0x7f5db40d0010 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db1e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f5db415c8d0 0x7f5db40b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34612/0 (socket says 172.21.15.31:34612) 2024-09-15T22:53:08.161 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db1e00640 1 -- 172.21.15.31:0/801662971 learned_addr learned my addr 172.21.15.31:0/801662971 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 --2- 172.21.15.31:0/801662971 >> v2:172.21.15.102:3300/0 conn(0x7f5db406ff20 0x7f5db415d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db1400640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db40d0010 0x7f5db415ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252554048 0 0) 0x7f5db4156d20 con 0x7f5db415c8d0 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d98003530 con 0x7f5db415c8d0 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2620993656 0 0) 0x7f5d98003530 con 0x7f5db415c8d0 2024-09-15T22:53:08.163 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db40d0010 msgr2=0x7f5db415ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db40d0010 0x7f5db415ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 >> v2:172.21.15.102:3300/0 conn(0x7f5db406ff20 msgr2=0x7f5db415d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 --2- 172.21.15.31:0/801662971 >> v2:172.21.15.102:3300/0 conn(0x7f5db406ff20 0x7f5db415d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db40b43a0 con 0x7f5db415c8d0 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f5da40016a0 con 0x7f5db415c8d0 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 >> v1:172.21.15.31:6789/0 conn(0x7f5db415c8d0 legacy=0x7f5db40b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d980039c0 0x7f5d98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d98004810 0x7f5d98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d980051d0 0x7f5d9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5db415d730 con 0x7f5d980051d0 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40b40c0 con 0x7f5d980039c0 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5d9800bf10 con 0x7f5d98004810 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db1400640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d98004810 0x7f5d98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.164 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d980051d0 0x7f5d9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db1e00640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d980039c0 0x7f5d98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 -- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d98004810 msgr2=0x7f5d98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5d98004810 0x7f5d98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 -- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d980039c0 msgr2=0x7f5d98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5d980039c0 0x7f5d98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.165 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.159+0000 7f5db2800640 1 -- 172.21.15.31:0/801662971 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d98003530 con 0x7f5d980051d0 2024-09-15T22:53:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db2800640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d980051d0 0x7f5d9800b9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e170 tx=0x7f5dac01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aed66f43c4eeb630 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac0b2070 con 0x7f5d980051d0 2024-09-15T22:53:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dac0a5cb0 con 0x7f5d980051d0 2024-09-15T22:53:08.166 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db0a00640 1 -- 172.21.15.31:0/801662971 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dac009c10 con 0x7f5d980051d0 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 -- 172.21.15.31:0/801662971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d980051d0 msgr2=0x7f5d9800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 --2- 172.21.15.31:0/801662971 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5d980051d0 0x7f5d9800b9d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5dac00e170 tx=0x7f5dac01cca0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db2800640 1 -- 172.21.15.31:0/801662971 reap_dead start 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 -- 172.21.15.31:0/801662971 shutdown_connections 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 -- 172.21.15.31:0/801662971 >> 172.21.15.31:0/801662971 conn(0x7f5db406be90 msgr2=0x7f5db406c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 -- 172.21.15.31:0/801662971 shutdown_connections 2024-09-15T22:53:08.167 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 -- 172.21.15.31:0/801662971 wait complete. 2024-09-15T22:53:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.163+0000 7f5db9000640 1 Processor -- start 2024-09-15T22:53:08.168 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- start start 2024-09-15T22:53:08.169 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db41f1480 0x7f5db41f1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 0x7f5db409a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5db409a6f0 0x7f5db414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40b4c40 con 0x7f5db40b1e60 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5db40b4960 con 0x7f5db409a6f0 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5db415ccb0 con 0x7f5db41f1480 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 0x7f5db409a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 0x7f5db409a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37592/0 (socket says 172.21.15.31:37592) 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 -- 172.21.15.31:0/2062981553 learned_addr learned my addr 172.21.15.31:0/2062981553 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db2800640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5db409a6f0 0x7f5db414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1e00640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db41f1480 0x7f5db41f1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 -- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db41f1480 msgr2=0x7f5db41f1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5db41f1480 0x7f5db41f1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.170 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 -- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5db409a6f0 msgr2=0x7f5db414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5db409a6f0 0x7f5db414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.171 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db414d850 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db1400640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 0x7f5db409a1b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5da0011920 tx=0x7f5da0011de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da0019070 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5da0004240 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5da000f8e0 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5db414db30 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5db40b1660 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.167+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5db415d070 con 0x7f5db40b1e60 2024-09-15T22:53:08.172 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5da001c070 con 0x7f5db40b1e60 2024-09-15T22:53:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5d940678c0 0x7f5d94069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.173 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f5da00861a0 con 0x7f5db40b1e60 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f5d9406de00 0x7f5d94070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5da0003e50 con 0x7f5d9406de00 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f5da008d050 con 0x7f5db40b1e60 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5db1e00640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5d940678c0 0x7f5d94069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5db2800640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f5d9406de00 0x7f5d94070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.174 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5db1e00640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5d940678c0 0x7f5d94069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5da4004850 tx=0x7f5da4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5db2800640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f5d9406de00 0x7f5d94070240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.175 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.171+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== osd.4 v2:172.21.15.102:6800/3006746036 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5da0003e50 con 0x7f5d9406de00 2024-09-15T22:53:08.188 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 --> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5db4153d30 con 0x7f5d9406de00 2024-09-15T22:53:08.189 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5daa000640 1 -- 172.21.15.31:0/2062981553 <== osd.4 v2:172.21.15.102:6800/3006746036 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5db4153d30 con 0x7f5d9406de00 2024-09-15T22:53:08.189 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:08.189 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:08.189 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f5d9406de00 msgr2=0x7f5d94070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6800/3006746036,v1:172.21.15.102:6801/3006746036] conn(0x7f5d9406de00 0x7f5d94070240 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5d940678c0 msgr2=0x7f5d94069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5d940678c0 0x7f5d94069d80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5da4004850 tx=0x7f5da4009040 comp rx=0 tx=0).stop 2024-09-15T22:53:08.190 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 msgr2=0x7f5db409a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 --2- 172.21.15.31:0/2062981553 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5db40b1e60 0x7f5db409a1b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5da0011920 tx=0x7f5da0011de0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db2800640 1 -- 172.21.15.31:0/2062981553 reap_dead start 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 shutdown_connections 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 >> 172.21.15.31:0/2062981553 conn(0x7f5db406be90 msgr2=0x7f5db4155a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 shutdown_connections 2024-09-15T22:53:08.191 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.187+0000 7f5db9000640 1 -- 172.21.15.31:0/2062981553 wait complete. 2024-09-15T22:53:08.208 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-15T22:53:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 Processor -- start 2024-09-15T22:53:08.350 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 -- start start 2024-09-15T22:53:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f2c180b1890 0x7f2c1815f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 0x7f2c1809aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.351 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c180b1c70 con 0x7f2c1806d280 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f2c181603f0 con 0x7f2c180b1890 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c1e600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c1809af80 con 0x7f2c1815ffb0 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c17e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f2c1806d280 0x7f2c1815e020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34628/0 (socket says 172.21.15.31:34628) 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c17e00640 1 -- 172.21.15.31:0/3959398176 learned_addr learned my addr 172.21.15.31:0/3959398176 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c0ea00640 1 --2- 172.21.15.31:0/3959398176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 0x7f2c1809aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.352 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c17400640 1 --2- 172.21.15.31:0/3959398176 >> v2:172.21.15.102:3300/0 conn(0x7f2c180b1890 0x7f2c1815f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.347+0000 7f2c16a00640 1 -- 172.21.15.31:0/3959398176 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2646309460 0 0) 0x7f2c100014a0 con 0x7f2c1806d280 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c16a00640 1 -- 172.21.15.31:0/3959398176 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2bfc003530 con 0x7f2c1806d280 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c0ea00640 1 -- 172.21.15.31:0/3959398176 >> v2:172.21.15.102:3300/0 conn(0x7f2c180b1890 msgr2=0x7f2c1815f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c0ea00640 1 --2- 172.21.15.31:0/3959398176 >> v2:172.21.15.102:3300/0 conn(0x7f2c180b1890 0x7f2c1815f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c0ea00640 1 -- 172.21.15.31:0/3959398176 >> v1:172.21.15.31:6789/0 conn(0x7f2c1806d280 legacy=0x7f2c1815e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.353 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c0ea00640 1 -- 172.21.15.31:0/3959398176 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1809b1e0 con 0x7f2c1815ffb0 2024-09-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c0ea00640 1 --2- 172.21.15.31:0/3959398176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 0x7f2c1809aa40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c000097c0 tx=0x7f2c0001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e38f238e8695ee3f server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.355 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c16a00640 1 -- 172.21.15.31:0/3959398176 <== mon.2 v2:172.21.15.102:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000b2070 con 0x7f2c1815ffb0 2024-09-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c16a00640 1 -- 172.21.15.31:0/3959398176 <== mon.2 v2:172.21.15.102:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c000ad680 con 0x7f2c1815ffb0 2024-09-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c16a00640 1 -- 172.21.15.31:0/3959398176 <== mon.2 v2:172.21.15.102:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c000ada50 con 0x7f2c1815ffb0 2024-09-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 -- 172.21.15.31:0/3959398176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 msgr2=0x7f2c1809aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.356 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 --2- 172.21.15.31:0/3959398176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 0x7f2c1809aa40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c000097c0 tx=0x7f2c0001c470 comp rx=0 tx=0).stop 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 -- 172.21.15.31:0/3959398176 shutdown_connections 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 --2- 172.21.15.31:0/3959398176 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c1815ffb0 0x7f2c1809aa40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 --2- 172.21.15.31:0/3959398176 >> v2:172.21.15.102:3300/0 conn(0x7f2c180b1890 0x7f2c1815f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 -- 172.21.15.31:0/3959398176 >> 172.21.15.31:0/3959398176 conn(0x7f2c180d23b0 msgr2=0x7f2c180d27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.351+0000 7f2c1e600640 1 -- 172.21.15.31:0/3959398176 shutdown_connections 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- 172.21.15.31:0/3959398176 wait complete. 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 Processor -- start 2024-09-15T22:53:08.357 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- start start 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c1806d280 0x7f2c18156430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c180b1890 0x7f2c180713e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1806daa0 con 0x7f2c1815ffb0 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f2c180d0670 con 0x7f2c1806d280 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f2c18070340 con 0x7f2c180b1890 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37608/0 (socket says 172.21.15.31:37608) 2024-09-15T22:53:08.360 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 -- 172.21.15.31:0/302423782 learned_addr learned my addr 172.21.15.31:0/302423782 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c0ea00640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c180b1890 0x7f2c180713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17400640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c1806d280 0x7f2c18156430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 -- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c180b1890 msgr2=0x7f2c180713e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c180b1890 0x7f2c180713e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 -- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c1806d280 msgr2=0x7f2c18156430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c1806d280 0x7f2c18156430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 -- 172.21.15.31:0/302423782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c18070620 con 0x7f2c1815ffb0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c17e00640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000cb10 tx=0x7f2c1000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10017070 con 0x7f2c1815ffb0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c1000ac10 con 0x7f2c1815ffb0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c10012400 con 0x7f2c1815ffb0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.355+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c18070900 con 0x7f2c1815ffb0 2024-09-15T22:53:08.361 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c18070ec0 con 0x7f2c1815ffb0 2024-09-15T22:53:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1815f810 con 0x7f2c1815ffb0 2024-09-15T22:53:08.362 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f2c1001a070 con 0x7f2c1815ffb0 2024-09-15T22:53:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c0fe00640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f2c100858c0 con 0x7f2c1815ffb0 2024-09-15T22:53:08.363 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c17400640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.364 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.359+0000 7f2c17400640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 0x7f2bf4069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009ac0 tx=0x7f2c08009190 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.363+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f2c180b1c70 con 0x7f2c1815ffb0 2024-09-15T22:53:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.535+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f2c180d2120 con 0x7f2bf40678c0 2024-09-15T22:53:08.539 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.535+0000 7f2c0fe00640 1 -- 172.21.15.31:0/302423782 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2c180d2120 con 0x7f2bf40678c0 2024-09-15T22:53:08.540 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 4 to deep-scrub 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 msgr2=0x7f2bf4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 0x7f2bf4069d80 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2c08009ac0 tx=0x7f2c08009190 comp rx=0 tx=0).stop 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 msgr2=0x7f2c181fb1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2c1000cb10 tx=0x7f2c1000a060 comp rx=0 tx=0).stop 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 shutdown_connections 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f2bf40678c0 0x7f2bf4069d80 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.542 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f2c1815ffb0 0x7f2c181fb1a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f2c180b1890 0x7f2c180713e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 --2- 172.21.15.31:0/302423782 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f2c1806d280 0x7f2c18156430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 >> 172.21.15.31:0/302423782 conn(0x7f2c180d23b0 msgr2=0x7f2c180b22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 shutdown_connections 2024-09-15T22:53:08.543 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.539+0000 7f2c1e600640 1 -- 172.21.15.31:0/302423782 wait complete. 2024-09-15T22:53:08.562 INFO:tasks.ceph:Scrubbing osd.5 2024-09-15T22:53:08.562 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 Processor -- start 2024-09-15T22:53:08.707 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 -- start start 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a4067a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f71a415e510 0x7f71a40b50c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71a406e770 con 0x7f71a415e130 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f71a406f060 con 0x7f71a415e510 2024-09-15T22:53:08.708 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a8a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40680c0 con 0x7f71a40aff00 2024-09-15T22:53:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.703+0000 7f71a1e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f71a415e130 0x7f71a40af7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34638/0 (socket says 172.21.15.31:34638) 2024-09-15T22:53:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1e00640 1 -- 172.21.15.31:0/2714214896 learned_addr learned my addr 172.21.15.31:0/2714214896 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 --2- 172.21.15.31:0/2714214896 >> v2:172.21.15.102:3300/0 conn(0x7f71a415e510 0x7f71a40b50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.709 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f7199400640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a4067a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1400640 1 -- 172.21.15.31:0/2714214896 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267070817 0 0) 0x7f71a406e770 con 0x7f71a415e130 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1400640 1 -- 172.21.15.31:0/2714214896 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7188003530 con 0x7f71a415e130 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 -- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 msgr2=0x7f71a4067a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a4067a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 -- 172.21.15.31:0/2714214896 >> v1:172.21.15.31:6789/0 conn(0x7f71a415e130 legacy=0x7f71a40af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 -- 172.21.15.31:0/2714214896 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a406ea10 con 0x7f71a415e510 2024-09-15T22:53:08.710 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f7199400640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a4067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:08.711 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a2800640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a40b50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f719c009dc0 tx=0x7f719c01c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9f2a319899c9182 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1400640 1 -- 172.21.15.31:0/2714214896 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0b2070 con 0x7f71a415e510 2024-09-15T22:53:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1400640 1 -- 172.21.15.31:0/2714214896 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c0a5920 con 0x7f71a415e510 2024-09-15T22:53:08.712 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.707+0000 7f71a1400640 1 -- 172.21.15.31:0/2714214896 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719c0a5cf0 con 0x7f71a415e510 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 msgr2=0x7f71a40b50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a40b50c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f719c009dc0 tx=0x7f719c01c950 comp rx=0 tx=0).stop 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- 172.21.15.31:0/2714214896 shutdown_connections 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a40b50c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- 172.21.15.31:0/2714214896 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a4067a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- 172.21.15.31:0/2714214896 >> 172.21.15.31:0/2714214896 conn(0x7f71a4073640 msgr2=0x7f71a406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- 172.21.15.31:0/2714214896 shutdown_connections 2024-09-15T22:53:08.713 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- 172.21.15.31:0/2714214896 wait complete. 2024-09-15T22:53:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 Processor -- start 2024-09-15T22:53:08.714 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- start start 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a414d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 0x7f71a414c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a415f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f71a4070070 con 0x7f71a415e130 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f71a406fef0 con 0x7f71a415e510 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a8a00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f71a40701f0 con 0x7f71a40aff00 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 0x7f71a414c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 0x7f71a414c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37614/0 (socket says 172.21.15.31:37614) 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 -- 172.21.15.31:0/950444872 learned_addr learned my addr 172.21.15.31:0/950444872 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:08.717 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a1e00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a414d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f71a2800640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a415f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 -- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 msgr2=0x7f71a414d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f71a40aff00 0x7f71a414d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 -- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 msgr2=0x7f71a415f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f71a415e510 0x7f71a415f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.711+0000 7f7199400640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71a415ebf0 con 0x7f71a415e130 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f7199400640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 0x7f71a414c1a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e9d0 tx=0x7f718c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c017070 con 0x7f71a415e130 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f718c00ca60 con 0x7f71a415e130 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718c00ce50 con 0x7f71a415e130 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71a414dc10 con 0x7f71a415e130 2024-09-15T22:53:08.718 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71a415f190 con 0x7f71a415e130 2024-09-15T22:53:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f71a4067a00 con 0x7f71a415e130 2024-09-15T22:53:08.719 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f718c01a070 con 0x7f71a415e130 2024-09-15T22:53:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7180067a60 0x7f7180069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f718c085d20 con 0x7f71a415e130 2024-09-15T22:53:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7f718006dfa0 0x7f71800703e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f718c014e50 con 0x7f718006dfa0 2024-09-15T22:53:08.720 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.715+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f718c0861b0 con 0x7f71a415e130 2024-09-15T22:53:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.719+0000 7f71a1e00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7180067a60 0x7f7180069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.719+0000 7f71a2800640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7f718006dfa0 0x7f71800703e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.719+0000 7f71a1e00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7180067a60 0x7f7180069f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7194007fd0 tx=0x7f7194000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.721 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.719+0000 7f71a2800640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7f718006dfa0 0x7f71800703e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.722 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.719+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== osd.5 v2:172.21.15.102:6824/4486619 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f718c014e50 con 0x7f718006dfa0 2024-09-15T22:53:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.731+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 --> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f71a406d130 con 0x7f718006dfa0 2024-09-15T22:53:08.735 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.731+0000 7f719aa00640 1 -- 172.21.15.31:0/950444872 <== osd.5 v2:172.21.15.102:6824/4486619 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f71a406d130 con 0x7f718006dfa0 2024-09-15T22:53:08.736 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:08.736 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:08.736 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.731+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7f718006dfa0 msgr2=0x7f71800703e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.731+0000 7f71a8a00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6824/4486619,v1:172.21.15.102:6825/4486619] conn(0x7f718006dfa0 0x7f71800703e0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7180067a60 msgr2=0x7f7180069f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f7180067a60 0x7f7180069f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7194007fd0 tx=0x7f7194000bd0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 msgr2=0x7f71a414c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 --2- 172.21.15.31:0/950444872 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f71a415e130 0x7f71a414c1a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f718c00e9d0 tx=0x7f718c00ee90 comp rx=0 tx=0).stop 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a2800640 1 -- 172.21.15.31:0/950444872 reap_dead start 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 shutdown_connections 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 >> 172.21.15.31:0/950444872 conn(0x7f71a4073640 msgr2=0x7f71a40ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 shutdown_connections 2024-09-15T22:53:08.737 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.735+0000 7f71a8a00640 1 -- 172.21.15.31:0/950444872 wait complete. 2024-09-15T22:53:08.755 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-15T22:53:08.896 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 Processor -- start 2024-09-15T22:53:08.897 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 -- start start 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb080726a0 0x7ffb0815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb08072d40 con 0x7ffb0806f270 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7ffb0815ba60 con 0x7ffb080726a0 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb080affa0 con 0x7ffb080b47a0 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7ffb080726a0 0x7ffb0815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.898 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb07e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7ffb0806f270 0x7ffb0806f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34654/0 (socket says 172.21.15.31:34654) 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb07e00640 1 -- 172.21.15.31:0/2948889913 learned_addr learned my addr 172.21.15.31:0/2948889913 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffaff400640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ca00640 1 -- 172.21.15.31:0/2948889913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 msgr2=0x7ffb08072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ca00640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ca00640 1 -- 172.21.15.31:0/2948889913 >> v1:172.21.15.31:6789/0 conn(0x7ffb0806f270 legacy=0x7ffb0806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.899 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb0ca00640 1 -- 172.21.15.31:0/2948889913 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb08073020 con 0x7ffb080726a0 2024-09-15T22:53:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffb07400640 1 -- 172.21.15.31:0/2948889913 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333036676 0 0) 0x7ffb08072d40 con 0x7ffb0806f270 2024-09-15T22:53:08.900 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.895+0000 7ffaff400640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:08.901 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ca00640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb0815c840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009d90 tx=0x7ffb0001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c85b17de88034b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb07400640 1 -- 172.21.15.31:0/2948889913 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb000b2070 con 0x7ffb080726a0 2024-09-15T22:53:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb07400640 1 -- 172.21.15.31:0/2948889913 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb000a5830 con 0x7ffb080726a0 2024-09-15T22:53:08.902 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb07400640 1 -- 172.21.15.31:0/2948889913 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb000a5c00 con 0x7ffb080726a0 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- 172.21.15.31:0/2948889913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 msgr2=0x7ffb0815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb0815c840 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009d90 tx=0x7ffb0001c970 comp rx=0 tx=0).stop 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- 172.21.15.31:0/2948889913 shutdown_connections 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb0815c840 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/2948889913 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08072160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- 172.21.15.31:0/2948889913 >> 172.21.15.31:0/2948889913 conn(0x7ffb08067e00 msgr2=0x7ffb0806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- 172.21.15.31:0/2948889913 shutdown_connections 2024-09-15T22:53:08.903 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- 172.21.15.31:0/2948889913 wait complete. 2024-09-15T22:53:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 Processor -- start 2024-09-15T22:53:08.904 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.899+0000 7ffb0ea00640 1 -- start start 2024-09-15T22:53:08.905 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0806f270 0x7ffb0815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08153110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080b4d00 con 0x7ffb080726a0 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7ffb080b4b80 con 0x7ffb0806f270 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7ffb0815d190 con 0x7ffb080b47a0 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37626/0 (socket says 172.21.15.31:37626) 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 -- 172.21.15.31:0/4152345795 learned_addr learned my addr 172.21.15.31:0/4152345795 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb07e00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0806f270 0x7ffb0815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ca00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08153110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 -- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 msgr2=0x7ffb08153110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08153110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 -- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0806f270 msgr2=0x7ffb0815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:08.906 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0806f270 0x7ffb0815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 -- 172.21.15.31:0/4152345795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb08155cc0 con 0x7ffb080726a0 2024-09-15T22:53:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffaff400640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000ebe0 tx=0x7ffaf000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.907 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0017070 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffaf000cc30 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf0013470 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb08155fa0 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb08158c80 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.903+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb0815c840 con 0x7ffb080726a0 2024-09-15T22:53:08.908 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.907+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7ffaf001a070 con 0x7ffb080726a0 2024-09-15T22:53:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.907+0000 7ffb04c00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 0x7ffae4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.907+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7ffaf0085f00 con 0x7ffb080726a0 2024-09-15T22:53:08.909 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.907+0000 7ffb07e00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 0x7ffae4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:08.910 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.907+0000 7ffb07e00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 0x7ffae4069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8000f70 tx=0x7ffaf8007c10 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:08.913 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:08.911+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7ffaf0056ac0 con 0x7ffb080726a0 2024-09-15T22:53:09.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.075+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7ffb0814eb00 con 0x7ffae40678c0 2024-09-15T22:53:09.079 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.075+0000 7ffb04c00640 1 -- 172.21.15.31:0/4152345795 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffb0814eb00 con 0x7ffae40678c0 2024-09-15T22:53:09.079 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 5 to deep-scrub 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 msgr2=0x7ffae4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 0x7ffae4069d80 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ffaf8000f70 tx=0x7ffaf8007c10 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 msgr2=0x7ffb08158220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7ffaf000ebe0 tx=0x7ffaf000c520 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 shutdown_connections 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7ffae40678c0 0x7ffae4069d80 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7ffb080b47a0 0x7ffb08153110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7ffb080726a0 0x7ffb08158220 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 --2- 172.21.15.31:0/4152345795 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7ffb0806f270 0x7ffb0815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 >> 172.21.15.31:0/4152345795 conn(0x7ffb08067e00 msgr2=0x7ffb0814f300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 shutdown_connections 2024-09-15T22:53:09.082 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.079+0000 7ffb0ea00640 1 -- 172.21.15.31:0/4152345795 wait complete. 2024-09-15T22:53:09.102 INFO:tasks.ceph:Scrubbing osd.6 2024-09-15T22:53:09.102 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 Processor -- start 2024-09-15T22:53:09.246 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 -- start start 2024-09-15T22:53:09.247 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f966c0d0010 0x7f966c15ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966c156d20 con 0x7f966c15c8d0 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f966c15d730 con 0x7f966c0d0010 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9674800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f966c0b40c0 con 0x7f966c06ff20 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9671e00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f966c15c8d0 0x7f966c0b3840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34658/0 (socket says 172.21.15.31:34658) 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9671e00640 1 -- 172.21.15.31:0/377178254 learned_addr learned my addr 172.21.15.31:0/377178254 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:09.248 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9671400640 1 --2- 172.21.15.31:0/377178254 >> v2:172.21.15.31:3300/0 conn(0x7f966c0d0010 0x7f966c15ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.243+0000 7f9672800640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9670a00640 1 -- 172.21.15.31:0/377178254 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509592098 0 0) 0x7f966c156d20 con 0x7f966c15c8d0 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9670a00640 1 -- 172.21.15.31:0/377178254 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9654003530 con 0x7f966c15c8d0 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9671400640 1 -- 172.21.15.31:0/377178254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 msgr2=0x7f966c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9671400640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9671400640 1 -- 172.21.15.31:0/377178254 >> v1:172.21.15.31:6789/0 conn(0x7f966c15c8d0 legacy=0x7f966c0b3840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.249 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9671400640 1 -- 172.21.15.31:0/377178254 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c0b43a0 con 0x7f966c0d0010 2024-09-15T22:53:09.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9671400640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15ccb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f966c15d8b0 tx=0x7f965c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cac21bf3f08da0c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9670a00640 1 -- 172.21.15.31:0/377178254 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0a7070 con 0x7f966c0d0010 2024-09-15T22:53:09.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9670a00640 1 -- 172.21.15.31:0/377178254 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c0b0070 con 0x7f966c0d0010 2024-09-15T22:53:09.251 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9670a00640 1 -- 172.21.15.31:0/377178254 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0ab870 con 0x7f966c0d0010 2024-09-15T22:53:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 -- 172.21.15.31:0/377178254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 msgr2=0x7f966c15ccb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15ccb0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f966c15d8b0 tx=0x7f965c01c470 comp rx=0 tx=0).stop 2024-09-15T22:53:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 -- 172.21.15.31:0/377178254 shutdown_connections 2024-09-15T22:53:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.252 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 --2- 172.21.15.31:0/377178254 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15ccb0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.247+0000 7f9674800640 1 -- 172.21.15.31:0/377178254 >> 172.21.15.31:0/377178254 conn(0x7f966c06be90 msgr2=0x7f966c06c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- 172.21.15.31:0/377178254 shutdown_connections 2024-09-15T22:53:09.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- 172.21.15.31:0/377178254 wait complete. 2024-09-15T22:53:09.253 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 Processor -- start 2024-09-15T22:53:09.254 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- start start 2024-09-15T22:53:09.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c072290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.255 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f966c15c8d0 0x7f966c15b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f966c168820 con 0x7f966c0d0010 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f966c1686a0 con 0x7f966c15c8d0 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f966c1689a0 con 0x7f966c06ff20 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37652/0 (socket says 172.21.15.31:37652) 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 -- 172.21.15.31:0/3494856632 learned_addr learned my addr 172.21.15.31:0/3494856632 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671e00640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c072290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9672800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f966c15c8d0 0x7f966c15b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 -- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 msgr2=0x7f966c072290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f966c06ff20 0x7f966c072290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 -- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f966c15c8d0 msgr2=0x7f966c15b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f966c15c8d0 0x7f966c15b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.256 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c0727d0 con 0x7f966c0d0010 2024-09-15T22:53:09.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9671400640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15b330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f965c01cd10 tx=0x7f965c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0bf610 con 0x7f966c0d0010 2024-09-15T22:53:09.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c0bf7b0 con 0x7f966c0d0010 2024-09-15T22:53:09.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f965c0bfb60 con 0x7f966c0d0010 2024-09-15T22:53:09.257 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.251+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c072a50 con 0x7f966c0d0010 2024-09-15T22:53:09.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c073010 con 0x7f966c0d0010 2024-09-15T22:53:09.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f966c0b3840 con 0x7f966c0d0010 2024-09-15T22:53:09.258 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f965c0bd020 con 0x7f966c0d0010 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96500678c0 0x7f9650069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f965c120330 con 0x7f966c0d0010 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f965006de00 0x7f9650070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9650070910 con 0x7f965006de00 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7f965c127050 con 0x7f966c0d0010 2024-09-15T22:53:09.259 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9671e00640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96500678c0 0x7f9650069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9672800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f965006de00 0x7f9650070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9671e00640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96500678c0 0x7f9650069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f966c14e730 tx=0x7f9660000bd0 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.260 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.255+0000 7f9672800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f965006de00 0x7f9650070240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.261 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.259+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== osd.6 v2:172.21.15.102:6808/1303586807 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9650070910 con 0x7f965006de00 2024-09-15T22:53:09.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 --> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f966c073250 con 0x7f965006de00 2024-09-15T22:53:09.274 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9666000640 1 -- 172.21.15.31:0/3494856632 <== osd.6 v2:172.21.15.102:6808/1303586807 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f966c073250 con 0x7f965006de00 2024-09-15T22:53:09.275 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:09.275 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:09.275 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f965006de00 msgr2=0x7f9650070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6808/1303586807,v1:172.21.15.102:6809/1303586807] conn(0x7f965006de00 0x7f9650070240 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96500678c0 msgr2=0x7f9650069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f96500678c0 0x7f9650069d80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f966c14e730 tx=0x7f9660000bd0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 msgr2=0x7f966c15b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 --2- 172.21.15.31:0/3494856632 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f966c0d0010 0x7f966c15b330 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f965c01cd10 tx=0x7f965c01acb0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9672800640 1 -- 172.21.15.31:0/3494856632 reap_dead start 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 shutdown_connections 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 >> 172.21.15.31:0/3494856632 conn(0x7f966c06be90 msgr2=0x7f966c0ad8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 shutdown_connections 2024-09-15T22:53:09.276 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.271+0000 7f9674800640 1 -- 172.21.15.31:0/3494856632 wait complete. 2024-09-15T22:53:09.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-15T22:53:09.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 Processor -- start 2024-09-15T22:53:09.434 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 -- start start 2024-09-15T22:53:09.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f815e6d0 0x7f30f815f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30f809b150 0x7f30f8161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f80d0c70 con 0x7f30f80d04b0 2024-09-15T22:53:09.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f30f815fcb0 con 0x7f30f809b150 2024-09-15T22:53:09.435 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f30f8160040 con 0x7f30f815e6d0 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30f809b150 0x7f30f8161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f30f809b150 0x7f30f8161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37668/0 (socket says 172.21.15.31:37668) 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 -- 172.21.15.31:0/3539735847 learned_addr learned my addr 172.21.15.31:0/3539735847 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30f7e00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f815e6d0 0x7f30f815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 -- 172.21.15.31:0/3539735847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f815e6d0 msgr2=0x7f30f815f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:09.436 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f815e6d0 0x7f30f815f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 -- 172.21.15.31:0/3539735847 >> v1:172.21.15.102:6789/0 conn(0x7f30f80d04b0 legacy=0x7f30f809aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.437 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.431+0000 7f30fca00640 1 -- 172.21.15.31:0/3539735847 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f80d0f50 con 0x7f30f809b150 2024-09-15T22:53:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fca00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f8161410 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009e50 tx=0x7f30f001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=169c39817a963cc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30f7400640 1 -- 172.21.15.31:0/3539735847 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a58d0 con 0x7f30f809b150 2024-09-15T22:53:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30f7400640 1 -- 172.21.15.31:0/3539735847 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30f00a5a70 con 0x7f30f809b150 2024-09-15T22:53:09.439 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30f7400640 1 -- 172.21.15.31:0/3539735847 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30f00a5e40 con 0x7f30f809b150 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 -- 172.21.15.31:0/3539735847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 msgr2=0x7f30f8161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f8161410 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f30f0009e50 tx=0x7f30f001ca00 comp rx=0 tx=0).stop 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 -- 172.21.15.31:0/3539735847 shutdown_connections 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f8161410 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 --2- 172.21.15.31:0/3539735847 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f815e6d0 0x7f30f815f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 -- 172.21.15.31:0/3539735847 >> 172.21.15.31:0/3539735847 conn(0x7f30f80d23b0 msgr2=0x7f30f80d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 -- 172.21.15.31:0/3539735847 shutdown_connections 2024-09-15T22:53:09.440 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.435+0000 7f30fea00640 1 -- 172.21.15.31:0/3539735847 wait complete. 2024-09-15T22:53:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 Processor -- start 2024-09-15T22:53:09.441 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- start start 2024-09-15T22:53:09.443 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f80d04b0 0x7f30f80af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 0x7f30f80af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80d0890 con 0x7f30f809b150 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f30f80d17f0 con 0x7f30f815e6d0 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f30f80d0a10 con 0x7f30f80d04b0 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37680/0 (socket says 172.21.15.31:37680) 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 -- 172.21.15.31:0/242453624 learned_addr learned my addr 172.21.15.31:0/242453624 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30ef400640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f80d04b0 0x7f30f80af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.444 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fca00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 0x7f30f80af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 -- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f80d04b0 msgr2=0x7f30f80af360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f80d04b0 0x7f30f80af360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 -- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 msgr2=0x7f30f80af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 0x7f30f80af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 -- 172.21.15.31:0/242453624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f8071020 con 0x7f30f809b150 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fca00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 0x7f30f80af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f7e00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d800 tx=0x7f30e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800b6c0 con 0x7f30f809b150 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e8019070 con 0x7f30f809b150 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f8071300 con 0x7f30f809b150 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e800ba60 con 0x7f30f809b150 2024-09-15T22:53:09.445 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.439+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f8071ba0 con 0x7f30f809b150 2024-09-15T22:53:09.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f80716f0 con 0x7f30f809b150 2024-09-15T22:53:09.446 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f30e800bc00 con 0x7f30f809b150 2024-09-15T22:53:09.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30f4c00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 0x7f30d4069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f30e80860e0 con 0x7f30f809b150 2024-09-15T22:53:09.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30ef400640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 0x7f30d4069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.447 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.443+0000 7f30ef400640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 0x7f30d4069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f30f80d3200 tx=0x7f30e0009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.451 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.447+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f30e8056c10 con 0x7f30f809b150 2024-09-15T22:53:09.616 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.611+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f30f8161410 con 0x7f30d40678c0 2024-09-15T22:53:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30f4c00640 1 -- 172.21.15.31:0/242453624 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30f8161410 con 0x7f30d40678c0 2024-09-15T22:53:09.617 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 6 to deep-scrub 2024-09-15T22:53:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 msgr2=0x7f30d4069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 0x7f30d4069d80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f30f80d3200 tx=0x7f30e0009040 comp rx=0 tx=0).stop 2024-09-15T22:53:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 msgr2=0x7f30f815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f30e800d800 tx=0x7f30e800dcc0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.620 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 shutdown_connections 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f30d40678c0 0x7f30d4069d80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f30f815e6d0 0x7f30f80af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f30f80d04b0 0x7f30f80af360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 --2- 172.21.15.31:0/242453624 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f30f809b150 0x7f30f815d940 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 >> 172.21.15.31:0/242453624 conn(0x7f30f80d23b0 msgr2=0x7f30f80ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 shutdown_connections 2024-09-15T22:53:09.621 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.615+0000 7f30fea00640 1 -- 172.21.15.31:0/242453624 wait complete. 2024-09-15T22:53:09.638 INFO:tasks.ceph:Scrubbing osd.7 2024-09-15T22:53:09.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-15T22:53:09.784 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 Processor -- start 2024-09-15T22:53:09.785 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 -- start start 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa604147da0 0x7fa604071660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fa6040b5aa0 0x7fa60415f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa60406d580 con 0x7fa604071ba0 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fa60415ed00 con 0x7fa604147da0 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603e00640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fa604148180 con 0x7fa6040b5aa0 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa602a00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fa604147da0 0x7fa604071660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa5fbe00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fa604071ba0 0x7fa6040b5390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:34674/0 (socket says 172.21.15.31:34674) 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa5fbe00640 1 -- 172.21.15.31:0/4269640070 learned_addr learned my addr 172.21.15.31:0/4269640070 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:09.786 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa603400640 1 --2- 172.21.15.31:0/4269640070 >> v2:172.21.15.102:3300/0 conn(0x7fa6040b5aa0 0x7fa60415f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa602a00640 1 -- 172.21.15.31:0/4269640070 >> v2:172.21.15.102:3300/0 conn(0x7fa6040b5aa0 msgr2=0x7fa60415f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:09.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa602a00640 1 --2- 172.21.15.31:0/4269640070 >> v2:172.21.15.102:3300/0 conn(0x7fa6040b5aa0 0x7fa60415f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa602a00640 1 -- 172.21.15.31:0/4269640070 >> v1:172.21.15.31:6789/0 conn(0x7fa604071ba0 legacy=0x7fa6040b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.787 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.783+0000 7fa602a00640 1 -- 172.21.15.31:0/4269640070 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6040721d0 con 0x7fa604147da0 2024-09-15T22:53:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa602a00640 1 --2- 172.21.15.31:0/4269640070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa604147da0 0x7fa604071660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa60406fa60 tx=0x7fa5f401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6ea844d81b658b server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa602000640 1 -- 172.21.15.31:0/4269640070 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40b0070 con 0x7fa604147da0 2024-09-15T22:53:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa602000640 1 -- 172.21.15.31:0/4269640070 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5f40ab600 con 0x7fa604147da0 2024-09-15T22:53:09.789 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa602000640 1 -- 172.21.15.31:0/4269640070 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5f40ab9d0 con 0x7fa604147da0 2024-09-15T22:53:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- 172.21.15.31:0/4269640070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa604147da0 msgr2=0x7fa604071660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 --2- 172.21.15.31:0/4269640070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa604147da0 0x7fa604071660 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa60406fa60 tx=0x7fa5f401c480 comp rx=0 tx=0).stop 2024-09-15T22:53:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- 172.21.15.31:0/4269640070 shutdown_connections 2024-09-15T22:53:09.790 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 --2- 172.21.15.31:0/4269640070 >> v2:172.21.15.102:3300/0 conn(0x7fa6040b5aa0 0x7fa60415f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 --2- 172.21.15.31:0/4269640070 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa604147da0 0x7fa604071660 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- 172.21.15.31:0/4269640070 >> 172.21.15.31:0/4269640070 conn(0x7fa604070020 msgr2=0x7fa604070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- 172.21.15.31:0/4269640070 shutdown_connections 2024-09-15T22:53:09.791 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- 172.21.15.31:0/4269640070 wait complete. 2024-09-15T22:53:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 Processor -- start 2024-09-15T22:53:09.792 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.787+0000 7fa603e00640 1 -- start start 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa604071ba0 0x7fa6041f7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 0x7fa6041431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa604147da0 0x7fa6041614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fa604160060 con 0x7fa6040b5aa0 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fa60415fee0 con 0x7fa604147da0 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fa6041601e0 con 0x7fa604071ba0 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 0x7fa6041431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 0x7fa6041431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37696/0 (socket says 172.21.15.31:37696) 2024-09-15T22:53:09.794 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 -- 172.21.15.31:0/3660024343 learned_addr learned my addr 172.21.15.31:0/3660024343 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603400640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa604147da0 0x7fa6041614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa602a00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa604071ba0 0x7fa6041f7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 -- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa604071ba0 msgr2=0x7fa6041f7260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fa604071ba0 0x7fa6041f7260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 -- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa604147da0 msgr2=0x7fa6041614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa604147da0 0x7fa6041614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa60413c690 con 0x7fa6040b5aa0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603400640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fa604147da0 0x7fa6041614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5fbe00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 0x7fa6041431e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c420 tx=0x7fa5ec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec017070 con 0x7fa6040b5aa0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5ec005cf0 con 0x7fa6040b5aa0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ec0072f0 con 0x7fa6040b5aa0 2024-09-15T22:53:09.795 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa60413c970 con 0x7fa6040b5aa0 2024-09-15T22:53:09.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa60413cf30 con 0x7fa6040b5aa0 2024-09-15T22:53:09.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa60415f190 con 0x7fa6040b5aa0 2024-09-15T22:53:09.796 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.791+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fa5ec01a070 con 0x7fa6040b5aa0 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa5e00678c0 0x7fa5e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fa5ec084fc0 con 0x7fa6040b5aa0 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7fa5e006de00 0x7fa5e0070240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5ec00de50 con 0x7fa5e006de00 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_get_version_reply(handle=1 version=64) ==== 24+0+0 (secure 0 0 0) 0x7fa5ec0875e0 con 0x7fa6040b5aa0 2024-09-15T22:53:09.797 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa602a00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa5e00678c0 0x7fa5e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa603400640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7fa5e006de00 0x7fa5e0070240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa602a00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa5e00678c0 0x7fa5e0069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ad000 tx=0x7fa5f4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.798 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa603400640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7fa5e006de00 0x7fa5e0070240 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.799 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.795+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== osd.7 v2:172.21.15.102:6816/944524781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5ec00de50 con 0x7fa5e006de00 2024-09-15T22:53:09.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.807+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 --> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa604074820 con 0x7fa5e006de00 2024-09-15T22:53:09.812 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa5faa00640 1 -- 172.21.15.31:0/3660024343 <== osd.7 v2:172.21.15.102:6816/944524781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa604074820 con 0x7fa5e006de00 2024-09-15T22:53:09.813 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2024-09-15T22:53:09.813 INFO:teuthology.orchestra.run.smithi031.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-15T22:53:09.813 INFO:teuthology.orchestra.run.smithi031.stdout:} 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7fa5e006de00 msgr2=0x7fa5e0070240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6816/944524781,v1:172.21.15.102:6817/944524781] conn(0x7fa5e006de00 0x7fa5e0070240 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa5e00678c0 msgr2=0x7fa5e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fa5e00678c0 0x7fa5e0069d80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fa5f40ad000 tx=0x7fa5f4008040 comp rx=0 tx=0).stop 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 msgr2=0x7fa6041431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 --2- 172.21.15.31:0/3660024343 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fa6040b5aa0 0x7fa6041431e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa5ec00c420 tx=0x7fa5ec00c8e0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603400640 1 -- 172.21.15.31:0/3660024343 reap_dead start 2024-09-15T22:53:09.814 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 shutdown_connections 2024-09-15T22:53:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 >> 172.21.15.31:0/3660024343 conn(0x7fa604070020 msgr2=0x7fa6040b3520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 shutdown_connections 2024-09-15T22:53:09.815 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.811+0000 7fa603e00640 1 -- 172.21.15.31:0/3660024343 wait complete. 2024-09-15T22:53:09.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-15T22:53:09.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 Processor -- start 2024-09-15T22:53:09.973 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 -- start start 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7809aa40 0x7f5e780d04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e7815f620 0x7f5e7809ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e7809b360 con 0x7f5e78162140 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f5e780d1780 con 0x7f5e7815f620 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e7e800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e780d0b70 con 0x7f5e7809aa40 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e7815f620 0x7f5e7809ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f5e7815f620 0x7f5e7809ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37702/0 (socket says 172.21.15.31:37702) 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 -- 172.21.15.31:0/3552149502 learned_addr learned my addr 172.21.15.31:0/3552149502 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.975 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e77400640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7809aa40 0x7f5e780d04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 -- 172.21.15.31:0/3552149502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7809aa40 msgr2=0x7f5e780d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7809aa40 0x7f5e780d04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 -- 172.21.15.31:0/3552149502 >> v1:172.21.15.102:6789/0 conn(0x7f5e78162140 legacy=0x7f5e781625f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.976 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.971+0000 7f5e6ea00640 1 -- 172.21.15.31:0/3552149502 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e780d0e50 con 0x7f5e7815f620 2024-09-15T22:53:09.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e6ea00640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7815f620 0x7f5e7809ae20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e600098a0 tx=0x7f5e6001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f862239a04bafe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e76a00640 1 -- 172.21.15.31:0/3552149502 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e600ab430 con 0x7f5e7815f620 2024-09-15T22:53:09.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e76a00640 1 -- 172.21.15.31:0/3552149502 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e600b0070 con 0x7f5e7815f620 2024-09-15T22:53:09.978 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e76a00640 1 -- 172.21.15.31:0/3552149502 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e600ab7f0 con 0x7f5e7815f620 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 -- 172.21.15.31:0/3552149502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7815f620 msgr2=0x7f5e7809ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7815f620 0x7f5e7809ae20 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5e600098a0 tx=0x7f5e6001c540 comp rx=0 tx=0).stop 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 -- 172.21.15.31:0/3552149502 shutdown_connections 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7815f620 0x7f5e7809ae20 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3552149502 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7809aa40 0x7f5e780d04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 -- 172.21.15.31:0/3552149502 >> 172.21.15.31:0/3552149502 conn(0x7f5e780d23b0 msgr2=0x7f5e780d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:09.979 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 -- 172.21.15.31:0/3552149502 shutdown_connections 2024-09-15T22:53:09.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.975+0000 7f5e7e800640 1 -- 172.21.15.31:0/3552149502 wait complete. 2024-09-15T22:53:09.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 Processor -- start 2024-09-15T22:53:09.980 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- start start 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7815f620 0x7f5e780af150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e78162140 0x7f5e780cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7815ea10 con 0x7f5e7809aa40 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f5e7815e890 con 0x7f5e78162140 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f5e7816bcd0 con 0x7f5e7815f620 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37712/0 (socket says 172.21.15.31:37712) 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 -- 172.21.15.31:0/3600945375 learned_addr learned my addr 172.21.15.31:0/3600945375 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e6ea00640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7815f620 0x7f5e780af150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77e00640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e78162140 0x7f5e780cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.983 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 -- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7815f620 msgr2=0x7f5e780af150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7815f620 0x7f5e780af150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 -- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e78162140 msgr2=0x7f5e780cf090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e78162140 0x7f5e780cf090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 -- 172.21.15.31:0/3600945375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e78158280 con 0x7f5e7809aa40 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e77400640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800e870 tx=0x7f5e6800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e68017070 con 0x7f5e7809aa40 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e6800c8e0 con 0x7f5e7809aa40 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e6800cc90 con 0x7f5e7809aa40 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e780b0290 con 0x7f5e7809aa40 2024-09-15T22:53:09.984 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e780b0850 con 0x7f5e7809aa40 2024-09-15T22:53:09.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.979+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e7809ae20 con 0x7f5e7809aa40 2024-09-15T22:53:09.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.983+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f5e6801a070 con 0x7f5e7809aa40 2024-09-15T22:53:09.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.983+0000 7f5e6fe00640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 0x7f5e54069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:09.985 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.983+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f5e68085aa0 con 0x7f5e7809aa40 2024-09-15T22:53:09.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.983+0000 7f5e6ea00640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 0x7f5e54069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:09.986 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.983+0000 7f5e6ea00640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 0x7f5e54069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e600af000 tx=0x7f5e60008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:09.989 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:09.987+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f5e68056660 con 0x7f5e7809aa40 2024-09-15T22:53:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.151+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f5e780b8330 con 0x7f5e540678c0 2024-09-15T22:53:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.151+0000 7f5e6fe00640 1 -- 172.21.15.31:0/3600945375 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5e780b8330 con 0x7f5e540678c0 2024-09-15T22:53:10.155 INFO:teuthology.orchestra.run.smithi031.stderr:instructed osd(s) 7 to deep-scrub 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 msgr2=0x7f5e54069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 0x7f5e54069d80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f5e600af000 tx=0x7f5e60008040 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 msgr2=0x7f5e780706d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5e6800e870 tx=0x7f5e6800ec70 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 shutdown_connections 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f5e540678c0 0x7f5e54069d80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f5e78162140 0x7f5e780cf090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f5e7815f620 0x7f5e780af150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 --2- 172.21.15.31:0/3600945375 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f5e7809aa40 0x7f5e780706d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.158 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 >> 172.21.15.31:0/3600945375 conn(0x7f5e780d23b0 msgr2=0x7f5e78160630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 shutdown_connections 2024-09-15T22:53:10.159 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.155+0000 7f5e7e800640 1 -- 172.21.15.31:0/3600945375 wait complete. 2024-09-15T22:53:10.177 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:53:10.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 Processor -- start 2024-09-15T22:53:10.317 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 -- start start 2024-09-15T22:53:10.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 0x7fc96415f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc96409b150 0x7fc964161410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9640d0c70 con 0x7fc9640d04b0 2024-09-15T22:53:10.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7fc96415fcb0 con 0x7fc96409b150 2024-09-15T22:53:10.318 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc96a000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc964160040 con 0x7fc96415e6d0 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc96409b150 0x7fc964161410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963400640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 0x7fc96415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7fc96409b150 0x7fc964161410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.102:3300/0 says I am v2:172.21.15.31:34714/0 (socket says 172.21.15.31:34714) 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 -- 172.21.15.31:0/1742504841 learned_addr learned my addr 172.21.15.31:0/1742504841 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 -- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 msgr2=0x7fc96415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 0x7fc96415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 -- 172.21.15.31:0/1742504841 >> v1:172.21.15.102:6789/0 conn(0x7fc9640d04b0 legacy=0x7fc96409aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963e00640 1 -- 172.21.15.31:0/1742504841 --> v2:172.21.15.102:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9640d0f50 con 0x7fc96409b150 2024-09-15T22:53:10.319 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.315+0000 7fc963400640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 0x7fc96415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-15T22:53:10.321 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc963e00640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc96409b150 0x7fc964161410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009870 tx=0x7fc95c01c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=af76a9de713cb6fd server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:10.322 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc962000640 1 -- 172.21.15.31:0/1742504841 <== mon.1 v2:172.21.15.102:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a95f0 con 0x7fc96409b150 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc962000640 1 -- 172.21.15.31:0/1742504841 <== mon.1 v2:172.21.15.102:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c0a9790 con 0x7fc96409b150 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc962000640 1 -- 172.21.15.31:0/1742504841 <== mon.1 v2:172.21.15.102:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0a9b60 con 0x7fc96409b150 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 -- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc96409b150 msgr2=0x7fc964161410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc96409b150 0x7fc964161410 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc95c009870 tx=0x7fc95c01c530 comp rx=0 tx=0).stop 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 -- 172.21.15.31:0/1742504841 shutdown_connections 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc96409b150 0x7fc964161410 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 --2- 172.21.15.31:0/1742504841 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96415e6d0 0x7fc96415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 -- 172.21.15.31:0/1742504841 >> 172.21.15.31:0/1742504841 conn(0x7fc9640d23b0 msgr2=0x7fc9640d2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 -- 172.21.15.31:0/1742504841 shutdown_connections 2024-09-15T22:53:10.323 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.319+0000 7fc96a000640 1 -- 172.21.15.31:0/1742504841 wait complete. 2024-09-15T22:53:10.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 Processor -- start 2024-09-15T22:53:10.324 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- start start 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96409b150 0x7fc964151470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9640d04b0 0x7fc964071560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fc9640d0890 con 0x7fc96415e6d0 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fc9640d17f0 con 0x7fc9640d04b0 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fc9640d0a10 con 0x7fc96409b150 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.326 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:37716/0 (socket says 172.21.15.31:37716) 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 -- 172.21.15.31:0/2687289542 learned_addr learned my addr 172.21.15.31:0/2687289542 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963400640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96409b150 0x7fc964151470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc962a00640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9640d04b0 0x7fc964071560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 -- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96409b150 msgr2=0x7fc964151470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96409b150 0x7fc964151470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 -- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9640d04b0 msgr2=0x7fc964071560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9640d04b0 0x7fc964071560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 -- 172.21.15.31:0/2687289542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9641519b0 con 0x7fc96415e6d0 2024-09-15T22:53:10.327 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc963e00640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0ab040 tx=0x7fc95c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b1800 con 0x7fc96415e6d0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc95c0b19a0 con 0x7fc96415e6d0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9640b6d10 con 0x7fc96415e6d0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc95c0b1d90 con 0x7fc96415e6d0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9640b72d0 con 0x7fc96415e6d0 2024-09-15T22:53:10.328 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.323+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc964161410 con 0x7fc96415e6d0 2024-09-15T22:53:10.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.327+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fc95c0a95b0 con 0x7fc96415e6d0 2024-09-15T22:53:10.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.327+0000 7fc95b400640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 0x7fc944069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:10.329 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.327+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fc95c120560 con 0x7fc96415e6d0 2024-09-15T22:53:10.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.327+0000 7fc963400640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 0x7fc944069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:10.330 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.327+0000 7fc963400640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 0x7fc944069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc954007440 tx=0x7fc95400b040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:10.333 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.331+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fc95c0ad020 con 0x7fc96415e6d0 2024-09-15T22:53:10.495 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.491+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc9640b8330 con 0x7fc9440678c0 2024-09-15T22:53:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.491+0000 7fc95b400640 1 -- 172.21.15.31:0/2687289542 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13397 (secure 0 0 0) 0x7fc9640b8330 con 0x7fc9440678c0 2024-09-15T22:53:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:10.496 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:53:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 msgr2=0x7fc944069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 0x7fc944069d80 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fc954007440 tx=0x7fc95400b040 comp rx=0 tx=0).stop 2024-09-15T22:53:10.498 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 msgr2=0x7fc9640b2d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0ab040 tx=0x7fc95c0192d0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 shutdown_connections 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fc9440678c0 0x7fc944069d80 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fc96415e6d0 0x7fc9640b2d40 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fc9640d04b0 0x7fc964071560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 --2- 172.21.15.31:0/2687289542 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fc96409b150 0x7fc964151470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 >> 172.21.15.31:0/2687289542 conn(0x7fc9640d23b0 msgr2=0x7fc96406d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 shutdown_connections 2024-09-15T22:53:10.499 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:10.495+0000 7fc96a000640 1 -- 172.21.15.31:0/2687289542 wait complete. 2024-09-15T22:53:10.517 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-15T22:53:09.595654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227584,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747136,"statfs":{"total":773094113280,"available":772861067264,"internally_reserved":0,"allocated":7348224,"data_stored":3985480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-7,"num_objects":-1,"num_object_clones":0,"num_object_copies":-2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-1,"num_write_kb":-1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002228"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":248,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T22:53:00.414912+0000","last_change":"2024-09-15T22:50:08.182307+0000","last_active":"2024-09-15T22:53:00.414912+0000","last_peered":"2024-09-15T22:53:00.414912+0000","last_clean":"2024-09-15T22:53:00.414912+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:53:00.414912+0000","last_undegraded":"2024-09-15T22:53:00.414912+0000","last_fullsized":"2024-09-15T22:53:00.414912+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-15T22:50:06.543622+0000","last_clean_scrub_stamp":"2024-09-15T22:50:06.543622+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T04:07:57.251999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542183,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28364,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343476,"statfs":{"total":96636764160,"available":96607719424,"internally_reserved":0,"allocated":1363968,"data_stored":940961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542182,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542182,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542184,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542183,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32524,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339316,"statfs":{"total":96636764160,"available":96603459584,"internally_reserved":0,"allocated":1363968,"data_stored":940961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:53:10.520 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-15T22:50:06.543622+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=50, tm_sec=6, tm_wday=6, tm_yday=259, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=15, tm_hour=22, tm_min=53, tm_sec=4, tm_wday=6, tm_yday=259, tm_isdst=0) 2024-09-15T22:53:10.520 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-15T22:53:14.719 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:14.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:30.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-15T22:53:30.674 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 Processor -- start 2024-09-15T22:53:30.675 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 -- start start 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7f9dd8072870 0x7f9dd815c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd8072d40 con 0x7f9dd806f270 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dd8073020 con 0x7f9dd80b47a0 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dde600640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7f9dd815ba60 con 0x7f9dd8072870 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dd7400640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f9dd806f270 0x7f9dd806f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41866/0 (socket says 172.21.15.31:41866) 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.670+0000 7f9dd7400640 1 -- 172.21.15.31:0/977839424 learned_addr learned my addr 172.21.15.31:0/977839424 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:30.676 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd7e00640 1 --2- 172.21.15.31:0/977839424 >> v2:172.21.15.31:3300/0 conn(0x7f9dd8072870 0x7f9dd815c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd6000640 1 -- 172.21.15.31:0/977839424 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518544451 0 0) 0x7f9dd8072d40 con 0x7f9dd806f270 2024-09-15T22:53:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd6000640 1 -- 172.21.15.31:0/977839424 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9dbc005740 con 0x7f9dd806f270 2024-09-15T22:53:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd7e00640 1 -- 172.21.15.31:0/977839424 >> v1:172.21.15.102:6789/0 conn(0x7f9dd80b47a0 legacy=0x7f9dd8072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd7e00640 1 -- 172.21.15.31:0/977839424 >> v1:172.21.15.31:6789/0 conn(0x7f9dd806f270 legacy=0x7f9dd806f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.677 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd7e00640 1 -- 172.21.15.31:0/977839424 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd80b3cc0 con 0x7f9dd8072870 2024-09-15T22:53:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd7e00640 1 --2- 172.21.15.31:0/977839424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd8072870 0x7f9dd815c840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009d90 tx=0x7f9dd001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d21a1fe61d5b1e server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd6000640 1 -- 172.21.15.31:0/977839424 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b2070 con 0x7f9dd8072870 2024-09-15T22:53:30.680 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd6000640 1 -- 172.21.15.31:0/977839424 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd00a5730 con 0x7f9dd8072870 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.674+0000 7f9dd6000640 1 -- 172.21.15.31:0/977839424 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00a5b00 con 0x7f9dd8072870 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- 172.21.15.31:0/977839424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd8072870 msgr2=0x7f9dd815c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 --2- 172.21.15.31:0/977839424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd8072870 0x7f9dd815c840 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9dd0009d90 tx=0x7f9dd001c970 comp rx=0 tx=0).stop 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- 172.21.15.31:0/977839424 shutdown_connections 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 --2- 172.21.15.31:0/977839424 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd8072870 0x7f9dd815c840 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- 172.21.15.31:0/977839424 >> 172.21.15.31:0/977839424 conn(0x7f9dd8067e00 msgr2=0x7f9dd806bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- 172.21.15.31:0/977839424 shutdown_connections 2024-09-15T22:53:30.681 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- 172.21.15.31:0/977839424 wait complete. 2024-09-15T22:53:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 Processor -- start 2024-09-15T22:53:30.682 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- start start 2024-09-15T22:53:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 0x7f9dd8145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 0x7f9dd8151a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.683 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd815d310 con 0x7f9dd80b47a0 2024-09-15T22:53:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f9dd815d190 con 0x7f9dd8072870 2024-09-15T22:53:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dde600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f9dd806e970 con 0x7f9dd806f270 2024-09-15T22:53:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42220/0 (socket says 172.21.15.31:42220) 2024-09-15T22:53:30.684 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 -- 172.21.15.31:0/1631464246 learned_addr learned my addr 172.21.15.31:0/1631464246 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:30.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7400640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 0x7f9dd8145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 -- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 msgr2=0x7f9dd8145aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.685 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 0x7f9dd8145aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 -- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 msgr2=0x7f9dd8151a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd6a00640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 0x7f9dd8151a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 0x7f9dd8151a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7e00640 1 -- 172.21.15.31:0/1631464246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dd8154470 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd7400640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 0x7f9dd8145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.678+0000 7f9dd6a00640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 0x7f9dd8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dd7e00640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00b0040 tx=0x7f9dd0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b2040 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9dd00bf070 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd00b8670 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dd814ec80 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dd814f240 con 0x7f9dd80b47a0 2024-09-15T22:53:30.686 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dd806ed30 con 0x7f9dd80b47a0 2024-09-15T22:53:30.687 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f9dd00b8810 con 0x7f9dd80b47a0 2024-09-15T22:53:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.682+0000 7f9dcf400640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.686+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f9dd0120c80 con 0x7f9dd80b47a0 2024-09-15T22:53:30.688 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.686+0000 7f9dd7400640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:30.689 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.686+0000 7f9dd7400640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 0x7f9db8069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80011f0 tx=0x7f9dc8009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:30.692 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.690+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f9dd0016560 con 0x7f9dd80b47a0 2024-09-15T22:53:30.854 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.850+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 --> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9dd80b29d0 con 0x7f9db80678c0 2024-09-15T22:53:30.855 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.850+0000 7f9dcf400640 1 -- 172.21.15.31:0/1631464246 <== mgr.4107 v2:172.21.15.102:6832/2404770539 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13359 (secure 0 0 0) 0x7f9dd80b29d0 con 0x7f9db80678c0 2024-09-15T22:53:30.855 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:30.856 INFO:teuthology.orchestra.run.smithi031.stderr:dumped all 2024-09-15T22:53:30.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 msgr2=0x7f9db8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 0x7f9db8069d80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9dc80011f0 tx=0x7f9dc8009040 comp rx=0 tx=0).stop 2024-09-15T22:53:30.857 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 msgr2=0x7f9dd8151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f9dd00b0040 tx=0x7f9dd0019710 comp rx=0 tx=0).stop 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 shutdown_connections 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f9db80678c0 0x7f9db8069d80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f9dd80b47a0 0x7f9dd8151fd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f9dd8072870 0x7f9dd8151a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 --2- 172.21.15.31:0/1631464246 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f9dd806f270 0x7f9dd8145aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 >> 172.21.15.31:0/1631464246 conn(0x7f9dd8067e00 msgr2=0x7f9dd80b12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 shutdown_connections 2024-09-15T22:53:30.858 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:30.854+0000 7f9dde600640 1 -- 172.21.15.31:0/1631464246 wait complete. 2024-09-15T22:53:30.877 INFO:teuthology.orchestra.run.smithi031.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2024-09-15T22:53:29.599944+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":227568,"kb_used_data":7176,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747152,"statfs":{"total":773094113280,"available":772861083648,"internally_reserved":0,"allocated":7348224,"data_stored":3985480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002491"},"pg_stats":[{"pgid":"1.0","version":"64'119","reported_seq":259,"reported_epoch":64,"state":"active+clean","last_fresh":"2024-09-15T22:53:11.089635+0000","last_change":"2024-09-15T22:53:11.089666+0000","last_active":"2024-09-15T22:53:11.089635+0000","last_peered":"2024-09-15T22:53:11.089635+0000","last_clean":"2024-09-15T22:53:11.089635+0000","last_became_active":"2024-09-15T22:50:08.181197+0000","last_became_peered":"2024-09-15T22:50:08.181197+0000","last_unstale":"2024-09-15T22:53:11.089635+0000","last_undegraded":"2024-09-15T22:53:11.089635+0000","last_fullsized":"2024-09-15T22:53:11.089635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"64'119","last_scrub_stamp":"2024-09-15T22:53:11.089563+0000","last_deep_scrub":"64'119","last_deep_scrub_stamp":"2024-09-15T22:53:11.089563+0000","last_clean_scrub_stamp":"2024-09-15T22:53:11.089563+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-17T01:11:41.503292+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542187,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28356,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343484,"statfs":{"total":96636764160,"available":96607727616,"internally_reserved":0,"allocated":1363968,"data_stored":940961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542186,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":14,"seq":60129542188,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27784,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542187,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27780,"kb_used_data":752,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":770048,"data_stored":350593,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542186,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32516,"kb_used_data":1332,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339324,"statfs":{"total":96636764160,"available":96603467776,"internally_reserved":0,"allocated":1363968,"data_stored":940961,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-15T22:53:30.878 DEBUG:teuthology.orchestra.run.smithi031:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 Processor -- start 2024-09-15T22:53:31.017 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 -- start start 2024-09-15T22:53:31.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fefcc15e310 0x7fefcc0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.018 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc072190 0x7fefcc06db30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefcc06d090 con 0x7fefcc06e070 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 -- --> v2:172.21.15.31:3300/0 -- mon_getmap magic: 0 -- 0x7fefcc15e6f0 con 0x7fefcc15e310 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefcb200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fefcc0cf130 con 0x7fefcc072190 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc9e00640 1 --2- >> v2:172.21.15.31:3300/0 conn(0x7fefcc15e310 0x7fefcc0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefca800640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7fefcc06e070 0x7fefcc0b51b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41868/0 (socket says 172.21.15.31:41868) 2024-09-15T22:53:31.019 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefca800640 1 -- 172.21.15.31:0/2753297122 learned_addr learned my addr 172.21.15.31:0/2753297122 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:31.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc1400640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc072190 0x7fefcc06db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc9e00640 1 -- 172.21.15.31:0/2753297122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc072190 msgr2=0x7fefcc06db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc9e00640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc072190 0x7fefcc06db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc9e00640 1 -- 172.21.15.31:0/2753297122 >> v1:172.21.15.31:6789/0 conn(0x7fefcc06e070 legacy=0x7fefcc0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.020 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.014+0000 7fefc9e00640 1 -- 172.21.15.31:0/2753297122 --> v2:172.21.15.31:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc0cf410 con 0x7fefcc15e310 2024-09-15T22:53:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefc9e00640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc15e310 0x7fefcc0ceb20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0097c0 tx=0x7fefbc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f026284ef52f32 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefc9400640 1 -- 172.21.15.31:0/2753297122 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0a7070 con 0x7fefcc15e310 2024-09-15T22:53:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefc9400640 1 -- 172.21.15.31:0/2753297122 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc0b0070 con 0x7fefcc15e310 2024-09-15T22:53:31.022 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefc9400640 1 -- 172.21.15.31:0/2753297122 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0ab890 con 0x7fefcc15e310 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 -- 172.21.15.31:0/2753297122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc15e310 msgr2=0x7fefcc0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc15e310 0x7fefcc0ceb20 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fefbc0097c0 tx=0x7fefbc01c470 comp rx=0 tx=0).stop 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 -- 172.21.15.31:0/2753297122 shutdown_connections 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc072190 0x7fefcc06db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 --2- 172.21.15.31:0/2753297122 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc15e310 0x7fefcc0ceb20 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.023 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 -- 172.21.15.31:0/2753297122 >> 172.21.15.31:0/2753297122 conn(0x7fefcc06ff90 msgr2=0x7fefcc0703a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 -- 172.21.15.31:0/2753297122 shutdown_connections 2024-09-15T22:53:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.018+0000 7fefcb200640 1 -- 172.21.15.31:0/2753297122 wait complete. 2024-09-15T22:53:31.024 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 Processor -- start 2024-09-15T22:53:31.025 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- start start 2024-09-15T22:53:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefcc072190 0x7fefcc0cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc15e310 0x7fefcc0ce160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc0b5a40 con 0x7fefcc06e070 2024-09-15T22:53:31.029 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7fefcc0b58c0 con 0x7fefcc072190 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7fefcc16b130 con 0x7fefcc15e310 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42250/0 (socket says 172.21.15.31:42250) 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 -- 172.21.15.31:0/979804588 learned_addr learned my addr 172.21.15.31:0/979804588 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 -- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc15e310 msgr2=0x7fefcc0ce160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc15e310 0x7fefcc0ce160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 -- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefcc072190 msgr2=0x7fefcc0cdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefcc072190 0x7fefcc0cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 -- 172.21.15.31:0/979804588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefcc0cc990 con 0x7fefcc06e070 2024-09-15T22:53:31.030 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc9e00640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fefbc01ab20 tx=0x7fefbc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0bf610 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefbc0bf7b0 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefcc0ccc70 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefbc0bfba0 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefcc1568e0 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.022+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefcc06db30 con 0x7fefcc06e070 2024-09-15T22:53:31.031 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.026+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7fefbc0bd020 con 0x7fefcc06e070 2024-09-15T22:53:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.026+0000 7fefc2a00640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 0x7fefa8069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.026+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7fefbc120640 con 0x7fefcc06e070 2024-09-15T22:53:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.026+0000 7fefc1400640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 0x7fefa8069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.032 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.026+0000 7fefc1400640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 0x7fefa8069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fefcc14f5d0 tx=0x7fefb4008040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.034 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.030+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7fefbc016090 con 0x7fefcc06e070 2024-09-15T22:53:31.200 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.194+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fefcc0cee70 con 0x7fefcc06e070 2024-09-15T22:53:31.203 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.198+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v14)=0 v14) ==== 123+0+0 (secure 0 0 0) 0x7fefbc0f1320 con 0x7fefcc06e070 2024-09-15T22:53:31.204 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.198+0000 7fefc2a00640 1 -- 172.21.15.31:0/979804588 <== mon.0 v2:172.21.15.31:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fefbc0b0020 con 0x7fefcc06e070 2024-09-15T22:53:31.206 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 msgr2=0x7fefa8069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 0x7fefa8069d80 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fefcc14f5d0 tx=0x7fefb4008040 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 msgr2=0x7fefcc0cbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fefbc01ab20 tx=0x7fefbc01acb0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 shutdown_connections 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7fefa80678c0 0x7fefa8069d80 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7fefcc15e310 0x7fefcc0ce160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7fefcc072190 0x7fefcc0cdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 --2- 172.21.15.31:0/979804588 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7fefcc06e070 0x7fefcc0cbf10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 >> 172.21.15.31:0/979804588 conn(0x7fefcc06ff90 msgr2=0x7fefcc15e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 shutdown_connections 2024-09-15T22:53:31.207 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.202+0000 7fefcb200640 1 -- 172.21.15.31:0/979804588 wait complete. 2024-09-15T22:53:31.226 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-15T22:53:31.226 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-15T22:53:31.366 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 Processor -- start 2024-09-15T22:53:31.367 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 -- start start 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 --2- >> v2:172.21.15.102:3300/0 conn(0x7f7a040b47a0 0x7f7a04072160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 -- --> v1:172.21.15.31:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a04072ad0 con 0x7f7a0406f270 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 -- --> v1:172.21.15.102:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a04072d40 con 0x7f7a040726a0 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.362+0000 7f7a0b600640 1 -- --> v2:172.21.15.102:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0415ba60 con 0x7f7a040b47a0 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a08c00640 1 --1- >> v1:172.21.15.31:6789/0 conn(0x7f7a0406f270 0x7f7a0406f650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.31:6789/0 says I am v1:172.21.15.31:41876/0 (socket says 172.21.15.31:41876) 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a08c00640 1 -- 172.21.15.31:0/2485506350 learned_addr learned my addr 172.21.15.31:0/2485506350 (peer_addr_for_me v1:172.21.15.31:0/0) 2024-09-15T22:53:31.370 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2485506350 >> v2:172.21.15.102:3300/0 conn(0x7f7a040b47a0 0x7f7a04072160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v1:172.21.15.31:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660178094 0 0) 0x7f7a04072ad0 con 0x7f7a0406f270 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 --> v1:172.21.15.31:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79e8003530 con 0x7f7a0406f270 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v1:172.21.15.31:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1808551680 0 0) 0x7f79e8003530 con 0x7f7a0406f270 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 >> v2:172.21.15.102:3300/0 conn(0x7f7a040b47a0 msgr2=0x7f7a04072160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 --2- 172.21.15.31:0/2485506350 >> v2:172.21.15.102:3300/0 conn(0x7f7a040b47a0 0x7f7a04072160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 >> v1:172.21.15.102:6789/0 conn(0x7f7a040726a0 legacy=0x7f7a0415c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 --> v1:172.21.15.31:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a04073020 con 0x7f7a0406f270 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v1:172.21.15.31:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 3263590766 0 0) 0x7f79f4001680 con 0x7f7a0406f270 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 >> v1:172.21.15.31:6789/0 conn(0x7f7a0406f270 legacy=0x7f7a0406f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79e80039c0 0x7f79e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 0x7f79e8004890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.371 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e8005090 0x7f79e800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0415ba60 con 0x7f79e80043c0 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f79e800bff0 con 0x7f79e8005090 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f79e800c1f0 con 0x7f79e80039c0 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 0x7f79e8004890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a08c00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79e80039c0 0x7f79e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a09600640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e8005090 0x7f79e800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 -- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79e80039c0 msgr2=0x7f79e8003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f79e80039c0 0x7f79e8003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 -- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e8005090 msgr2=0x7f79e800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-15T22:53:31.372 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e8005090 0x7f79e800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f79fbe00640 1 -- 172.21.15.31:0/2485506350 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e8003530 con 0x7f79e80043c0 2024-09-15T22:53:31.373 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.366+0000 7f7a09600640 1 -- 172.21.15.31:0/2485506350 reap_dead start 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 0x7f79e8004890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009ae0 tx=0x7f79ec01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc1d7d56f7ac8e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0b2070 con 0x7f79e80043c0 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f79ec0a55e0 con 0x7f79e80043c0 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a03e00640 1 -- 172.21.15.31:0/2485506350 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0096b0 con 0x7f79e80043c0 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 msgr2=0x7f79e8004890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.374 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 0x7f79e8004890 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f79ec009ae0 tx=0x7f79ec01ca70 comp rx=0 tx=0).stop 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- 172.21.15.31:0/2485506350 shutdown_connections 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2485506350 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f79e80043c0 0x7f79e8004890 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- 172.21.15.31:0/2485506350 >> 172.21.15.31:0/2485506350 conn(0x7f7a04067e00 msgr2=0x7f7a0406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- 172.21.15.31:0/2485506350 shutdown_connections 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- 172.21.15.31:0/2485506350 wait complete. 2024-09-15T22:53:31.375 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 Processor -- start 2024-09-15T22:53:31.376 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.370+0000 7f7a0b600640 1 -- start start 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 --2- >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e80043c0 0x7f7a041307d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 --2- >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 0x7f7a0414fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_getmap magic: 0 -- 0x7f7a040b4310 con 0x7f7a04145210 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- --> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] -- mon_getmap magic: 0 -- 0x7f7a040affa0 con 0x7f79e80043c0 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- --> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] -- mon_getmap magic: 0 -- 0x7f7a040b3fa0 con 0x7f7a0414fa70 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.378 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 --2- >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.31:3300/0 says I am v2:172.21.15.31:42266/0 (socket says 172.21.15.31:42266) 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 -- 172.21.15.31:0/2454004865 learned_addr learned my addr 172.21.15.31:0/2454004865 (peer_addr_for_me v2:172.21.15.31:0/0) 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a08c00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e80043c0 0x7f7a041307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a09600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 0x7f7a0414fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 -- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 msgr2=0x7f7a0414fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 0x7f7a0414fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 -- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e80043c0 msgr2=0x7f7a041307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e80043c0 0x7f7a041307d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 -- 172.21.15.31:0/2454004865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a04145a10 con 0x7f7a04145210 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a09600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 0x7f7a0414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f79fbe00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f79ec01c8a0 tx=0x7f79ec019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec0b2040 con 0x7f7a04145210 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f79ec004020 con 0x7f7a04145210 2024-09-15T22:53:31.379 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a04145cf0 con 0x7f7a04145210 2024-09-15T22:53:31.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79ec004450 con 0x7f7a04145210 2024-09-15T22:53:31.380 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a041462b0 con 0x7f7a04145210 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a04149c60 con 0x7f7a04145210 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.374+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 4 ==== mgrmap(e 5) ==== 87445+0+0 (secure 0 0 0) 0x7f79ec0bf020 con 0x7f7a04145210 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.378+0000 7f7a01600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 0x7f79e0069d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.378+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 5421+0+0 (secure 0 0 0) 0x7f79ec11fc00 con 0x7f7a04145210 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.378+0000 7f7a08c00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 0x7f79e0069d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-15T22:53:31.381 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.378+0000 7f7a08c00640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 0x7f79e0069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a041f7390 tx=0x7f79f4009040 comp rx=0 tx=0).ready entity=mgr.4107 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-15T22:53:31.384 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.382+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180250 (secure 0 0 0) 0x7f7a04149c60 con 0x7f7a04145210 2024-09-15T22:53:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.578+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 --> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7a040b4c30 con 0x7f7a04145210 2024-09-15T22:53:31.584 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a01600640 1 -- 172.21.15.31:0/2454004865 <== mon.0 v2:172.21.15.31:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3914 (secure 0 0 0) 0x7f79ec0c6020 con 0x7f7a04145210 2024-09-15T22:53:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: 2024-09-15T22:53:31.585 INFO:teuthology.orchestra.run.smithi031.stdout:{"epoch":42,"btime":"2024-09-15T22:52:57:959839+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5045,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6837/818409761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6835","nonce":818409761},{"type":"v1","addr":"172.21.15.102:6837","nonce":818409761}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5320,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.102:6836/4014183979","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6834","nonce":4014183979},{"type":"v1","addr":"172.21.15.102:6836","nonce":4014183979}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34},{"gid":5481,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6834/3655432837","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6832","nonce":3655432837},{"type":"v1","addr":"172.21.15.31:6834","nonce":3655432837}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":35},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.31:6835/4213820004","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6833","nonce":4213820004},{"type":"v1","addr":"172.21.15.31:6835","nonce":4213820004}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-09-15T22:53:31.585 INFO:teuthology.orchestra.run.smithi031.stderr:dumped fsmap epoch 42 2024-09-15T22:53:31.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 msgr2=0x7f79e0069d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 0x7f79e0069d80 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7a041f7390 tx=0x7f79f4009040 comp rx=0 tx=0).stop 2024-09-15T22:53:31.586 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 msgr2=0x7f7a040b2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f79ec01c8a0 tx=0x7f79ec019810 comp rx=0 tx=0).stop 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 shutdown_connections 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:6832/2404770539,v1:172.21.15.102:6833/2404770539] conn(0x7f79e00678c0 0x7f79e0069d80 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3301/0,v1:172.21.15.102:6790/0] conn(0x7f7a0414fa70 0x7f7a0414fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.31:3300/0,v1:172.21.15.31:6789/0] conn(0x7f7a04145210 0x7f7a040b2980 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 --2- 172.21.15.31:0/2454004865 >> [v2:172.21.15.102:3300/0,v1:172.21.15.102:6789/0] conn(0x7f79e80043c0 0x7f7a041307d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 >> 172.21.15.31:0/2454004865 conn(0x7f7a04067e00 msgr2=0x7f7a0406bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 shutdown_connections 2024-09-15T22:53:31.587 INFO:teuthology.orchestra.run.smithi031.stderr:2024-09-15T22:53:31.582+0000 7f7a0b600640 1 -- 172.21.15.31:0/2454004865 wait complete. 2024-09-15T22:53:31.607 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-15T22:53:31.607 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-15T22:53:31.608 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-15T22:53:31.608 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.620 INFO:tasks.ceph.mds.a:Stopped 2024-09-15T22:53:31.620 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-15T22:53:31.620 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.675 INFO:tasks.ceph.mds.c:Stopped 2024-09-15T22:53:31.676 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-15T22:53:31.676 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.691 INFO:tasks.ceph.mds.b:Stopped 2024-09-15T22:53:31.691 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-15T22:53:31.691 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.749 INFO:tasks.ceph.mds.d:Stopped 2024-09-15T22:53:31.749 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-15T22:53:31.750 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-15T22:53:31.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.828 INFO:tasks.ceph.osd.0:Stopped 2024-09-15T22:53:31.828 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-15T22:53:31.828 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:31.919 INFO:tasks.ceph.osd.1:Stopped 2024-09-15T22:53:31.919 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-15T22:53:31.919 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:35.167 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-09-15T22:53:38.021 INFO:tasks.ceph.osd.2:Stopped 2024-09-15T22:53:38.021 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-15T22:53:38.021 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:38.097 INFO:tasks.ceph.osd.3:Stopped 2024-09-15T22:53:38.097 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-15T22:53:38.097 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:40.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-15T22:53:40.974 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-09-15T22:53:44.199 INFO:tasks.ceph.osd.4:Stopped 2024-09-15T22:53:44.199 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-15T22:53:44.199 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:44.267 INFO:tasks.ceph.osd.5:Stopped 2024-09-15T22:53:44.267 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-15T22:53:44.267 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:44.358 INFO:tasks.ceph.osd.6:Stopped 2024-09-15T22:53:44.359 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-15T22:53:44.359 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:44.778 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:44.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:46.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-15T22:53:46.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-15T22:53:50.460 INFO:tasks.ceph.osd.7:Stopped 2024-09-15T22:53:50.460 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-15T22:53:50.461 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-15T22:53:50.461 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:50.514 INFO:tasks.ceph.mgr.y:Stopped 2024-09-15T22:53:50.514 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-15T22:53:50.514 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:50.570 INFO:tasks.ceph.mgr.x:Stopped 2024-09-15T22:53:50.571 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-15T22:53:50.571 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-15T22:53:50.571 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:50.589 INFO:tasks.ceph.mon.a:Stopped 2024-09-15T22:53:50.590 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-15T22:53:50.590 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:50.604 INFO:tasks.ceph.mon.b:Stopped 2024-09-15T22:53:50.604 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-15T22:53:50.604 INFO:teuthology.orchestra.run:waiting for 300 2024-09-15T22:53:50.662 INFO:tasks.ceph.mon.c:Stopped 2024-09-15T22:53:50.662 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-15T22:53:50.662 DEBUG:teuthology.orchestra.run.smithi031:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-15T22:53:50.696 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:53:50.696 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-15T22:53:50.984 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:53:50.984 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-15T22:53:51.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:53:51.155 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-15T22:53:51.322 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:53:51.322 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-15T22:53:51.466 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:53:51.466 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-15T22:53:51.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-15T22:53:51.698 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:53:51.698 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-15T22:53:51.835 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:53:51.835 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-15T22:53:51.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:53:51.995 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-15T22:53:52.119 INFO:tasks.ceph:Archiving mon data... 2024-09-15T22:53:52.120 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/data/mon.a.tgz 2024-09-15T22:53:52.120 DEBUG:teuthology.orchestra.run.smithi031:> mktemp 2024-09-15T22:53:52.129 INFO:teuthology.orchestra.run.smithi031.stdout:/tmp/tmp.hMuZ1ZLBu3 2024-09-15T22:53:52.129 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.hMuZ1ZLBu3 2024-09-15T22:53:52.268 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0666 /tmp/tmp.hMuZ1ZLBu3 2024-09-15T22:53:52.349 DEBUG:teuthology.orchestra.remote:smithi031:/tmp/tmp.hMuZ1ZLBu3 is 368KB 2024-09-15T22:53:52.410 DEBUG:teuthology.orchestra.run.smithi031:> rm -fr /tmp/tmp.hMuZ1ZLBu3 2024-09-15T22:53:52.419 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/data/mon.b.tgz 2024-09-15T22:53:52.419 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-15T22:53:52.428 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.0CBheILxFc 2024-09-15T22:53:52.428 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0CBheILxFc 2024-09-15T22:53:52.586 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.0CBheILxFc 2024-09-15T22:53:52.663 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.0CBheILxFc is 485KB 2024-09-15T22:53:52.725 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.0CBheILxFc 2024-09-15T22:53:52.733 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/data/mon.c.tgz 2024-09-15T22:53:52.733 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-15T22:53:52.782 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.7EKQb6Hc4J 2024-09-15T22:53:52.783 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.7EKQb6Hc4J 2024-09-15T22:53:52.937 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.7EKQb6Hc4J 2024-09-15T22:53:53.011 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.7EKQb6Hc4J is 485KB 2024-09-15T22:53:53.077 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.7EKQb6Hc4J 2024-09-15T22:53:53.085 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-15T22:53:53.086 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:53:53.089 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-15T22:53:53.164 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:53:53.195 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-15T22:53:53.195 INFO:tasks.ceph:Archiving crash dumps... 2024-09-15T22:53:53.197 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi031/crash 2024-09-15T22:53:53.197 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:53:53.232 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi102/crash 2024-09-15T22:53:53.233 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-15T22:53:53.256 INFO:tasks.ceph:Shutting down logrotate 2024-09-15T22:53:53.257 DEBUG:teuthology.orchestra.run.smithi031:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:53.278 DEBUG:teuthology.orchestra.run.smithi102:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:53.344 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:53.365 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-15T22:53:53.383 INFO:tasks.ceph:Compressing logs... 2024-09-15T22:53:53.383 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:53:53.411 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-15T22:53:53.435 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40637.log 2024-09-15T22:53:53.436 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40924.log 2024-09-15T22:53:53.437 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40637.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37990.log 2024-09-15T22:53:53.437 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40637.log.gz 2024-09-15T22:53:53.438 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39359.log 2024-09-15T22:53:53.438 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40924.log.gz 2024-09-15T22:53:53.439 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36715.log 2024-09-15T22:53:53.439 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37990.log.gz 2024-09-15T22:53:53.440 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39359.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.23919.log 2024-09-15T22:53:53.440 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39359.log.gz 2024-09-15T22:53:53.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35984.log 2024-09-15T22:53:53.441 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36715.log.gz 2024-09-15T22:53:53.441 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.tmp-client.admin.23919.log: gzip 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.23919.log.gz 2024-09-15T22:53:53.441 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-15T22:53:53.442 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40846.log 2024-09-15T22:53:53.442 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35984.log.gz 2024-09-15T22:53:53.443 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40768.log 2024-09-15T22:53:53.443 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-15T22:53:53.444 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37099.log 2024-09-15T22:53:53.444 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40846.log.gz 2024-09-15T22:53:53.445 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39216.log 2024-09-15T22:53:53.445 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40768.log.gz 2024-09-15T22:53:53.446 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37581.log 2024-09-15T22:53:53.446 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37099.log.gz 2024-09-15T22:53:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39216.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-15T22:53:53.447 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39216.log.gz 2024-09-15T22:53:53.447 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40978.log 2024-09-15T22:53:53.447 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37581.log.gz 2024-09-15T22:53:53.448 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37886.log 2024-09-15T22:53:53.449 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39333.log 2024-09-15T22:53:53.449 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40978.log.gz 2024-09-15T22:53:53.450 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35334.log 2024-09-15T22:53:53.450 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37886.log.gz 2024-09-15T22:53:53.451 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29127.log 2024-09-15T22:53:53.451 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40245.log 2024-09-15T22:53:53.451 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39333.log.gz 2024-09-15T22:53:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35778.log 2024-09-15T22:53:53.453 INFO:teuthology.orchestra.run.smithi031.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-15T22:53:53.453 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35334.log.gz 2024-09-15T22:53:53.453 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40742.log 2024-09-15T22:53:53.453 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.40245.log.gz 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34824.log 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29103.log 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29127.log.gz 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.34824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34824.log.gz 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34908.log 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29103.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29103.log.gz 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.34908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.3.34908.log.gz 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-15T22:53:53.455 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-09-15T22:53:53.458 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2024-09-15T22:53:53.458 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29007.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-15T22:53:53.458 INFO:teuthology.orchestra.run.smithi102.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-09-15T22:53:53.458 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.28959.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-15T22:53:53.458 INFO:teuthology.orchestra.run.smithi102.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2024-09-15T22:53:53.459 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35962.log 2024-09-15T22:53:53.459 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35778.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36845.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40742.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41056.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35962.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.36845.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39244.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41056.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40898.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35199.log 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39244.log.gz 2024-09-15T22:53:53.460 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40898.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-15T22:53:53.461 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40898.log.gz 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.34806.log 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.1.34806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.34913.log 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.34806.log.gz 2024-09-15T22:53:53.463 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:53:53.464 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29079.log 2024-09-15T22:53:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38665.log 2024-09-15T22:53:53.464 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35199.log.gz 2024-09-15T22:53:53.464 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35981.log 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.38665.log.gz 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38226.log 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35981.log.gz 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36689.log 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40060.log 2024-09-15T22:53:53.465 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.38226.log.gz 2024-09-15T22:53:53.466 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.3.34913.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 0.0% 2024-09-15T22:53:53.466 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.3.34913.log.gz 2024-09-15T22:53:53.467 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.29079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29055.log 2024-09-15T22:53:53.467 INFO:teuthology.orchestra.run.smithi102.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29079.log.gz 2024-09-15T22:53:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34885.log 2024-09-15T22:53:53.467 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36689.log.gz 2024-09-15T22:53:53.467 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34604.log 2024-09-15T22:53:53.468 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40060.log.gz 2024-09-15T22:53:53.468 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36220.log 2024-09-15T22:53:53.468 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34885.log.gz 2024-09-15T22:53:53.470 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.29055.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-15T22:53:53.470 INFO:teuthology.orchestra.run.smithi102.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29055.log.gz 2024-09-15T22:53:53.470 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29031.log 2024-09-15T22:53:53.470 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34859.log 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34604.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34604.log.gz 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39674.log 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36220.log.gz 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37073.log 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34859.log.gz 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.39674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39674.log.gz 2024-09-15T22:53:53.471 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37661.log 2024-09-15T22:53:53.473 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-client.admin.29031.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29031.log.gz 2024-09-15T22:53:53.473 INFO:teuthology.orchestra.run.smithi102.stderr: 93.0%gzip -- replaced with /var/log/ceph/ceph-mds.d.log.gz -5 2024-09-15T22:53:53.473 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28983.log 2024-09-15T22:53:53.473 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34911.log 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37073.log.gz 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36962.log 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37661.log.gz 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39415.log 2024-09-15T22:53:53.474 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34911.log.gz 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.28983.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi102.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28983.log.gz 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35986.log 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36962.log.gz 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35360.log 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39415.log.gz 2024-09-15T22:53:53.476 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mds.b.log: /var/log/ceph/ceph-mon.b.log: 92.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-15T22:53:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35516.log 2024-09-15T22:53:53.477 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35986.log.gz 2024-09-15T22:53:53.477 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36741.log 2024-09-15T22:53:53.477 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35360.log.gz 2024-09-15T22:53:53.478 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38303.log 2024-09-15T22:53:53.478 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35516.log.gz 2024-09-15T22:53:53.479 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34479.log 2024-09-15T22:53:53.479 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36741.log.gz 2024-09-15T22:53:53.480 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-15T22:53:53.480 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36819.log 2024-09-15T22:53:53.480 INFO:teuthology.orchestra.run.smithi031.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.38303.log.gz 2024-09-15T22:53:53.481 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2024-09-15T22:53:53.481 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34479.log.gz 2024-09-15T22:53:53.482 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35412.log 2024-09-15T22:53:53.482 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36819.log.gz 2024-09-15T22:53:53.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40028.log 2024-09-15T22:53:53.483 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2024-09-15T22:53:53.483 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36246.log 2024-09-15T22:53:53.484 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35412.log.gz 2024-09-15T22:53:53.484 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35141.log 2024-09-15T22:53:53.485 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40028.log.gz 2024-09-15T22:53:53.485 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35560.log 2024-09-15T22:53:53.485 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36246.log.gz 2024-09-15T22:53:53.486 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35256.log 2024-09-15T22:53:53.487 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40349.log 2024-09-15T22:53:53.487 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35560.log.gz 2024-09-15T22:53:53.488 INFO:teuthology.orchestra.run.smithi031.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.35141.log.gz 2024-09-15T22:53:53.488 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36931.log 2024-09-15T22:53:53.488 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35256.log.gz 2024-09-15T22:53:53.489 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36793.log 2024-09-15T22:53:53.489 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40349.log.gz 2024-09-15T22:53:53.490 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36931.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-15T22:53:53.490 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36931.log.gz 2024-09-15T22:53:53.491 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35226.log 2024-09-15T22:53:53.491 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36793.log.gz 2024-09-15T22:53:53.492 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39857.log 2024-09-15T22:53:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28743.log 2024-09-15T22:53:53.493 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35226.log.gz 2024-09-15T22:53:53.493 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40090.log 2024-09-15T22:53:53.494 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.39857.log.gz 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36166.log 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28743.log.gz 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39621.log 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40090.log.gz 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39519.log 2024-09-15T22:53:53.496 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36166.log.gz 2024-09-15T22:53:53.497 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40401.log 2024-09-15T22:53:53.498 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39621.log.gz 2024-09-15T22:53:53.498 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39519.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.39519.log.gz 2024-09-15T22:53:53.498 INFO:teuthology.orchestra.run.smithi031.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.39066.log 2024-09-15T22:53:53.499 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-09-15T22:53:53.500 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40401.log.gz 2024-09-15T22:53:53.500 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39066.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39066.log.gz 2024-09-15T22:53:53.500 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38016.log 2024-09-15T22:53:53.501 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41186.log 2024-09-15T22:53:53.501 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-09-15T22:53:53.502 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38016.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-15T22:53:53.502 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38016.log.gz 2024-09-15T22:53:53.503 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37808.log 2024-09-15T22:53:53.503 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41186.log.gz 2024-09-15T22:53:53.504 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40472.log 2024-09-15T22:53:53.505 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37808.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37808.log.gz 2024-09-15T22:53:53.505 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40794.log 2024-09-15T22:53:53.506 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36298.log 2024-09-15T22:53:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40472.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40472.log.gz 2024-09-15T22:53:53.507 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36665.log 2024-09-15T22:53:53.508 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40794.log.gz 2024-09-15T22:53:53.508 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38953.log 2024-09-15T22:53:53.509 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36298.log.gz 2024-09-15T22:53:53.509 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.2.36665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36991.log 2024-09-15T22:53:53.510 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36665.log.gz 2024-09-15T22:53:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38953.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.38953.log.gz 2024-09-15T22:53:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36324.log 2024-09-15T22:53:53.511 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34512.log 2024-09-15T22:53:53.512 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36991.log: /var/log/ceph/ceph-client.admin.36324.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.36991.log.gz 2024-09-15T22:53:53.513 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40507.log 2024-09-15T22:53:53.513 INFO:teuthology.orchestra.run.smithi031.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36324.log.gz 2024-09-15T22:53:53.514 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38353.log 2024-09-15T22:53:53.514 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34512.log.gz 2024-09-15T22:53:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36194.log 2024-09-15T22:53:53.515 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38353.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40507.log.gz 2024-09-15T22:53:53.516 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38353.log.gz 2024-09-15T22:53:53.516 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36897.log 2024-09-15T22:53:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38613.log 2024-09-15T22:53:53.517 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36194.log: /var/log/ceph/ceph-client.admin.36897.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.36194.log.gz 2024-09-15T22:53:53.518 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36897.log.gz 2024-09-15T22:53:53.518 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38196.log 2024-09-15T22:53:53.519 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37125.log 2024-09-15T22:53:53.520 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38613.log: /var/log/ceph/ceph-client.0.38196.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38613.log.gz 2024-09-15T22:53:53.520 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.0.38196.log.gz -5 2024-09-15T22:53:53.520 INFO:teuthology.orchestra.run.smithi031.stderr: --verbose -- /var/log/ceph/ceph-client.admin.39307.log 2024-09-15T22:53:53.521 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40611.log 2024-09-15T22:53:53.521 INFO:teuthology.orchestra.run.smithi031.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37125.log.gz 2024-09-15T22:53:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.4.log: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-15T22:53:53.522 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37476.log 2024-09-15T22:53:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39307.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39307.log.gz 2024-09-15T22:53:53.523 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-09-15T22:53:53.523 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40611.log.gz 2024-09-15T22:53:53.524 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35562.log 2024-09-15T22:53:53.525 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37476.log.gz 2024-09-15T22:53:53.525 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38927.log 2024-09-15T22:53:53.526 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28954.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-09-15T22:53:53.526 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38379.log 2024-09-15T22:53:53.527 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35562.log.gz 2024-09-15T22:53:53.527 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38927.log: gzip -5 --verbose -- 88.2% /var/log/ceph/ceph-client.admin.37964.log -- replaced with /var/log/ceph/ceph-client.admin.38927.log.gz 2024-09-15T22:53:53.528 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-15T22:53:53.529 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34347.log 2024-09-15T22:53:53.529 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38379.log.gz 2024-09-15T22:53:53.530 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34632.log 2024-09-15T22:53:53.530 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37964.log.gz 2024-09-15T22:53:53.531 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39190.log 2024-09-15T22:53:53.531 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34347.log.gz 2024-09-15T22:53:53.532 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35555.log 2024-09-15T22:53:53.532 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34632.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34632.log.gz 2024-09-15T22:53:53.533 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-09-15T22:53:53.533 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39190.log.gz 2024-09-15T22:53:53.534 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38795.log 2024-09-15T22:53:53.534 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35555.log.gz 2024-09-15T22:53:53.535 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35774.log 2024-09-15T22:53:53.535 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-09-15T22:53:53.537 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38795.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.38795.log.gz 2024-09-15T22:53:53.537 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40271.log 2024-09-15T22:53:53.538 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39033.log 2024-09-15T22:53:53.538 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35774.log.gz 2024-09-15T22:53:53.539 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40271.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-15T22:53:53.539 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40271.log.gz 2024-09-15T22:53:53.540 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38979.log 2024-09-15T22:53:53.541 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39033.log: /var/log/ceph/ceph-osd.3.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39033.log.gz 2024-09-15T22:53:53.541 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35977.log 2024-09-15T22:53:53.542 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34937.log 2024-09-15T22:53:53.542 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38979.log.gz 2024-09-15T22:53:53.543 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35771.log 2024-09-15T22:53:53.543 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35977.log.gz 2024-09-15T22:53:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40446.log 2024-09-15T22:53:53.545 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34937.log.gz 2024-09-15T22:53:53.545 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37691.log 2024-09-15T22:53:53.546 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35771.log.gz 2024-09-15T22:53:53.546 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35308.log 2024-09-15T22:53:53.547 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40446.log.gz 2024-09-15T22:53:53.548 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40663.log 2024-09-15T22:53:53.548 INFO:teuthology.orchestra.run.smithi031.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37691.log.gz 2024-09-15T22:53:53.548 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35570.log 2024-09-15T22:53:53.549 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35308.log.gz 2024-09-15T22:53:53.550 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35490.log 2024-09-15T22:53:53.550 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40663.log.gz 2024-09-15T22:53:53.551 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39005.log 2024-09-15T22:53:53.551 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35570.log.gz 2024-09-15T22:53:53.552 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37503.log 2024-09-15T22:53:53.552 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35490.log.gz 2024-09-15T22:53:53.553 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35464.log 2024-09-15T22:53:53.553 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.39005.log.gz 2024-09-15T22:53:53.555 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38840.log 2024-09-15T22:53:53.555 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.37503.log.gz 2024-09-15T22:53:53.556 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35569.log 2024-09-15T22:53:53.556 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35464.log.gz 2024-09-15T22:53:53.556 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35386.log 2024-09-15T22:53:53.557 INFO:teuthology.orchestra.run.smithi031.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38840.log.gz 2024-09-15T22:53:53.558 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35569.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-15T22:53:53.558 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-09-15T22:53:53.559 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40533.log 2024-09-15T22:53:53.559 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35386.log.gz 2024-09-15T22:53:53.560 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41108.log 2024-09-15T22:53:53.561 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40533.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38068.log 2024-09-15T22:53:53.562 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40533.log.gz 2024-09-15T22:53:53.563 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41108.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41108.log.gz 2024-09-15T22:53:53.564 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38068.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38068.log.gz 2024-09-15T22:53:53.564 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37633.log 2024-09-15T22:53:53.565 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38548.log 2024-09-15T22:53:53.567 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40690.log 2024-09-15T22:53:53.567 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37633.log.gz 2024-09-15T22:53:53.568 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39571.log 2024-09-15T22:53:53.568 INFO:teuthology.orchestra.run.smithi031.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.38548.log.gz 2024-09-15T22:53:53.569 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35976.log 2024-09-15T22:53:53.569 INFO:teuthology.orchestra.run.smithi031.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40690.log.gz 2024-09-15T22:53:53.570 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38435.log 2024-09-15T22:53:53.571 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35976.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39571.log.gz 2024-09-15T22:53:53.571 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37912.log 2024-09-15T22:53:53.572 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35976.log.gz 2024-09-15T22:53:53.573 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39781.log 2024-09-15T22:53:53.573 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.38435.log.gz 2024-09-15T22:53:53.574 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36272.log 2024-09-15T22:53:53.574 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37912.log.gz 2024-09-15T22:53:53.575 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40323.log 2024-09-15T22:53:53.576 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36272.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.39781.log.gz 2024-09-15T22:53:53.576 INFO:teuthology.orchestra.run.smithi031.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36272.log.gz 2024-09-15T22:53:53.578 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40323.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40323.log.gz 2024-09-15T22:53:53.578 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38639.log 2024-09-15T22:53:53.579 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39467.log 2024-09-15T22:53:53.581 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35985.log 2024-09-15T22:53:53.581 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38639.log.gz 2024-09-15T22:53:53.582 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34963.log 2024-09-15T22:53:53.582 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39467.log.gz 2024-09-15T22:53:53.583 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36350.log 2024-09-15T22:53:53.583 INFO:teuthology.orchestra.run.smithi031.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35985.log.gz 2024-09-15T22:53:53.585 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37047.log 2024-09-15T22:53:53.585 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36350.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.34963.log.gz 2024-09-15T22:53:53.586 INFO:teuthology.orchestra.run.smithi031.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.36350.log.gz 2024-09-15T22:53:53.587 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37047.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37047.log.gz 2024-09-15T22:53:53.587 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37177.log 2024-09-15T22:53:53.589 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-15T22:53:53.590 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37424.log 2024-09-15T22:53:53.590 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.37177.log.gz 2024-09-15T22:53:53.591 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37021.log 2024-09-15T22:53:53.592 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37424.log: 85.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-15T22:53:53.592 INFO:teuthology.orchestra.run.smithi031.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.37424.log.gz 2024-09-15T22:53:53.593 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-15T22:53:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37607.log 2024-09-15T22:53:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37021.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37021.log.gz 2024-09-15T22:53:53.594 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39272.log 2024-09-15T22:53:53.595 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37752.log 2024-09-15T22:53:53.595 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37607.log.gz 2024-09-15T22:53:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37938.log 2024-09-15T22:53:53.597 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39272.log.gz 2024-09-15T22:53:53.597 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37752.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37752.log.gz 2024-09-15T22:53:53.598 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40120.log 2024-09-15T22:53:53.599 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37938.log.gz 2024-09-15T22:53:53.599 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36416.log 2024-09-15T22:53:53.601 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37860.log 2024-09-15T22:53:53.601 INFO:teuthology.orchestra.run.smithi031.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.40120.log.gz 2024-09-15T22:53:53.602 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35563.log 2024-09-15T22:53:53.602 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36416.log.gz 2024-09-15T22:53:53.603 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37860.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37860.log.gz 2024-09-15T22:53:53.603 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.36660.log 2024-09-15T22:53:53.604 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35563.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35563.log.gz 2024-09-15T22:53:53.604 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37726.log 2024-09-15T22:53:53.605 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.2.36660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34578.log 2024-09-15T22:53:53.605 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.36660.log.gz 2024-09-15T22:53:53.606 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-15T22:53:53.607 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37726.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37726.log.gz 2024-09-15T22:53:53.608 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34578.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34578.log.gz 2024-09-15T22:53:53.608 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37778.log 2024-09-15T22:53:53.609 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35961.log 2024-09-15T22:53:53.611 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40872.log 2024-09-15T22:53:53.611 INFO:teuthology.orchestra.run.smithi031.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37778.log.gz 2024-09-15T22:53:53.612 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35961.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35961.log.gz 2024-09-15T22:53:53.613 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40872.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40872.log.gz 2024-09-15T22:53:53.613 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40150.log 2024-09-15T22:53:53.614 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39545.log 2024-09-15T22:53:53.616 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35438.log 2024-09-15T22:53:53.616 INFO:teuthology.orchestra.run.smithi031.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40150.log.gz 2024-09-15T22:53:53.617 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39545.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39545.log.gz 2024-09-15T22:53:53.618 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35438.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35438.log.gz 2024-09-15T22:53:53.619 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37151.log 2024-09-15T22:53:53.620 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37555.log 2024-09-15T22:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40375.log 2024-09-15T22:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.37151.log.gz 2024-09-15T22:53:53.622 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37555.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37555.log.gz 2024-09-15T22:53:53.623 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40375.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40375.log.gz 2024-09-15T22:53:53.624 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39913.log 2024-09-15T22:53:53.625 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40187.log 2024-09-15T22:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39164.log 2024-09-15T22:53:53.627 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40187.log: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.39913.log.gz 2024-09-15T22:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40187.log.gz 2024-09-15T22:53:53.628 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39164.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.39164.log.gz 2024-09-15T22:53:53.629 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37203.log 2024-09-15T22:53:53.630 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40297.log 2024-09-15T22:53:53.632 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38042.log 2024-09-15T22:53:53.632 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37203.log.gz/var/log/ceph/ceph-client.admin.40297.log: 2024-09-15T22:53:53.633 INFO:teuthology.orchestra.run.smithi031.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40297.log.gz 2024-09-15T22:53:53.634 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38042.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38042.log.gz 2024-09-15T22:53:53.634 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34688.log 2024-09-15T22:53:53.635 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34723.log 2024-09-15T22:53:53.637 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41160.log 2024-09-15T22:53:53.637 INFO:teuthology.orchestra.run.smithi031.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34688.log.gz 2024-09-15T22:53:53.638 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34723.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34723.log.gz 2024-09-15T22:53:53.639 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41160.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41160.log.gz 2024-09-15T22:53:53.639 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38144.log 2024-09-15T22:53:53.640 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39493.log 2024-09-15T22:53:53.642 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41004.log 2024-09-15T22:53:53.643 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38144.log.gz 2024-09-15T22:53:53.643 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39493.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.39493.log.gz 2024-09-15T22:53:53.644 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41004.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.41004.log.gz 2024-09-15T22:53:53.644 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35757.log 2024-09-15T22:53:53.646 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39704.log 2024-09-15T22:53:53.647 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35757.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-15T22:53:53.648 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35757.log.gz 2024-09-15T22:53:53.648 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39704.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.39704.log.gz 2024-09-15T22:53:53.650 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph.audit.log: 89.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-15T22:53:53.651 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37327.log 2024-09-15T22:53:53.652 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-15T22:53:53.654 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37327.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39998.log 2024-09-15T22:53:53.654 INFO:teuthology.orchestra.run.smithi031.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37327.log.gz 2024-09-15T22:53:53.656 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.39998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38717.log 2024-09-15T22:53:53.657 INFO:teuthology.orchestra.run.smithi031.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39998.log.gz 2024-09-15T22:53:53.657 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-15T22:53:53.659 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38717.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38717.log.gz 2024-09-15T22:53:53.664 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36871.log 2024-09-15T22:53:53.666 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38901.log 2024-09-15T22:53:53.667 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.36871.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38581.log 2024-09-15T22:53:53.667 INFO:teuthology.orchestra.run.smithi031.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36871.log.gz 2024-09-15T22:53:53.668 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35768.log 2024-09-15T22:53:53.668 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38901.log.gz 2024-09-15T22:53:53.670 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38581.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38581.log.gz 2024-09-15T22:53:53.671 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37834.log 2024-09-15T22:53:53.674 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41082.log 2024-09-15T22:53:53.676 INFO:teuthology.orchestra.run.smithi031.stderr: 88.4%/var/log/ceph/ceph-client.admin.35768.log: -- replaced with /var/log/ceph/ceph-client.admin.37834.log.gz 2024-09-15T22:53:53.677 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35768.log.gz 2024-09-15T22:53:53.678 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38191.log 2024-09-15T22:53:53.679 INFO:teuthology.orchestra.run.smithi031.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41082.log.gz 2024-09-15T22:53:53.681 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.38191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38769.log 2024-09-15T22:53:53.682 INFO:teuthology.orchestra.run.smithi031.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.38191.log.gz 2024-09-15T22:53:53.683 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34660.log 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38769.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.38769.log.gz 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34660.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34660.log.gz 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38743.log 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38743.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38743.log.gz 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35282.log 2024-09-15T22:53:53.692 INFO:teuthology.orchestra.run.smithi031.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-15T22:53:53.693 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40952.log 2024-09-15T22:53:53.693 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41030.log 2024-09-15T22:53:53.693 INFO:teuthology.orchestra.run.smithi031.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35282.log.gz 2024-09-15T22:53:53.694 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40952.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40952.log.gz 2024-09-15T22:53:53.694 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.41030.log: /var/log/ceph/ceph-client.0.36532.log 2024-09-15T22:53:53.695 INFO:teuthology.orchestra.run.smithi031.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41030.log.gz 2024-09-15T22:53:53.696 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35013.log 2024-09-15T22:53:53.697 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.36532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36532.log.gz 2024-09-15T22:53:53.698 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35552.log 2024-09-15T22:53:53.699 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35013.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35013.log.gz 2024-09-15T22:53:53.700 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35552.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35552.log.gz 2024-09-15T22:53:53.701 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39887.log 2024-09-15T22:53:53.702 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40820.log 2024-09-15T22:53:53.704 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39887.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39887.log.gz 2024-09-15T22:53:53.704 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40820.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.40820.log.gz 2024-09-15T22:53:53.705 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41136.log 2024-09-15T22:53:53.706 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39669.log 2024-09-15T22:53:53.708 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.41136.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41136.log.gz 2024-09-15T22:53:53.708 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.39669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.39669.log.gz 2024-09-15T22:53:53.709 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35765.log 2024-09-15T22:53:53.710 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39118.log 2024-09-15T22:53:53.711 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35765.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35765.log.gz 2024-09-15T22:53:53.712 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39118.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.39118.log.gz 2024-09-15T22:53:53.713 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34833.log 2024-09-15T22:53:53.714 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37359.log 2024-09-15T22:53:53.717 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34833.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34833.log.gz 2024-09-15T22:53:53.717 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37359.log.gz 2024-09-15T22:53:53.717 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36550.log 2024-09-15T22:53:53.718 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34781.log 2024-09-15T22:53:53.719 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.0.36550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.36550.log.gz 2024-09-15T22:53:53.720 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34781.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34781.log.gz 2024-09-15T22:53:53.721 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40716.log 2024-09-15T22:53:53.722 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38409.log 2024-09-15T22:53:53.724 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40716.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40716.log.gz 2024-09-15T22:53:53.724 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38409.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38409.log.gz 2024-09-15T22:53:53.725 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39441.log 2024-09-15T22:53:53.726 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34753.log 2024-09-15T22:53:53.728 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39441.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39441.log.gz 2024-09-15T22:53:53.728 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.34753.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34753.log.gz 2024-09-15T22:53:53.729 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28853.log 2024-09-15T22:53:53.730 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35758.log 2024-09-15T22:53:53.732 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.28853.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28853.log.gz 2024-09-15T22:53:53.733 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35758.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35758.log.gz 2024-09-15T22:53:53.733 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40219.log 2024-09-15T22:53:53.734 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-09-15T22:53:53.736 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40219.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40219.log.gz 2024-09-15T22:53:53.737 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37301.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-09-15T22:53:53.737 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37529.log 2024-09-15T22:53:53.739 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40585.log 2024-09-15T22:53:53.740 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37529.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37529.log.gz 2024-09-15T22:53:53.741 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.40585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40585.log.gz 2024-09-15T22:53:53.741 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39831.log 2024-09-15T22:53:53.743 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39963.log 2024-09-15T22:53:53.744 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39831.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39831.log.gz 2024-09-15T22:53:53.745 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39963.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39963.log.gz 2024-09-15T22:53:53.745 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37450.log 2024-09-15T22:53:53.747 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38094.log 2024-09-15T22:53:53.748 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37450.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.37450.log.gz 2024-09-15T22:53:53.749 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38094.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38094.log.gz 2024-09-15T22:53:53.750 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38691.log 2024-09-15T22:53:53.751 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-09-15T22:53:53.753 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.38691.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38691.log.gz 2024-09-15T22:53:53.754 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.35565.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-09-15T22:53:53.755 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37275.log 2024-09-15T22:53:53.756 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-09-15T22:53:53.758 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.37275.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37275.log.gz 2024-09-15T22:53:53.758 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-client.admin.39389.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-09-15T22:53:53.782 INFO:teuthology.orchestra.run.smithi031.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-15T22:53:53.807 INFO:teuthology.orchestra.run.smithi031.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-15T22:53:54.213 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-15T22:53:54.232 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-15T22:53:54.239 INFO:teuthology.orchestra.run.smithi102.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-15T22:53:54.255 INFO:teuthology.orchestra.run.smithi102.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-15T22:53:54.258 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-15T22:53:54.258 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m0.825s 2024-09-15T22:53:54.258 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m3.144s 2024-09-15T22:53:54.258 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.353s 2024-09-15T22:53:54.303 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-15T22:53:54.341 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-15T22:53:54.417 INFO:teuthology.orchestra.run.smithi031.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-15T22:53:54.422 INFO:teuthology.orchestra.run.smithi031.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-15T22:53:54.424 INFO:teuthology.orchestra.run.smithi031.stderr: 2024-09-15T22:53:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m1.010s 2024-09-15T22:53:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m3.805s 2024-09-15T22:53:54.425 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.753s 2024-09-15T22:53:54.426 INFO:tasks.ceph:Archiving logs... 2024-09-15T22:53:54.426 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi031/log 2024-09-15T22:53:54.427 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:53:55.057 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi102/log 2024-09-15T22:53:55.058 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-15T22:53:55.445 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-15T22:53:55.454 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-15T22:53:55.454 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:53:55.457 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-15T22:53:55.531 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-15T22:53:55.541 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-15T22:53:55.541 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:53:55.544 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout:============================================================================== 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout:+hv01.front.sepi 67.205.162.81 3 u 47 64 177 0.082 -1.675 0.551 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout:+hv02.front.sepi 96.245.170.99 3 u 43 64 177 0.071 +0.716 0.685 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout:*hv03.front.sepi 74.6.168.72 3 u 47 64 177 0.082 +0.011 0.867 2024-09-15T22:53:55.557 INFO:teuthology.orchestra.run.smithi031.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: remote refid st t when poll reach delay offset jitter 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout:============================================================================== 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout:+hv01.front.sepi 67.205.162.81 3 u 45 64 177 0.072 -2.106 1.178 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout:+hv02.front.sepi 96.245.170.99 3 u 48 64 177 0.118 +0.674 1.619 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout:*hv03.front.sepi 74.6.168.72 3 u 47 64 177 0.113 -0.246 1.559 2024-09-15T22:53:55.559 INFO:teuthology.orchestra.run.smithi102.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-15T22:53:55.560 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-15T22:53:55.585 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-15T22:53:55.585 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-15T22:53:55.643 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-15T22:53:55.687 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-15T22:53:55.725 INFO:teuthology.task.internal:Duration was 947.580932 seconds 2024-09-15T22:53:55.725 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-15T22:53:55.760 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-15T22:53:55.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:53:55.764 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-15T22:53:55.876 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-15T22:53:55.876 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2024-09-15T22:53:55.877 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:53:55.898 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-15T22:53:55.898 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-15T22:53:55.919 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-15T22:53:55.919 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:53:55.946 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-15T22:53:56.001 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-15T22:53:56.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:53:56.030 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-15T22:53:56.113 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-15T22:53:56.123 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-15T22:53:56.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:53:56.144 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-15T22:53:56.164 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-15T22:53:56.176 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:53:56.190 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:53:56.204 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2024-09-15T22:53:56.227 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-15T22:53:56.245 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:53:56.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:53:56.274 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-15T22:53:56.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-15T22:53:56.294 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-15T22:53:56.321 INFO:teuthology.task.internal:Transferring archived files... 2024-09-15T22:53:56.321 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi031 2024-09-15T22:53:56.322 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:53:56.348 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-15_21:24:03-fs-squid-distro-default-smithi/7906272/remote/smithi102 2024-09-15T22:53:56.349 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-15T22:53:56.374 INFO:teuthology.task.internal:Removing archive directory... 2024-09-15T22:53:56.374 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:53:56.390 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-15T22:53:56.422 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-15T22:53:56.433 INFO:teuthology.task.internal:Not uploading archives. 2024-09-15T22:53:56.433 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-15T22:53:56.464 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-15T22:53:56.464 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:53:56.467 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-15T22:53:56.473 INFO:teuthology.orchestra.run.smithi031.stdout: 658142 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:53 /home/ubuntu/cephtest 2024-09-15T22:53:56.475 INFO:teuthology.orchestra.run.smithi102.stdout: 658143 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 15 22:53 /home/ubuntu/cephtest 2024-09-15T22:53:56.477 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-15T22:53:56.502 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-15T22:53:56.603 INFO:teuthology.run:Summary data: client.0-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a client.1-kernel-sha1: 2ca44a2f35ca8f36983aaaa46d49312239ef519a description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} subvol_versions/create_subvol_version_v1 tasks/openfiletable} duration: 947.5809323787689 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-15T22:53:56.604 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-15T22:53:56.668 INFO:teuthology.run:pass